2024-04-22T06:24:32.264 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-22T06:24:32.264 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134 --name leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/fs/trivial_sync}} --owner scheduled_leonidus@teuthology --verbose -- /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/orig.config.yaml 2024-04-22T06:24:32.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T06:24:32.408 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/fs/trivial_sync}} email: null first_in_suite: false job_id: '7668134' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4362 sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 sleep_before_teardown: 0 subset: 222/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi113.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZ+77ifGZn2SiyzutY+8PjwaIY2E0agniXCAOSoNasPOzGOp5fR+Wle6IyCvhVhzh7Hc2OSF6w/MIKLr6txO14= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOWuUrUsYKZM9f3ntSvSFzMMULsB7naGYopwRAMwxaMNMQS4zAq7B1mBDsdK2ZH7UMBHL9Erac9RHCiWANJzEYI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-22_05:52:53 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-22T06:24:32.408 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa; will attempt to use it 2024-04-22T06:24:32.409 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks 2024-04-22T06:24:32.409 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-22T06:24:32.411 INFO:teuthology.task.internal:Checking packages... 2024-04-22T06:24:32.433 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '86f7587a5a09af35f0895e1a2d08527638fae697' 2024-04-22T06:24:32.433 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-22T06:24:32.433 INFO:teuthology.packaging:ref: None 2024-04-22T06:24:32.433 INFO:teuthology.packaging:tag: None 2024-04-22T06:24:32.433 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-22T06:24:32.433 INFO:teuthology.packaging:sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T06:24:32.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-22T06:24:32.605 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.g86f7587a 2024-04-22T06:24:32.607 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-22T06:24:32.614 INFO:teuthology.task.internal:no buildpackages task found 2024-04-22T06:24:32.615 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-22T06:24:32.619 INFO:teuthology.task.internal:Saving configuration 2024-04-22T06:24:32.638 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-22T06:24:32.643 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-22T06:24:32.671 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 06:18:58.690215', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZ+77ifGZn2SiyzutY+8PjwaIY2E0agniXCAOSoNasPOzGOp5fR+Wle6IyCvhVhzh7Hc2OSF6w/MIKLr6txO14='} 2024-04-22T06:24:32.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 06:18:58.689080', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOWuUrUsYKZM9f3ntSvSFzMMULsB7naGYopwRAMwxaMNMQS4zAq7B1mBDsdK2ZH7UMBHL9Erac9RHCiWANJzEYI='} 2024-04-22T06:24:32.698 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-22T06:24:32.703 INFO:teuthology.task.internal:roles: ubuntu@smithi113.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-22T06:24:32.703 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-22T06:24:32.703 INFO:teuthology.run_tasks:Running task console_log... 2024-04-22T06:24:32.773 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5ac2f220d0>, signals=[15]) 2024-04-22T06:24:32.774 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-22T06:24:32.780 INFO:teuthology.task.internal:Opening connections... 2024-04-22T06:24:32.780 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:24:32.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T06:24:32.865 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:24:32.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T06:24:32.949 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-22T06:24:32.955 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-04-22T06:24:32.973 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-04-22T06:24:32.973 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-04-22T06:24:33.030 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2024-04-22T06:24:33.031 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-22T06:24:33.031 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-04-22T06:24:33.031 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-22T06:24:33.031 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-22T06:24:33.031 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-22T06:24:33.031 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-04-22T06:24:33.060 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-04-22T06:24:33.077 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-04-22T06:24:33.077 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-04-22T06:24:33.135 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-04-22T06:24:33.135 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-04-22T06:24:33.135 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-04-22T06:24:33.135 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-22T06:24:33.136 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-22T06:24:33.136 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-04-22T06:24:33.160 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-22T06:24:33.169 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-22T06:24:33.173 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-22T06:24:33.173 DEBUG:teuthology.orchestra.run.smithi113:> test '!' -e /home/ubuntu/cephtest 2024-04-22T06:24:33.176 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-04-22T06:24:33.192 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-22T06:24:33.197 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-22T06:24:33.198 DEBUG:teuthology.orchestra.run.smithi113:> test -z $(ls -A /var/lib/ceph) 2024-04-22T06:24:33.233 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-04-22T06:24:33.331 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-22T06:24:33.390 INFO:teuthology.run_tasks:Running task kernel... 2024-04-22T06:24:33.403 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-22T06:24:33.403 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-22T06:24:33.404 DEBUG:teuthology.orchestra.run.smithi113:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-22T06:24:33.404 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-22T06:24:33.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:24:33.420 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2024-04-22T06:24:33.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:24:33.421 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-04-22T06:24:33.477 INFO:teuthology.orchestra.run.smithi113.stdout:5.14.0-437.el9.x86_64 2024-04-22T06:24:33.477 INFO:teuthology.task.kernel:Running kernel on smithi113: 5.14.0-437.el9.x86_64 2024-04-22T06:24:33.477 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum install -y kernel 2024-04-22T06:24:33.478 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-437.el9.x86_64 2024-04-22T06:24:33.478 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.14.0-437.el9.x86_64 2024-04-22T06:24:33.479 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum install -y kernel 2024-04-22T06:24:35.795 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-22T06:24:36.126 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.0 MB 00:00 2024-04-22T06:24:37.630 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-22T06:24:38.294 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-22T06:24:41.872 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-04-22T06:24:42.901 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.2 MB 00:00 2024-04-22T06:24:43.473 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 16 kB 00:00 2024-04-22T06:24:44.452 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-22T06:24:46.782 INFO:teuthology.orchestra.run.smithi113.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 21 MB 00:03 2024-04-22T06:24:47.319 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 21 MB 00:02 2024-04-22T06:24:51.748 INFO:teuthology.orchestra.run.smithi113.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-22T06:24:52.477 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-22T06:24:53.595 INFO:teuthology.orchestra.run.smithi113.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-22T06:24:53.595 INFO:teuthology.orchestra.run.smithi113.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-22T06:24:53.688 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-04-22T06:24:53.689 INFO:teuthology.orchestra.run.smithi113.stdout:Nothing to do. 2024-04-22T06:24:53.690 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2024-04-22T06:24:53.811 DEBUG:teuthology.orchestra.run.smithi113:> echo no | sudo yum reinstall kernel || true 2024-04-22T06:24:54.309 INFO:teuthology.orchestra.run.smithi113.stdout:Last metadata expiration check: 0:00:03 ago on Mon 22 Apr 2024 06:24:51 AM UTC. 2024-04-22T06:24:54.333 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-22T06:24:54.333 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-22T06:24:54.426 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-04-22T06:24:54.427 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-04-22T06:24:54.427 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-04-22T06:24:54.434 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-04-22T06:24:54.445 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-22T06:24:54.445 INFO:teuthology.orchestra.run.smithi113.stdout: Package Architecture Version Repository Size 2024-04-22T06:24:54.445 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-22T06:24:54.445 INFO:teuthology.orchestra.run.smithi113.stdout:Reinstalling: 2024-04-22T06:24:54.445 INFO:teuthology.orchestra.run.smithi113.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-22T06:24:54.445 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:24:54.445 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2024-04-22T06:24:54.445 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-22T06:24:54.446 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:24:54.446 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 255 k 2024-04-22T06:24:54.446 INFO:teuthology.orchestra.run.smithi113.stdout:Installed size: 0 2024-04-22T06:24:54.446 INFO:teuthology.orchestra.run.smithi113.stderr:Operation aborted. 2024-04-22T06:24:54.500 INFO:teuthology.orchestra.run.smithi113.stdout:Is this ok [y/N]: 2024-04-22T06:24:54.501 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum reinstall -y kernel || true 2024-04-22T06:24:54.550 DEBUG:teuthology.orchestra.run.smithi145:> echo no | sudo yum reinstall kernel || true 2024-04-22T06:24:54.990 INFO:teuthology.orchestra.run.smithi113.stdout:Last metadata expiration check: 0:00:03 ago on Mon 22 Apr 2024 06:24:51 AM UTC. 2024-04-22T06:24:55.044 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:03 ago on Mon 22 Apr 2024 06:24:52 AM UTC. 2024-04-22T06:24:55.105 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-04-22T06:24:55.106 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-22T06:24:55.106 INFO:teuthology.orchestra.run.smithi113.stdout: Package Architecture Version Repository Size 2024-04-22T06:24:55.106 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-22T06:24:55.106 INFO:teuthology.orchestra.run.smithi113.stdout:Reinstalling: 2024-04-22T06:24:55.106 INFO:teuthology.orchestra.run.smithi113.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-22T06:24:55.106 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:24:55.106 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2024-04-22T06:24:55.107 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-04-22T06:24:55.107 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:24:55.107 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 255 k 2024-04-22T06:24:55.107 INFO:teuthology.orchestra.run.smithi113.stdout:Installed size: 0 2024-04-22T06:24:55.107 INFO:teuthology.orchestra.run.smithi113.stdout:Downloading Packages: 2024-04-22T06:24:55.188 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout:Reinstalling: 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 255 k 2024-04-22T06:24:55.198 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 0 2024-04-22T06:24:55.199 INFO:teuthology.orchestra.run.smithi145.stderr:Operation aborted. 2024-04-22T06:24:55.257 INFO:teuthology.orchestra.run.smithi145.stdout:Is this ok [y/N]: 2024-04-22T06:24:55.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum reinstall -y kernel || true 2024-04-22T06:24:55.592 INFO:teuthology.orchestra.run.smithi113.stdout:kernel-5.14.0-437.el9.x86_64.rpm 770 kB/s | 255 kB 00:00 2024-04-22T06:24:55.592 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2024-04-22T06:24:55.592 INFO:teuthology.orchestra.run.smithi113.stdout:Total 525 kB/s | 255 kB 00:00 2024-04-22T06:24:55.606 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction check 2024-04-22T06:24:55.747 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:03 ago on Mon 22 Apr 2024 06:24:52 AM UTC. 2024-04-22T06:24:55.792 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction check succeeded. 2024-04-22T06:24:55.792 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction test 2024-04-22T06:24:55.797 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction test succeeded. 2024-04-22T06:24:55.798 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction 2024-04-22T06:24:55.862 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout:Reinstalling: 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 255 k 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 0 2024-04-22T06:24:55.863 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-04-22T06:24:55.946 INFO:teuthology.orchestra.run.smithi113.stdout: Preparing : 1/1 2024-04-22T06:24:56.034 INFO:teuthology.orchestra.run.smithi113.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-22T06:24:56.034 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T06:24:56.204 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.1 MB/s | 255 kB 00:00 2024-04-22T06:24:56.204 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-04-22T06:24:56.204 INFO:teuthology.orchestra.run.smithi145.stdout:Total 748 kB/s | 255 kB 00:00 2024-04-22T06:24:56.221 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-04-22T06:24:56.392 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-04-22T06:24:56.392 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-04-22T06:24:56.397 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-04-22T06:24:56.397 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-04-22T06:24:56.538 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-04-22T06:24:56.613 INFO:teuthology.orchestra.run.smithi145.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-22T06:24:56.613 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T06:24:56.802 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T06:24:56.802 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-22T06:24:57.296 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T06:24:57.297 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-22T06:24:57.483 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T06:24:57.483 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:24:57.483 INFO:teuthology.orchestra.run.smithi113.stdout:Reinstalled: 2024-04-22T06:24:57.483 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-22T06:24:57.484 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:24:57.484 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2024-04-22T06:24:57.638 DEBUG:teuthology.orchestra.run.smithi113:> rpm -q kernel | sort -rV | head -n 1 2024-04-22T06:24:57.685 INFO:teuthology.orchestra.run.smithi113.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-22T06:24:57.685 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-22T06:24:57.685 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-22T06:24:57.686 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-22T06:24:57.686 DEBUG:teuthology.orchestra.run.smithi113:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-22T06:24:57.714 INFO:teuthology.orchestra.run.smithi113.stdout:ttyS1 2024-04-22T06:24:57.739 DEBUG:teuthology.parallel:result is None 2024-04-22T06:24:57.994 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T06:24:57.994 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:24:57.995 INFO:teuthology.orchestra.run.smithi145.stdout:Reinstalled: 2024-04-22T06:24:57.995 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-22T06:24:57.995 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:24:57.995 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-04-22T06:24:58.185 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-04-22T06:24:58.232 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-22T06:24:58.232 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-22T06:24:58.232 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-22T06:24:58.232 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-22T06:24:58.232 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-22T06:24:58.261 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-04-22T06:24:58.282 DEBUG:teuthology.parallel:result is None 2024-04-22T06:24:58.282 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-22T06:24:58.290 INFO:teuthology.task.internal:Creating test directory... 2024-04-22T06:24:58.290 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-22T06:24:58.293 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-22T06:24:58.337 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-22T06:24:58.345 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-22T06:24:58.482 INFO:teuthology.task.internal:Creating archive directory... 2024-04-22T06:24:58.483 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-22T06:24:58.485 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-22T06:24:58.522 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-22T06:24:58.530 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-22T06:24:58.530 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-22T06:24:58.550 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-22T06:24:58.589 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T06:24:58.598 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T06:24:58.600 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T06:24:58.610 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T06:24:58.612 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-22T06:24:58.620 INFO:teuthology.task.internal:Configuring sudo... 2024-04-22T06:24:58.620 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-22T06:24:58.622 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-22T06:24:58.663 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-22T06:24:58.674 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-22T06:24:58.674 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-22T06:24:58.689 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-22T06:24:58.718 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T06:24:58.792 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T06:24:58.831 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T06:24:58.919 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T06:24:58.951 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:24:58.951 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-22T06:24:59.014 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T06:24:59.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T06:24:59.112 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T06:24:59.199 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T06:24:59.232 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:24:59.232 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-22T06:24:59.295 DEBUG:teuthology.orchestra.run.smithi113:> sudo service rsyslog restart 2024-04-22T06:24:59.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-04-22T06:24:59.329 INFO:teuthology.orchestra.run.smithi113.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T06:24:59.369 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T06:24:59.732 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-22T06:24:59.740 INFO:teuthology.task.internal:Starting timer... 2024-04-22T06:24:59.740 INFO:teuthology.run_tasks:Running task pcp... 2024-04-22T06:24:59.760 INFO:teuthology.run_tasks:Running task selinux... 2024-04-22T06:24:59.769 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-22T06:24:59.770 DEBUG:teuthology.orchestra.run.smithi113:> sudo service auditd rotate 2024-04-22T06:24:59.825 INFO:teuthology.orchestra.run.smithi113.stdout:Rotating logs: 2024-04-22T06:24:59.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-04-22T06:24:59.899 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-04-22T06:24:59.900 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-22T06:24:59.901 DEBUG:teuthology.orchestra.run.smithi113:> /usr/sbin/getenforce 2024-04-22T06:24:59.933 INFO:teuthology.orchestra.run.smithi113.stdout:Permissive 2024-04-22T06:24:59.933 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-04-22T06:24:59.961 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-04-22T06:24:59.961 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi113.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2024-04-22T06:24:59.962 DEBUG:teuthology.orchestra.run.smithi113:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T06:24:59.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:24:59.997 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T06:25:00.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:25:00.025 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-22T06:25:00.025 DEBUG:teuthology.orchestra.run.smithi113:> sudo /usr/sbin/setenforce permissive 2024-04-22T06:25:00.062 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-04-22T06:25:00.090 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-22T06:25:00.099 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-22T06:25:00.114 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-22T06:25:00.116 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi113.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-22T06:28:29.476 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi113.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-04-22T06:28:29.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-22T06:28:29.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T06:28:29.561 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-04-22T06:28:29.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-22T06:28:29.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-04-22T06:28:29.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T06:28:29.724 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-04-22T06:28:29.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-04-22T06:28:29.805 INFO:teuthology.run_tasks:Running task clock... 2024-04-22T06:28:29.819 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-22T06:28:29.819 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-22T06:28:29.820 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T06:28:29.822 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-22T06:28:29.822 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T06:28:29.848 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-22T06:28:29.861 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-22T06:28:29.873 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-22T06:28:29.883 INFO:teuthology.orchestra.run.smithi113.stderr:sudo: ntpd: command not found 2024-04-22T06:28:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-22T06:28:29.893 INFO:teuthology.orchestra.run.smithi113.stdout:506 Cannot talk to daemon 2024-04-22T06:28:29.906 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-22T06:28:29.908 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-04-22T06:28:29.919 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-04-22T06:28:29.919 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-22T06:28:29.932 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-22T06:28:29.945 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-22T06:28:29.973 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 1: ntpq: command not found 2024-04-22T06:28:29.977 INFO:teuthology.orchestra.run.smithi113.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T06:28:29.977 INFO:teuthology.orchestra.run.smithi113.stdout:=============================================================================== 2024-04-22T06:28:29.977 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:28:29.978 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:28:29.978 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:28:29.978 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:28:30.000 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-04-22T06:28:30.004 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T06:28:30.004 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-04-22T06:28:30.004 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:28:30.004 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:28:30.004 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:28:30.004 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:28:30.004 INFO:teuthology.run_tasks:Running task install... 2024-04-22T06:28:30.014 DEBUG:teuthology.task.install:project ceph 2024-04-22T06:28:30.014 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}} 2024-04-22T06:28:30.014 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'} 2024-04-22T06:28:30.014 INFO:teuthology.task.install:Using flavor: default 2024-04-22T06:28:30.021 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-22T06:28:30.021 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-22T06:28:30.022 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'tag': None, 'wait_for_package': False} 2024-04-22T06:28:30.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T06:28:30.025 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'tag': None, 'wait_for_package': False} 2024-04-22T06:28:30.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T06:28:30.267 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/ 2024-04-22T06:28:30.267 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.g86f7587a 2024-04-22T06:28:30.279 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/ 2024-04-22T06:28:30.279 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.g86f7587a 2024-04-22T06:28:30.424 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-22T06:28:30.424 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:28:30.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-22T06:28:30.449 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-22T06:28:30.449 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86f7587a5a09af35f0895e1a2d08527638fae697/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-22T06:28:30.463 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-22T06:28:30.463 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:28:30.463 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-22T06:28:30.489 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-22T06:28:30.489 DEBUG:teuthology.orchestra.run.smithi113:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86f7587a5a09af35f0895e1a2d08527638fae697/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-22T06:28:30.513 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-22T06:28:30.555 DEBUG:teuthology.orchestra.run.smithi113:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-22T06:28:30.588 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-22T06:28:30.633 DEBUG:teuthology.orchestra.run.smithi113:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-22T06:28:30.656 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-04-22T06:28:30.657 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-04-22T06:28:30.694 INFO:teuthology.orchestra.run.smithi113.stdout:check_obsoletes = 1 2024-04-22T06:28:30.696 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum clean all 2024-04-22T06:28:30.879 INFO:teuthology.orchestra.run.smithi145.stdout:48 files removed 2024-04-22T06:28:30.906 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-22T06:28:30.921 INFO:teuthology.orchestra.run.smithi113.stdout:48 files removed 2024-04-22T06:28:30.948 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-22T06:28:31.601 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 192 kB/s | 83 kB 00:00 2024-04-22T06:28:31.910 INFO:teuthology.orchestra.run.smithi113.stdout:ceph packages for x86_64 119 kB/s | 83 kB 00:00 2024-04-22T06:28:32.236 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 20 kB/s | 12 kB 00:00 2024-04-22T06:28:32.436 INFO:teuthology.orchestra.run.smithi113.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-04-22T06:28:32.753 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-04-22T06:28:32.961 INFO:teuthology.orchestra.run.smithi113.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-04-22T06:28:33.594 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-22T06:28:34.544 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.0 MB 00:01 2024-04-22T06:28:35.379 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-22T06:28:39.313 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-04-22T06:28:40.914 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-22T06:28:43.765 INFO:teuthology.orchestra.run.smithi113.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 21 MB 00:02 2024-04-22T06:28:48.773 INFO:teuthology.orchestra.run.smithi113.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-04-22T06:28:50.873 INFO:teuthology.orchestra.run.smithi113.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T06:28:50.874 INFO:teuthology.orchestra.run.smithi113.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T06:28:50.885 INFO:teuthology.orchestra.run.smithi113.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-22T06:28:50.886 INFO:teuthology.orchestra.run.smithi113.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-22T06:28:50.886 INFO:teuthology.orchestra.run.smithi113.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-22T06:28:50.887 INFO:teuthology.orchestra.run.smithi113.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-22T06:28:50.889 INFO:teuthology.orchestra.run.smithi113.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-22T06:28:50.891 INFO:teuthology.orchestra.run.smithi113.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-22T06:28:50.892 INFO:teuthology.orchestra.run.smithi113.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-22T06:28:50.951 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-04-22T06:28:50.961 INFO:teuthology.orchestra.run.smithi113.stdout:======================================================================================= 2024-04-22T06:28:50.961 INFO:teuthology.orchestra.run.smithi113.stdout: Package Arch Version Repository Size 2024-04-22T06:28:50.961 INFO:teuthology.orchestra.run.smithi113.stdout:======================================================================================= 2024-04-22T06:28:50.961 INFO:teuthology.orchestra.run.smithi113.stdout:Installing: 2024-04-22T06:28:50.962 INFO:teuthology.orchestra.run.smithi113.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-22T06:28:50.962 INFO:teuthology.orchestra.run.smithi113.stdout: ceph x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 6.6 k 2024-04-22T06:28:50.962 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T06:28:50.962 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 890 k 2024-04-22T06:28:50.962 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 145 k 2024-04-22T06:28:50.963 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 1.5 M 2024-04-22T06:28:50.963 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 142 k 2024-04-22T06:28:50.963 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 3.5 M 2024-04-22T06:28:50.963 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 7.4 M 2024-04-22T06:28:50.963 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 49 k 2024-04-22T06:28:50.963 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-radosgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 11 M 2024-04-22T06:28:50.964 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-test x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 49 M 2024-04-22T06:28:50.964 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-volume noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 273 k 2024-04-22T06:28:50.964 INFO:teuthology.orchestra.run.smithi113.stdout: cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 763 k 2024-04-22T06:28:50.964 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 225 k 2024-04-22T06:28:50.964 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-shell x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 27 k 2024-04-22T06:28:50.964 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-top noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 18 k 2024-04-22T06:28:50.964 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-22T06:28:50.965 INFO:teuthology.orchestra.run.smithi113.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-22T06:28:50.965 INFO:teuthology.orchestra.run.smithi113.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-22T06:28:50.965 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 32 k 2024-04-22T06:28:50.965 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 747 k 2024-04-22T06:28:50.965 INFO:teuthology.orchestra.run.smithi113.stdout: librados-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 127 k 2024-04-22T06:28:50.965 INFO:teuthology.orchestra.run.smithi113.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-22T06:28:50.965 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-22T06:28:50.965 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-22T06:28:50.966 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-22T06:28:50.966 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-22T06:28:50.966 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-22T06:28:50.966 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cephfs x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 162 k 2024-04-22T06:28:50.966 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rados x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 320 k 2024-04-22T06:28:50.966 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 298 k 2024-04-22T06:28:50.966 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 100 k 2024-04-22T06:28:50.967 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 85 k 2024-04-22T06:28:50.967 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T06:28:50.967 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-nbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 171 k 2024-04-22T06:28:50.967 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-22T06:28:50.967 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrading: 2024-04-22T06:28:50.967 INFO:teuthology.orchestra.run.smithi113.stdout: librados2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.4 M 2024-04-22T06:28:50.967 INFO:teuthology.orchestra.run.smithi113.stdout: librbd1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T06:28:50.967 INFO:teuthology.orchestra.run.smithi113.stdout:Installing dependencies: 2024-04-22T06:28:50.968 INFO:teuthology.orchestra.run.smithi113.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-22T06:28:50.968 INFO:teuthology.orchestra.run.smithi113.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-22T06:28:50.968 INFO:teuthology.orchestra.run.smithi113.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-22T06:28:50.968 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 21 M 2024-04-22T06:28:50.968 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 34 k 2024-04-22T06:28:50.968 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mds x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 2.4 M 2024-04-22T06:28:50.968 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 249 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mon x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 4.7 M 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-osd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 17 M 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 16 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-selinux x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 25 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-22T06:28:50.969 INFO:teuthology.orchestra.run.smithi113.stdout: libcephsqlite x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 164 k 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: libradosstriper1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 500 k 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T06:28:50.970 INFO:teuthology.orchestra.run.smithi113.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-22T06:28:50.971 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 45 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 135 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-22T06:28:50.972 INFO:teuthology.orchestra.run.smithi113.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-22T06:28:50.973 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-22T06:28:50.974 INFO:teuthology.orchestra.run.smithi113.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-22T06:28:50.975 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-22T06:28:50.976 INFO:teuthology.orchestra.run.smithi113.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout:Installing weak dependencies: 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout:======================================================================================= 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout:Install 148 Packages 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrade 2 Packages 2024-04-22T06:28:50.977 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:28:50.978 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 218 M 2024-04-22T06:28:50.978 INFO:teuthology.orchestra.run.smithi113.stdout:Downloading Packages: 2024-04-22T06:28:51.765 INFO:teuthology.orchestra.run.smithi113.stdout:(1/150): ceph-19.0.0-3156.g86f7587a.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-04-22T06:28:52.634 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:17 2024-04-22T06:28:52.874 INFO:teuthology.orchestra.run.smithi113.stdout:(2/150): ceph-fuse-19.0.0-3156.g86f7587a.el9.x8 803 kB/s | 890 kB 00:01 2024-04-22T06:28:53.024 INFO:teuthology.orchestra.run.smithi113.stdout:(3/150): ceph-immutable-object-cache-19.0.0-315 967 kB/s | 145 kB 00:00 2024-04-22T06:28:54.274 INFO:teuthology.orchestra.run.smithi113.stdout:(4/150): ceph-mds-19.0.0-3156.g86f7587a.el9.x86 1.9 MB/s | 2.4 MB 00:01 2024-04-22T06:28:54.633 INFO:teuthology.orchestra.run.smithi113.stdout:(5/150): ceph-base-19.0.0-3156.g86f7587a.el9.x8 1.7 MB/s | 5.4 MB 00:03 2024-04-22T06:28:54.824 INFO:teuthology.orchestra.run.smithi113.stdout:(6/150): ceph-mgr-19.0.0-3156.g86f7587a.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-04-22T06:28:56.516 INFO:teuthology.orchestra.run.smithi113.stdout:(7/150): ceph-common-19.0.0-3156.g86f7587a.el9. 4.2 MB/s | 21 MB 00:05 2024-04-22T06:28:56.583 INFO:teuthology.orchestra.run.smithi113.stdout:(8/150): ceph-mon-19.0.0-3156.g86f7587a.el9.x86 2.4 MB/s | 4.7 MB 00:01 2024-04-22T06:28:56.683 INFO:teuthology.orchestra.run.smithi113.stdout:(9/150): ceph-selinux-19.0.0-3156.g86f7587a.el9 252 kB/s | 25 kB 00:00 2024-04-22T06:28:56.826 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-04-22T06:28:57.234 INFO:teuthology.orchestra.run.smithi113.stdout:(10/150): ceph-osd-19.0.0-3156.g86f7587a.el9.x8 7.0 MB/s | 17 MB 00:02 2024-04-22T06:28:57.358 INFO:teuthology.orchestra.run.smithi113.stdout:(11/150): cephfs-mirror-19.0.0-3156.g86f7587a.e 1.8 MB/s | 225 kB 00:00 2024-04-22T06:28:57.467 INFO:teuthology.orchestra.run.smithi113.stdout:(12/150): cephfs-shell-19.0.0-3156.g86f7587a.el 249 kB/s | 27 kB 00:00 2024-04-22T06:28:57.551 INFO:teuthology.orchestra.run.smithi113.stdout:(13/150): libcephfs-devel-19.0.0-3156.g86f7587a 380 kB/s | 32 kB 00:00 2024-04-22T06:28:58.027 INFO:teuthology.orchestra.run.smithi113.stdout:(14/150): libcephfs2-19.0.0-3156.g86f7587a.el9. 1.5 MB/s | 747 kB 00:00 2024-04-22T06:28:58.094 INFO:teuthology.orchestra.run.smithi113.stdout:(15/150): libcephsqlite-19.0.0-3156.g86f7587a.e 2.4 MB/s | 164 kB 00:00 2024-04-22T06:28:58.160 INFO:teuthology.orchestra.run.smithi113.stdout:(16/150): librados-devel-19.0.0-3156.g86f7587a. 1.9 MB/s | 127 kB 00:00 2024-04-22T06:28:58.244 INFO:teuthology.orchestra.run.smithi113.stdout:(17/150): libradosstriper1-19.0.0-3156.g86f7587 5.9 MB/s | 500 kB 00:00 2024-04-22T06:28:58.519 INFO:teuthology.orchestra.run.smithi113.stdout:(18/150): ceph-radosgw-19.0.0-3156.g86f7587a.el 5.3 MB/s | 11 MB 00:02 2024-04-22T06:28:58.560 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-22T06:28:58.578 INFO:teuthology.orchestra.run.smithi113.stdout:(19/150): python3-ceph-argparse-19.0.0-3156.g86 778 kB/s | 45 kB 00:00 2024-04-22T06:28:58.636 INFO:teuthology.orchestra.run.smithi113.stdout:(20/150): python3-ceph-common-19.0.0-3156.g86f7 2.3 MB/s | 135 kB 00:00 2024-04-22T06:28:58.703 INFO:teuthology.orchestra.run.smithi113.stdout:(21/150): python3-cephfs-19.0.0-3156.g86f7587a. 2.4 MB/s | 162 kB 00:00 2024-04-22T06:28:58.795 INFO:teuthology.orchestra.run.smithi113.stdout:(22/150): python3-rados-19.0.0-3156.g86f7587a.e 3.4 MB/s | 320 kB 00:00 2024-04-22T06:28:58.929 INFO:teuthology.orchestra.run.smithi113.stdout:(23/150): librgw2-19.0.0-3156.g86f7587a.el9.x86 7.9 MB/s | 5.4 MB 00:00 2024-04-22T06:28:58.954 INFO:teuthology.orchestra.run.smithi113.stdout:(24/150): python3-rbd-19.0.0-3156.g86f7587a.el9 1.8 MB/s | 298 kB 00:00 2024-04-22T06:28:58.997 INFO:teuthology.orchestra.run.smithi113.stdout:(25/150): python3-rgw-19.0.0-3156.g86f7587a.el9 1.4 MB/s | 100 kB 00:00 2024-04-22T06:28:59.022 INFO:teuthology.orchestra.run.smithi113.stdout:(26/150): rbd-fuse-19.0.0-3156.g86f7587a.el9.x8 1.2 MB/s | 85 kB 00:00 2024-04-22T06:28:59.072 INFO:teuthology.orchestra.run.smithi113.stdout:(27/150): rbd-nbd-19.0.0-3156.g86f7587a.el9.x86 3.4 MB/s | 171 kB 00:00 2024-04-22T06:28:59.122 INFO:teuthology.orchestra.run.smithi113.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3156.g 685 kB/s | 34 kB 00:00 2024-04-22T06:28:59.189 INFO:teuthology.orchestra.run.smithi113.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3156.g86f7587 2.1 MB/s | 142 kB 00:00 2024-04-22T06:28:59.356 INFO:teuthology.orchestra.run.smithi113.stdout:(30/150): rbd-mirror-19.0.0-3156.g86f7587a.el9. 8.6 MB/s | 3.1 MB 00:00 2024-04-22T06:28:59.790 INFO:teuthology.orchestra.run.smithi113.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3156.g86f75 5.9 MB/s | 3.5 MB 00:00 2024-04-22T06:28:59.857 INFO:teuthology.orchestra.run.smithi113.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3156.g86 3.7 MB/s | 249 kB 00:00 2024-04-22T06:28:59.915 INFO:teuthology.orchestra.run.smithi113.stdout:(33/150): ceph-mgr-rook-19.0.0-3156.g86f7587a.e 848 kB/s | 49 kB 00:00 2024-04-22T06:28:59.974 INFO:teuthology.orchestra.run.smithi113.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3156.g8 283 kB/s | 16 kB 00:00 2024-04-22T06:29:00.049 INFO:teuthology.orchestra.run.smithi113.stdout:(35/150): ceph-volume-19.0.0-3156.g86f7587a.el9 3.6 MB/s | 273 kB 00:00 2024-04-22T06:29:00.191 INFO:teuthology.orchestra.run.smithi113.stdout:(36/150): ceph-mgr-diskprediction-local-19.0.0- 8.9 MB/s | 7.4 MB 00:00 2024-04-22T06:29:00.225 INFO:teuthology.orchestra.run.smithi113.stdout:(37/150): cephadm-19.0.0-3156.g86f7587a.el9.noa 4.2 MB/s | 763 kB 00:00 2024-04-22T06:29:00.250 INFO:teuthology.orchestra.run.smithi113.stdout:(38/150): cephfs-top-19.0.0-3156.g86f7587a.el9. 312 kB/s | 18 kB 00:00 2024-04-22T06:29:00.967 INFO:teuthology.orchestra.run.smithi113.stdout:(39/150): fuse-2.9.9-15.el9.x86_64.rpm 108 kB/s | 80 kB 00:00 2024-04-22T06:29:01.503 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 21 MB 00:02 2024-04-22T06:29:01.817 INFO:teuthology.orchestra.run.smithi113.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 230 kB/s | 195 kB 00:00 2024-04-22T06:29:01.892 INFO:teuthology.orchestra.run.smithi113.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 489 kB/s | 803 kB 00:01 2024-04-22T06:29:02.709 INFO:teuthology.orchestra.run.smithi113.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 284 kB/s | 253 kB 00:00 2024-04-22T06:29:03.451 INFO:teuthology.orchestra.run.smithi113.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 144 kB/s | 106 kB 00:00 2024-04-22T06:29:04.193 INFO:teuthology.orchestra.run.smithi113.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 546 kB/s | 1.2 MB 00:02 2024-04-22T06:29:04.234 INFO:teuthology.orchestra.run.smithi113.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 173 kB/s | 135 kB 00:00 2024-04-22T06:29:04.968 INFO:teuthology.orchestra.run.smithi113.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 161 kB/s | 125 kB 00:00 2024-04-22T06:29:05.094 INFO:teuthology.orchestra.run.smithi113.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 250 kB/s | 215 kB 00:00 2024-04-22T06:29:05.169 INFO:teuthology.orchestra.run.smithi113.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-04-22T06:29:05.228 INFO:teuthology.orchestra.run.smithi113.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-22T06:29:05.269 INFO:teuthology.orchestra.run.smithi113.stdout:(50/150): elfutils-libelf-devel-0.190-2.el9.x86 519 kB/s | 21 kB 00:00 2024-04-22T06:29:05.328 INFO:teuthology.orchestra.run.smithi113.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-04-22T06:29:05.353 INFO:teuthology.orchestra.run.smithi113.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-04-22T06:29:05.379 INFO:teuthology.orchestra.run.smithi113.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-04-22T06:29:05.421 INFO:teuthology.orchestra.run.smithi113.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-04-22T06:29:05.480 INFO:teuthology.orchestra.run.smithi113.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-22T06:29:05.517 INFO:teuthology.orchestra.run.smithi113.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-04-22T06:29:05.521 INFO:teuthology.orchestra.run.smithi113.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-04-22T06:29:05.538 INFO:teuthology.orchestra.run.smithi113.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-22T06:29:05.572 INFO:teuthology.orchestra.run.smithi113.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-22T06:29:05.597 INFO:teuthology.orchestra.run.smithi113.stdout:(60/150): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-04-22T06:29:05.622 INFO:teuthology.orchestra.run.smithi113.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 507 kB/s | 25 kB 00:00 2024-04-22T06:29:05.648 INFO:teuthology.orchestra.run.smithi113.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-04-22T06:29:05.673 INFO:teuthology.orchestra.run.smithi113.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-22T06:29:05.699 INFO:teuthology.orchestra.run.smithi113.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-22T06:29:05.724 INFO:teuthology.orchestra.run.smithi113.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-04-22T06:29:05.841 INFO:teuthology.orchestra.run.smithi113.stdout:(66/150): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-04-22T06:29:05.908 INFO:teuthology.orchestra.run.smithi113.stdout:(67/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 23 MB/s | 4.1 MB 00:00 2024-04-22T06:29:05.950 INFO:teuthology.orchestra.run.smithi113.stdout:(68/150): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-22T06:29:05.992 INFO:teuthology.orchestra.run.smithi113.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-04-22T06:29:06.017 INFO:teuthology.orchestra.run.smithi113.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-04-22T06:29:06.076 INFO:teuthology.orchestra.run.smithi113.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-04-22T06:29:06.151 INFO:teuthology.orchestra.run.smithi113.stdout:(72/150): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-04-22T06:29:06.176 INFO:teuthology.orchestra.run.smithi113.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-04-22T06:29:06.226 INFO:teuthology.orchestra.run.smithi113.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-04-22T06:29:06.310 INFO:teuthology.orchestra.run.smithi113.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-04-22T06:29:06.335 INFO:teuthology.orchestra.run.smithi113.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-04-22T06:29:06.360 INFO:teuthology.orchestra.run.smithi113.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-22T06:29:06.386 INFO:teuthology.orchestra.run.smithi113.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-22T06:29:06.411 INFO:teuthology.orchestra.run.smithi113.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-22T06:29:06.436 INFO:teuthology.orchestra.run.smithi113.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-04-22T06:29:06.487 INFO:teuthology.orchestra.run.smithi113.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-04-22T06:29:06.536 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-22T06:29:06.554 INFO:teuthology.orchestra.run.smithi113.stdout:(82/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-04-22T06:29:06.571 INFO:teuthology.orchestra.run.smithi113.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-22T06:29:06.596 INFO:teuthology.orchestra.run.smithi113.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-04-22T06:29:06.621 INFO:teuthology.orchestra.run.smithi113.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-04-22T06:29:06.647 INFO:teuthology.orchestra.run.smithi113.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-22T06:29:06.672 INFO:teuthology.orchestra.run.smithi113.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-22T06:29:06.697 INFO:teuthology.orchestra.run.smithi113.stdout:(88/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-22T06:29:06.714 INFO:teuthology.orchestra.run.smithi113.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-04-22T06:29:06.740 INFO:teuthology.orchestra.run.smithi113.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-04-22T06:29:06.782 INFO:teuthology.orchestra.run.smithi113.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-04-22T06:29:06.823 INFO:teuthology.orchestra.run.smithi113.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-04-22T06:29:06.874 INFO:teuthology.orchestra.run.smithi113.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-22T06:29:06.907 INFO:teuthology.orchestra.run.smithi113.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-04-22T06:29:07.091 INFO:teuthology.orchestra.run.smithi113.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-04-22T06:29:07.108 INFO:teuthology.orchestra.run.smithi113.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 236 kB/s | 47 kB 00:00 2024-04-22T06:29:07.142 INFO:teuthology.orchestra.run.smithi113.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-22T06:29:07.167 INFO:teuthology.orchestra.run.smithi113.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-04-22T06:29:07.192 INFO:teuthology.orchestra.run.smithi113.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-22T06:29:07.217 INFO:teuthology.orchestra.run.smithi113.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-22T06:29:07.242 INFO:teuthology.orchestra.run.smithi113.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-04-22T06:29:07.334 INFO:teuthology.orchestra.run.smithi113.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-04-22T06:29:07.477 INFO:teuthology.orchestra.run.smithi113.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-04-22T06:29:07.727 INFO:teuthology.orchestra.run.smithi113.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-04-22T06:29:07.860 INFO:teuthology.orchestra.run.smithi113.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 146 kB/s | 19 kB 00:00 2024-04-22T06:29:07.994 INFO:teuthology.orchestra.run.smithi113.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 597 kB/s | 309 kB 00:00 2024-04-22T06:29:08.094 INFO:teuthology.orchestra.run.smithi113.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-04-22T06:29:08.186 INFO:teuthology.orchestra.run.smithi113.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 531 kB/s | 49 kB 00:00 2024-04-22T06:29:08.269 INFO:teuthology.orchestra.run.smithi113.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 810 kB/s | 67 kB 00:00 2024-04-22T06:29:08.370 INFO:teuthology.orchestra.run.smithi113.stdout:(110/150): libarrow-9.0.0-10.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-04-22T06:29:08.437 INFO:teuthology.orchestra.run.smithi113.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 903 kB/s | 151 kB 00:00 2024-04-22T06:29:08.562 INFO:teuthology.orchestra.run.smithi113.stdout:(112/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2024-04-22T06:29:08.654 INFO:teuthology.orchestra.run.smithi113.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 475 kB/s | 43 kB 00:00 2024-04-22T06:29:08.679 INFO:teuthology.orchestra.run.smithi113.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-04-22T06:29:08.687 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T06:29:08.688 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T06:29:08.699 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-22T06:29:08.700 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-22T06:29:08.700 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-22T06:29:08.701 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-22T06:29:08.703 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-22T06:29:08.705 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-22T06:29:08.706 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-22T06:29:08.755 INFO:teuthology.orchestra.run.smithi113.stdout:(115/150): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-04-22T06:29:08.766 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 6.6 k 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 890 k 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 145 k 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 1.5 M 2024-04-22T06:29:08.775 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 142 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 3.5 M 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 7.4 M 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 49 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 11 M 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 49 M 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 273 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 763 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 225 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 27 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 18 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-22T06:29:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 32 k 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 747 k 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 127 k 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-22T06:29:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 162 k 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 320 k 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 298 k 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 100 k 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 85 k 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 171 k 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.4 M 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-04-22T06:29:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 21 M 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 34 k 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 2.4 M 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 249 k 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 4.7 M 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 17 M 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 16 k 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 25 k 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-22T06:29:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 164 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 500 k 2024-04-22T06:29:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-22T06:29:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 45 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 135 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-22T06:29:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-22T06:29:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-22T06:29:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-22T06:29:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-22T06:29:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout:======================================================================================= 2024-04-22T06:29:08.787 INFO:teuthology.orchestra.run.smithi145.stdout:Install 148 Packages 2024-04-22T06:29:08.788 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 2 Packages 2024-04-22T06:29:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:29:08.788 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 218 M 2024-04-22T06:29:08.788 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-04-22T06:29:08.863 INFO:teuthology.orchestra.run.smithi113.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 154 kB/s | 32 kB 00:00 2024-04-22T06:29:08.889 INFO:teuthology.orchestra.run.smithi113.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-04-22T06:29:08.964 INFO:teuthology.orchestra.run.smithi113.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-22T06:29:09.064 INFO:teuthology.orchestra.run.smithi113.stdout:(119/150): python3-colorama-0.4.4-12.el9.noarch 353 kB/s | 35 kB 00:00 2024-04-22T06:29:09.123 INFO:teuthology.orchestra.run.smithi113.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.3 MB/s | 303 kB 00:00 2024-04-22T06:29:09.148 INFO:teuthology.orchestra.run.smithi113.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-04-22T06:29:09.298 INFO:teuthology.orchestra.run.smithi113.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 964 kB/s | 144 kB 00:00 2024-04-22T06:29:09.423 INFO:teuthology.orchestra.run.smithi113.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-04-22T06:29:09.507 INFO:teuthology.orchestra.run.smithi113.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2024-04-22T06:29:09.635 INFO:teuthology.orchestra.run.smithi113.stdout:(125/150): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-04-22T06:29:09.766 INFO:teuthology.orchestra.run.smithi113.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 89 kB/s | 23 kB 00:00 2024-04-22T06:29:09.791 INFO:teuthology.orchestra.run.smithi113.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 125 kB/s | 19 kB 00:00 2024-04-22T06:29:09.850 INFO:teuthology.orchestra.run.smithi113.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 236 kB/s | 20 kB 00:00 2024-04-22T06:29:09.950 INFO:teuthology.orchestra.run.smithi113.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 463 kB/s | 46 kB 00:00 2024-04-22T06:29:10.017 INFO:teuthology.orchestra.run.smithi113.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-04-22T06:29:10.042 INFO:teuthology.orchestra.run.smithi113.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 858 kB/s | 79 kB 00:00 2024-04-22T06:29:10.093 INFO:teuthology.orchestra.run.smithi113.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-04-22T06:29:10.135 INFO:teuthology.orchestra.run.smithi113.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-22T06:29:10.169 INFO:teuthology.orchestra.run.smithi113.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-22T06:29:10.179 INFO:teuthology.orchestra.run.smithi145.stdout:(1/150): ceph-19.0.0-3156.g86f7587a.el9.x86_64. 13 kB/s | 6.6 kB 00:00 2024-04-22T06:29:10.202 INFO:teuthology.orchestra.run.smithi113.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-22T06:29:10.269 INFO:teuthology.orchestra.run.smithi113.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 282 kB/s | 28 kB 00:00 2024-04-22T06:29:10.285 INFO:teuthology.orchestra.run.smithi113.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 368 kB/s | 31 kB 00:00 2024-04-22T06:29:10.353 INFO:teuthology.orchestra.run.smithi113.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-22T06:29:10.370 INFO:teuthology.orchestra.run.smithi113.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-04-22T06:29:10.420 INFO:teuthology.orchestra.run.smithi113.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 533 kB/s | 36 kB 00:00 2024-04-22T06:29:10.446 INFO:teuthology.orchestra.run.smithi113.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-04-22T06:29:10.504 INFO:teuthology.orchestra.run.smithi113.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-22T06:29:10.529 INFO:teuthology.orchestra.run.smithi113.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-22T06:29:10.629 INFO:teuthology.orchestra.run.smithi113.stdout:(144/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-22T06:29:10.655 INFO:teuthology.orchestra.run.smithi113.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2024-04-22T06:29:10.930 INFO:teuthology.orchestra.run.smithi113.stdout:(146/150): thrift-0.15.0-2.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-04-22T06:29:10.955 INFO:teuthology.orchestra.run.smithi113.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 589 kB/s | 192 kB 00:00 2024-04-22T06:29:11.038 INFO:teuthology.orchestra.run.smithi145.stdout:(2/150): ceph-fuse-19.0.0-3156.g86f7587a.el9.x8 1.0 MB/s | 890 kB 00:00 2024-04-22T06:29:11.222 INFO:teuthology.orchestra.run.smithi145.stdout:(3/150): ceph-immutable-object-cache-19.0.0-315 790 kB/s | 145 kB 00:00 2024-04-22T06:29:12.163 INFO:teuthology.orchestra.run.smithi113.stdout:(148/150): librados2-19.0.0-3156.g86f7587a.el9. 2.8 MB/s | 3.4 MB 00:01 2024-04-22T06:29:12.314 INFO:teuthology.orchestra.run.smithi113.stdout:(149/150): librbd1-19.0.0-3156.g86f7587a.el9.x8 2.3 MB/s | 3.1 MB 00:01 2024-04-22T06:29:13.255 INFO:teuthology.orchestra.run.smithi145.stdout:(4/150): ceph-mds-19.0.0-3156.g86f7587a.el9.x86 1.2 MB/s | 2.4 MB 00:02 2024-04-22T06:29:14.380 INFO:teuthology.orchestra.run.smithi145.stdout:(5/150): ceph-mgr-19.0.0-3156.g86f7587a.el9.x86 1.3 MB/s | 1.5 MB 00:01 2024-04-22T06:29:14.472 INFO:teuthology.orchestra.run.smithi113.stdout:(150/150): ceph-test-19.0.0-3156.g86f7587a.el9. 2.8 MB/s | 49 MB 00:17 2024-04-22T06:29:14.476 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2024-04-22T06:29:14.476 INFO:teuthology.orchestra.run.smithi113.stdout:Total 9.3 MB/s | 218 MB 00:23 2024-04-22T06:29:14.688 INFO:teuthology.orchestra.run.smithi145.stdout:(6/150): ceph-base-19.0.0-3156.g86f7587a.el9.x8 1.1 MB/s | 5.4 MB 00:05 2024-04-22T06:29:15.531 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction check 2024-04-22T06:29:15.655 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction check succeeded. 2024-04-22T06:29:15.655 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction test 2024-04-22T06:29:17.105 INFO:teuthology.orchestra.run.smithi145.stdout:(7/150): ceph-mon-19.0.0-3156.g86f7587a.el9.x86 1.7 MB/s | 4.7 MB 00:02 2024-04-22T06:29:17.362 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction test succeeded. 2024-04-22T06:29:17.362 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction 2024-04-22T06:29:19.355 INFO:teuthology.orchestra.run.smithi145.stdout:(8/150): ceph-common-19.0.0-3156.g86f7587a.el9. 2.2 MB/s | 21 MB 00:09 2024-04-22T06:29:19.455 INFO:teuthology.orchestra.run.smithi145.stdout:(9/150): ceph-selinux-19.0.0-3156.g86f7587a.el9 253 kB/s | 25 kB 00:00 2024-04-22T06:29:21.230 INFO:teuthology.orchestra.run.smithi145.stdout:(10/150): ceph-osd-19.0.0-3156.g86f7587a.el9.x8 2.6 MB/s | 17 MB 00:06 2024-04-22T06:29:21.297 INFO:teuthology.orchestra.run.smithi145.stdout:(11/150): cephfs-mirror-19.0.0-3156.g86f7587a.e 3.3 MB/s | 225 kB 00:00 2024-04-22T06:29:21.339 INFO:teuthology.orchestra.run.smithi145.stdout:(12/150): cephfs-shell-19.0.0-3156.g86f7587a.el 651 kB/s | 27 kB 00:00 2024-04-22T06:29:21.389 INFO:teuthology.orchestra.run.smithi145.stdout:(13/150): libcephfs-devel-19.0.0-3156.g86f7587a 637 kB/s | 32 kB 00:00 2024-04-22T06:29:21.547 INFO:teuthology.orchestra.run.smithi145.stdout:(14/150): ceph-radosgw-19.0.0-3156.g86f7587a.el 2.4 MB/s | 11 MB 00:04 2024-04-22T06:29:21.606 INFO:teuthology.orchestra.run.smithi145.stdout:(15/150): libcephfs2-19.0.0-3156.g86f7587a.el9. 3.4 MB/s | 747 kB 00:00 2024-04-22T06:29:21.634 INFO:teuthology.orchestra.run.smithi145.stdout:(16/150): libcephsqlite-19.0.0-3156.g86f7587a.e 1.9 MB/s | 164 kB 00:00 2024-04-22T06:29:21.657 INFO:teuthology.orchestra.run.smithi145.stdout:(17/150): librados-devel-19.0.0-3156.g86f7587a. 2.5 MB/s | 127 kB 00:00 2024-04-22T06:29:21.782 INFO:teuthology.orchestra.run.smithi145.stdout:(18/150): libradosstriper1-19.0.0-3156.g86f7587 3.3 MB/s | 500 kB 00:00 2024-04-22T06:29:21.849 INFO:teuthology.orchestra.run.smithi145.stdout:(19/150): python3-ceph-argparse-19.0.0-3156.g86 677 kB/s | 45 kB 00:00 2024-04-22T06:29:21.949 INFO:teuthology.orchestra.run.smithi145.stdout:(20/150): python3-ceph-common-19.0.0-3156.g86f7 1.3 MB/s | 135 kB 00:00 2024-04-22T06:29:22.049 INFO:teuthology.orchestra.run.smithi145.stdout:(21/150): python3-cephfs-19.0.0-3156.g86f7587a. 1.6 MB/s | 162 kB 00:00 2024-04-22T06:29:22.199 INFO:teuthology.orchestra.run.smithi145.stdout:(22/150): python3-rados-19.0.0-3156.g86f7587a.e 2.1 MB/s | 320 kB 00:00 2024-04-22T06:29:22.342 INFO:teuthology.orchestra.run.smithi145.stdout:(23/150): python3-rbd-19.0.0-3156.g86f7587a.el9 2.0 MB/s | 298 kB 00:00 2024-04-22T06:29:22.426 INFO:teuthology.orchestra.run.smithi145.stdout:(24/150): python3-rgw-19.0.0-3156.g86f7587a.el9 1.2 MB/s | 100 kB 00:00 2024-04-22T06:29:22.501 INFO:teuthology.orchestra.run.smithi145.stdout:(25/150): rbd-fuse-19.0.0-3156.g86f7587a.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-22T06:29:22.818 INFO:teuthology.orchestra.run.smithi145.stdout:(26/150): librgw2-19.0.0-3156.g86f7587a.el9.x86 4.6 MB/s | 5.4 MB 00:01 2024-04-22T06:29:22.877 INFO:teuthology.orchestra.run.smithi145.stdout:(27/150): rbd-nbd-19.0.0-3156.g86f7587a.el9.x86 2.9 MB/s | 171 kB 00:00 2024-04-22T06:29:22.918 INFO:teuthology.orchestra.run.smithi145.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3156.g 822 kB/s | 34 kB 00:00 2024-04-22T06:29:22.977 INFO:teuthology.orchestra.run.smithi145.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3156.g86f7587 2.4 MB/s | 142 kB 00:00 2024-04-22T06:29:23.150 INFO:teuthology.orchestra.run.smithi113.stdout: Preparing : 1/1 2024-04-22T06:29:23.266 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-22T06:29:23.344 INFO:teuthology.orchestra.run.smithi145.stdout:(30/150): rbd-mirror-19.0.0-3156.g86f7587a.el9. 3.7 MB/s | 3.1 MB 00:00 2024-04-22T06:29:23.394 INFO:teuthology.orchestra.run.smithi145.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3156.g86f75 8.5 MB/s | 3.5 MB 00:00 2024-04-22T06:29:23.453 INFO:teuthology.orchestra.run.smithi145.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3156.g86 4.2 MB/s | 249 kB 00:00 2024-04-22T06:29:23.466 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-22T06:29:23.503 INFO:teuthology.orchestra.run.smithi145.stdout:(33/150): ceph-mgr-rook-19.0.0-3156.g86f7587a.e 994 kB/s | 49 kB 00:00 2024-04-22T06:29:23.512 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-22T06:29:23.554 INFO:teuthology.orchestra.run.smithi145.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3156.g8 328 kB/s | 16 kB 00:00 2024-04-22T06:29:23.629 INFO:teuthology.orchestra.run.smithi145.stdout:(35/150): ceph-volume-19.0.0-3156.g86f7587a.el9 3.6 MB/s | 273 kB 00:00 2024-04-22T06:29:23.737 INFO:teuthology.orchestra.run.smithi145.stdout:(36/150): cephadm-19.0.0-3156.g86f7587a.el9.noa 6.9 MB/s | 763 kB 00:00 2024-04-22T06:29:23.788 INFO:teuthology.orchestra.run.smithi145.stdout:(37/150): cephfs-top-19.0.0-3156.g86f7587a.el9. 366 kB/s | 18 kB 00:00 2024-04-22T06:29:23.842 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-22T06:29:23.950 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T06:29:24.079 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T06:29:24.109 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T06:29:24.201 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T06:29:24.244 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T06:29:24.272 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-22T06:29:24.306 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-22T06:29:24.462 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-22T06:29:24.496 INFO:teuthology.orchestra.run.smithi145.stdout:(38/150): fuse-2.9.9-15.el9.x86_64.rpm 113 kB/s | 80 kB 00:00 2024-04-22T06:29:24.520 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-22T06:29:24.548 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T06:29:24.652 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T06:29:24.674 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T06:29:24.720 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T06:29:24.721 INFO:teuthology.orchestra.run.smithi145.stdout:(39/150): ceph-mgr-diskprediction-local-19.0.0- 5.4 MB/s | 7.4 MB 00:01 2024-04-22T06:29:24.750 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T06:29:24.769 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T06:29:24.942 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T06:29:24.975 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T06:29:25.082 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-22T06:29:25.182 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-22T06:29:25.216 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-22T06:29:25.252 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-22T06:29:25.326 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-22T06:29:25.376 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-22T06:29:25.419 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-22T06:29:25.459 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-22T06:29:25.490 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-22T06:29:25.568 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-22T06:29:25.571 INFO:teuthology.orchestra.run.smithi145.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 230 kB/s | 195 kB 00:00 2024-04-22T06:29:25.628 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-22T06:29:25.657 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-22T06:29:25.702 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-22T06:29:25.780 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-22T06:29:25.812 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 30/152 2024-04-22T06:29:25.855 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 31/152 2024-04-22T06:29:25.884 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 32/152 2024-04-22T06:29:25.957 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-22T06:29:25.999 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-22T06:29:26.075 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-22T06:29:26.155 INFO:teuthology.orchestra.run.smithi145.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 484 kB/s | 803 kB 00:01 2024-04-22T06:29:26.214 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-22T06:29:26.269 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-22T06:29:26.656 INFO:teuthology.orchestra.run.smithi145.stdout:(42/150): ceph-test-19.0.0-3156.g86f7587a.el9.x 6.8 MB/s | 49 MB 00:07 2024-04-22T06:29:26.681 INFO:teuthology.orchestra.run.smithi145.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 228 kB/s | 253 kB 00:01 2024-04-22T06:29:26.815 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-22T06:29:26.898 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-22T06:29:26.925 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-22T06:29:26.985 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-22T06:29:27.023 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 42/152 2024-04-22T06:29:27.056 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-22T06:29:27.112 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-22T06:29:27.186 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-22T06:29:27.223 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-22T06:29:27.260 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-22T06:29:27.316 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-22T06:29:27.351 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-22T06:29:27.394 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-22T06:29:27.437 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-22T06:29:27.447 INFO:teuthology.orchestra.run.smithi145.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 176 kB/s | 135 kB 00:00 2024-04-22T06:29:27.473 INFO:teuthology.orchestra.run.smithi145.stdout:(45/150): python3-ply-3.11-14.el9.noarch.rpm 130 kB/s | 106 kB 00:00 2024-04-22T06:29:27.577 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-22T06:29:27.625 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-22T06:29:27.655 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-22T06:29:27.697 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-22T06:29:27.793 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-22T06:29:27.830 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-22T06:29:27.870 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-22T06:29:27.896 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-22T06:29:27.921 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-22T06:29:27.996 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-22T06:29:28.126 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-22T06:29:28.178 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-22T06:29:28.206 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-22T06:29:28.214 INFO:teuthology.orchestra.run.smithi145.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 163 kB/s | 125 kB 00:00 2024-04-22T06:29:28.240 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-22T06:29:28.284 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-22T06:29:28.348 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-22T06:29:28.387 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-22T06:29:28.390 INFO:teuthology.orchestra.run.smithi145.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 689 kB 00:00 2024-04-22T06:29:28.415 INFO:teuthology.orchestra.run.smithi145.stdout:(48/150): python3-urllib3-1.26.5-5.el9.noarch.r 228 kB/s | 215 kB 00:00 2024-04-22T06:29:28.417 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-22T06:29:28.451 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-22T06:29:28.474 INFO:teuthology.orchestra.run.smithi145.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-04-22T06:29:28.484 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-22T06:29:28.516 INFO:teuthology.orchestra.run.smithi145.stdout:(50/150): elfutils-libelf-devel-0.190-2.el9.x86 517 kB/s | 21 kB 00:00 2024-04-22T06:29:28.526 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-22T06:29:28.533 INFO:teuthology.orchestra.run.smithi145.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 911 kB/s | 107 kB 00:00 2024-04-22T06:29:28.560 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-22T06:29:28.566 INFO:teuthology.orchestra.run.smithi145.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-22T06:29:28.583 INFO:teuthology.orchestra.run.smithi145.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-04-22T06:29:28.618 INFO:teuthology.orchestra.run.smithi145.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 547 kB/s | 18 kB 00:00 2024-04-22T06:29:28.649 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-22T06:29:28.676 INFO:teuthology.orchestra.run.smithi145.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-04-22T06:29:28.693 INFO:teuthology.orchestra.run.smithi145.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-04-22T06:29:28.700 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-22T06:29:28.726 INFO:teuthology.orchestra.run.smithi145.stdout:(57/150): python3-cryptography-36.0.1-4.el9.x86 488 kB/s | 1.2 MB 00:02 2024-04-22T06:29:28.730 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-22T06:29:28.743 INFO:teuthology.orchestra.run.smithi145.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-04-22T06:29:28.768 INFO:teuthology.orchestra.run.smithi145.stdout:(59/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-04-22T06:29:28.778 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-22T06:29:28.802 INFO:teuthology.orchestra.run.smithi145.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 770 kB/s | 25 kB 00:00 2024-04-22T06:29:28.861 INFO:teuthology.orchestra.run.smithi145.stdout:(61/150): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-04-22T06:29:28.878 INFO:teuthology.orchestra.run.smithi145.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-04-22T06:29:28.888 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-22T06:29:28.911 INFO:teuthology.orchestra.run.smithi145.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-22T06:29:28.937 INFO:teuthology.orchestra.run.smithi145.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-04-22T06:29:28.941 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-22T06:29:28.962 INFO:teuthology.orchestra.run.smithi145.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-04-22T06:29:28.987 INFO:teuthology.orchestra.run.smithi145.stdout:(66/150): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-04-22T06:29:29.096 INFO:teuthology.orchestra.run.smithi145.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-22T06:29:29.137 INFO:teuthology.orchestra.run.smithi145.stdout:(68/150): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-22T06:29:29.196 INFO:teuthology.orchestra.run.smithi145.stdout:(69/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 18 MB/s | 4.1 MB 00:00 2024-04-22T06:29:29.221 INFO:teuthology.orchestra.run.smithi145.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-22T06:29:29.263 INFO:teuthology.orchestra.run.smithi145.stdout:(71/150): postgresql-contrib-13.14-1.el9.x86_64 5.3 MB/s | 911 kB 00:00 2024-04-22T06:29:29.305 INFO:teuthology.orchestra.run.smithi145.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-22T06:29:29.331 INFO:teuthology.orchestra.run.smithi145.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-22T06:29:29.381 INFO:teuthology.orchestra.run.smithi145.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-04-22T06:29:29.448 INFO:teuthology.orchestra.run.smithi145.stdout:(75/150): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-04-22T06:29:29.473 INFO:teuthology.orchestra.run.smithi145.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-04-22T06:29:29.499 INFO:teuthology.orchestra.run.smithi145.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-04-22T06:29:29.523 INFO:teuthology.orchestra.run.smithi145.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-22T06:29:29.549 INFO:teuthology.orchestra.run.smithi145.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-22T06:29:29.576 INFO:teuthology.orchestra.run.smithi145.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 664 kB/s | 35 kB 00:00 2024-04-22T06:29:29.660 INFO:teuthology.orchestra.run.smithi145.stdout:(81/150): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-04-22T06:29:29.685 INFO:teuthology.orchestra.run.smithi145.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-04-22T06:29:29.708 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-22T06:29:29.710 INFO:teuthology.orchestra.run.smithi145.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-22T06:29:29.736 INFO:teuthology.orchestra.run.smithi145.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-22T06:29:29.752 INFO:teuthology.orchestra.run.smithi145.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-04-22T06:29:29.754 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-22T06:29:29.786 INFO:teuthology.orchestra.run.smithi145.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-22T06:29:29.788 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-22T06:29:29.811 INFO:teuthology.orchestra.run.smithi145.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-04-22T06:29:29.837 INFO:teuthology.orchestra.run.smithi145.stdout:(88/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-22T06:29:29.854 INFO:teuthology.orchestra.run.smithi145.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-04-22T06:29:29.892 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-22T06:29:29.921 INFO:teuthology.orchestra.run.smithi145.stdout:(90/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-04-22T06:29:29.937 INFO:teuthology.orchestra.run.smithi145.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-04-22T06:29:29.946 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-22T06:29:29.963 INFO:teuthology.orchestra.run.smithi145.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 998 kB/s | 42 kB 00:00 2024-04-22T06:29:29.988 INFO:teuthology.orchestra.run.smithi145.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-04-22T06:29:30.013 INFO:teuthology.orchestra.run.smithi145.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-22T06:29:30.039 INFO:teuthology.orchestra.run.smithi145.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-04-22T06:29:30.044 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-22T06:29:30.064 INFO:teuthology.orchestra.run.smithi145.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-22T06:29:30.082 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-22T06:29:30.098 INFO:teuthology.orchestra.run.smithi145.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-22T06:29:30.123 INFO:teuthology.orchestra.run.smithi145.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-04-22T06:29:30.165 INFO:teuthology.orchestra.run.smithi145.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-22T06:29:30.190 INFO:teuthology.orchestra.run.smithi145.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-04-22T06:29:30.215 INFO:teuthology.orchestra.run.smithi145.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-04-22T06:29:30.259 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-22T06:29:30.288 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-22T06:29:30.299 INFO:teuthology.orchestra.run.smithi145.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-04-22T06:29:30.366 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-22T06:29:30.458 INFO:teuthology.orchestra.run.smithi145.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-04-22T06:29:30.725 INFO:teuthology.orchestra.run.smithi145.stdout:(104/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-04-22T06:29:31.025 INFO:teuthology.orchestra.run.smithi145.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2024-04-22T06:29:31.036 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-22T06:29:31.155 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-22T06:29:31.291 INFO:teuthology.orchestra.run.smithi145.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 371 kB/s | 309 kB 00:00 2024-04-22T06:29:31.417 INFO:teuthology.orchestra.run.smithi145.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-04-22T06:29:31.534 INFO:teuthology.orchestra.run.smithi145.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 417 kB/s | 49 kB 00:00 2024-04-22T06:29:31.651 INFO:teuthology.orchestra.run.smithi145.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 576 kB/s | 67 kB 00:00 2024-04-22T06:29:31.768 INFO:teuthology.orchestra.run.smithi145.stdout:(110/150): abseil-cpp-20211102.0-3.el9.x86_64.r 373 kB/s | 548 kB 00:01 2024-04-22T06:29:31.868 INFO:teuthology.orchestra.run.smithi145.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 696 kB/s | 151 kB 00:00 2024-04-22T06:29:32.427 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-22T06:29:32.502 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-22T06:29:32.527 INFO:teuthology.orchestra.run.smithi145.stdout:(112/150): python3-asyncssh-2.13.2-5.el9.noarch 833 kB/s | 548 kB 00:00 2024-04-22T06:29:32.528 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-22T06:29:32.561 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-22T06:29:32.644 INFO:teuthology.orchestra.run.smithi145.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 373 kB/s | 43 kB 00:00 2024-04-22T06:29:32.769 INFO:teuthology.orchestra.run.smithi145.stdout:(114/150): python3-cachetools-4.2.4-1.el9.noarc 258 kB/s | 32 kB 00:00 2024-04-22T06:29:32.794 INFO:teuthology.orchestra.run.smithi145.stdout:(115/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 817 kB/s | 838 kB 00:01 2024-04-22T06:29:32.875 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-22T06:29:32.886 INFO:teuthology.orchestra.run.smithi145.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-04-22T06:29:32.924 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T06:29:33.014 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T06:29:33.020 INFO:teuthology.orchestra.run.smithi145.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 762 kB/s | 172 kB 00:00 2024-04-22T06:29:33.046 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 98/152 2024-04-22T06:29:33.090 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-22T06:29:33.370 INFO:teuthology.orchestra.run.smithi145.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 742 kB/s | 358 kB 00:00 2024-04-22T06:29:33.412 INFO:teuthology.orchestra.run.smithi145.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 773 kB/s | 303 kB 00:00 2024-04-22T06:29:33.487 INFO:teuthology.orchestra.run.smithi145.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 301 kB/s | 35 kB 00:00 2024-04-22T06:29:33.569 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-22T06:29:33.602 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T06:29:33.673 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T06:29:33.695 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 102/152 2024-04-22T06:29:33.712 INFO:teuthology.orchestra.run.smithi145.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 675 kB/s | 203 kB 00:00 2024-04-22T06:29:33.921 INFO:teuthology.orchestra.run.smithi145.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 694 kB/s | 144 kB 00:00 2024-04-22T06:29:34.038 INFO:teuthology.orchestra.run.smithi145.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2024-04-22T06:29:34.146 INFO:teuthology.orchestra.run.smithi145.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2024-04-22T06:29:34.255 INFO:teuthology.orchestra.run.smithi145.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2024-04-22T06:29:34.364 INFO:teuthology.orchestra.run.smithi145.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-04-22T06:29:34.472 INFO:teuthology.orchestra.run.smithi145.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-04-22T06:29:35.556 INFO:teuthology.orchestra.run.smithi145.stdout:(128/150): python3-grpcio-1.46.7-10.el9.x86_64. 1.0 MB/s | 2.0 MB 00:02 2024-04-22T06:29:35.589 INFO:teuthology.orchestra.run.smithi145.stdout:(129/150): python3-kubernetes-26.1.0-2.el9.noar 936 kB/s | 1.0 MB 00:01 2024-04-22T06:29:35.682 INFO:teuthology.orchestra.run.smithi145.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 370 kB/s | 46 kB 00:00 2024-04-22T06:29:35.706 INFO:teuthology.orchestra.run.smithi145.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 674 kB/s | 79 kB 00:00 2024-04-22T06:29:35.799 INFO:teuthology.orchestra.run.smithi145.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 495 kB/s | 58 kB 00:00 2024-04-22T06:29:35.907 INFO:teuthology.orchestra.run.smithi145.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-04-22T06:29:36.024 INFO:teuthology.orchestra.run.smithi145.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 772 kB/s | 90 kB 00:00 2024-04-22T06:29:36.026 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T06:29:36.049 INFO:teuthology.orchestra.run.smithi145.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 795 kB/s | 272 kB 00:00 2024-04-22T06:29:36.066 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T06:29:36.141 INFO:teuthology.orchestra.run.smithi145.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 242 kB/s | 28 kB 00:00 2024-04-22T06:29:36.167 INFO:teuthology.orchestra.run.smithi145.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2024-04-22T06:29:36.242 INFO:teuthology.orchestra.run.smithi145.stdout:(138/150): libarrow-9.0.0-10.el9.x86_64.rpm 867 kB/s | 4.4 MB 00:05 2024-04-22T06:29:36.284 INFO:teuthology.orchestra.run.smithi145.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 504 kB/s | 59 kB 00:00 2024-04-22T06:29:36.359 INFO:teuthology.orchestra.run.smithi145.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 866 kB/s | 188 kB 00:00 2024-04-22T06:29:36.385 INFO:teuthology.orchestra.run.smithi145.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 251 kB/s | 36 kB 00:00 2024-04-22T06:29:36.410 INFO:teuthology.orchestra.run.smithi145.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 406 kB/s | 51 kB 00:00 2024-04-22T06:29:36.502 INFO:teuthology.orchestra.run.smithi145.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 769 kB/s | 90 kB 00:00 2024-04-22T06:29:36.615 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T06:29:36.619 INFO:teuthology.orchestra.run.smithi145.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-04-22T06:29:36.652 INFO:teuthology.orchestra.run.smithi145.stdout:(145/150): python3-webob-1.8.7-6.el9.noarch.rpm 785 kB/s | 230 kB 00:00 2024-04-22T06:29:36.653 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T06:29:36.743 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T06:29:36.743 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-22T06:29:36.743 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-22T06:29:36.744 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:36.780 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T06:29:36.828 INFO:teuthology.orchestra.run.smithi145.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 919 kB/s | 192 kB 00:00 2024-04-22T06:29:36.895 INFO:teuthology.orchestra.run.smithi145.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 882 kB/s | 427 kB 00:00 2024-04-22T06:29:37.278 INFO:teuthology.orchestra.run.smithi145.stdout:(148/150): librbd1-19.0.0-3156.g86f7587a.el9.x8 8.2 MB/s | 3.1 MB 00:00 2024-04-22T06:29:37.537 INFO:teuthology.orchestra.run.smithi145.stdout:(149/150): librados2-19.0.0-3156.g86f7587a.el9. 4.8 MB/s | 3.4 MB 00:00 2024-04-22T06:29:38.195 INFO:teuthology.orchestra.run.smithi145.stdout:(150/150): thrift-0.15.0-2.el9.x86_64.rpm 1.0 MB/s | 1.6 MB 00:01 2024-04-22T06:29:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-04-22T06:29:38.198 INFO:teuthology.orchestra.run.smithi145.stdout:Total 7.4 MB/s | 218 MB 00:29 2024-04-22T06:29:39.279 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-04-22T06:29:39.407 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-04-22T06:29:39.407 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-04-22T06:29:41.125 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-04-22T06:29:41.125 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-04-22T06:29:47.021 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-04-22T06:29:47.106 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-22T06:29:47.131 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-22T06:29:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-22T06:29:47.506 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-22T06:29:47.623 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T06:29:47.746 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T06:29:47.783 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T06:29:47.874 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T06:29:47.916 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T06:29:47.945 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-22T06:29:47.971 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-22T06:29:48.129 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-22T06:29:48.185 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-22T06:29:48.213 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T06:29:48.293 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T06:29:48.293 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /sys 2024-04-22T06:29:48.293 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /proc 2024-04-22T06:29:48.293 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /mnt 2024-04-22T06:29:48.293 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /var/tmp 2024-04-22T06:29:48.293 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /home 2024-04-22T06:29:48.294 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /root 2024-04-22T06:29:48.294 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /tmp 2024-04-22T06:29:48.294 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:48.299 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T06:29:48.322 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T06:29:48.368 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T06:29:48.390 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T06:29:48.415 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T06:29:48.484 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T06:29:48.499 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T06:29:48.499 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:48.499 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-22T06:29:48.499 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:48.615 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T06:29:48.648 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T06:29:48.754 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-22T06:29:48.854 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-22T06:29:48.905 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-22T06:29:48.940 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-22T06:29:49.015 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-22T06:29:49.056 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-22T06:29:49.099 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-22T06:29:49.132 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-22T06:29:49.160 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-22T06:29:49.230 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-22T06:29:49.291 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-22T06:29:49.357 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-22T06:29:49.548 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-22T06:29:49.626 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-22T06:29:49.659 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 30/152 2024-04-22T06:29:49.702 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 31/152 2024-04-22T06:29:49.731 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 32/152 2024-04-22T06:29:49.804 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-22T06:29:49.846 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-22T06:29:49.922 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-22T06:29:49.978 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T06:29:50.004 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T06:29:50.004 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:50.004 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-22T06:29:50.004 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T06:29:50.005 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T06:29:50.005 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:50.060 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-22T06:29:50.116 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-22T06:29:50.229 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T06:29:50.251 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T06:29:50.251 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:50.251 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-22T06:29:50.251 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T06:29:50.252 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T06:29:50.252 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:50.666 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-22T06:29:50.696 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T06:29:50.719 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T06:29:50.719 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:50.719 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-22T06:29:50.719 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T06:29:50.719 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T06:29:50.719 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:50.754 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-22T06:29:50.790 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-22T06:29:50.818 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-22T06:29:50.833 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-22T06:29:50.871 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 42/152 2024-04-22T06:29:50.875 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-22T06:29:50.903 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-22T06:29:50.939 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-22T06:29:50.959 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-22T06:29:51.033 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-22T06:29:51.071 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-22T06:29:51.108 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-22T06:29:51.125 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-22T06:29:51.155 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-22T06:29:51.172 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-22T06:29:51.199 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-22T06:29:51.242 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-22T06:29:51.258 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-22T06:29:51.285 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-22T06:29:51.356 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-22T06:29:51.425 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-22T06:29:51.473 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-22T06:29:51.495 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-22T06:29:51.495 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-22T06:29:51.536 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-22T06:29:51.560 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-22T06:29:51.571 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-22T06:29:51.598 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-22T06:29:51.633 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-22T06:29:51.669 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-22T06:29:51.710 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-22T06:29:51.735 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-22T06:29:51.760 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-22T06:29:51.837 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-22T06:29:51.991 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-22T06:29:51.991 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T06:29:52.022 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T06:29:52.034 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-22T06:29:52.054 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 122/152 2024-04-22T06:29:52.062 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-22T06:29:52.096 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-22T06:29:52.116 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 123/152 2024-04-22T06:29:52.141 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-22T06:29:52.145 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T06:29:52.179 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-22T06:29:52.218 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-22T06:29:52.248 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-22T06:29:52.282 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-22T06:29:52.316 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-22T06:29:52.358 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-22T06:29:52.392 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-22T06:29:52.481 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-22T06:29:52.530 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-22T06:29:52.561 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-22T06:29:52.609 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-22T06:29:52.719 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-22T06:29:52.772 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-22T06:29:53.185 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T06:29:53.222 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T06:29:53.535 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-22T06:29:53.585 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-22T06:29:53.619 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-22T06:29:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-22T06:29:53.778 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-22T06:29:53.868 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-22T06:29:53.904 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-22T06:29:54.082 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-22T06:29:54.110 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-22T06:29:54.188 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-22T06:29:54.189 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T06:29:54.222 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T06:29:54.324 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T06:29:54.485 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 127/152 2024-04-22T06:29:54.516 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T06:29:54.539 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T06:29:54.539 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:54.539 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-22T06:29:54.539 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T06:29:54.539 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T06:29:54.540 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:54.584 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T06:29:54.594 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T06:29:54.693 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 130/152 2024-04-22T06:29:54.741 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 131/152 2024-04-22T06:29:54.861 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-22T06:29:54.987 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-22T06:29:55.662 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-22T06:29:55.694 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T06:29:55.717 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T06:29:55.717 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:55.717 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-22T06:29:55.717 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T06:29:55.717 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T06:29:55.717 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:55.762 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T06:29:55.784 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T06:29:55.784 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:55.784 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-22T06:29:55.784 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:55.829 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T06:29:55.852 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T06:29:55.852 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:55.852 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-22T06:29:55.852 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T06:29:55.852 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T06:29:55.852 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:56.155 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T06:29:56.177 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T06:29:56.177 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:29:56.177 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-22T06:29:56.177 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T06:29:56.177 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T06:29:56.177 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:29:56.259 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-22T06:29:56.331 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-22T06:29:56.359 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-22T06:29:56.417 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-22T06:29:56.729 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-22T06:29:56.772 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T06:29:56.862 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T06:29:56.893 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 98/152 2024-04-22T06:29:56.928 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-22T06:29:57.412 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-22T06:29:57.449 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T06:29:57.521 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T06:29:57.551 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 102/152 2024-04-22T06:29:59.771 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T06:29:59.814 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T06:30:00.420 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T06:30:00.459 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T06:30:00.548 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T06:30:00.548 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-22T06:30:00.548 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-22T06:30:00.548 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:00.577 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T06:30:00.808 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 137/152 2024-04-22T06:30:00.849 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 138/152 2024-04-22T06:30:00.890 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 139/152 2024-04-22T06:30:00.922 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-22T06:30:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-22T06:30:01.136 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 142/152 2024-04-22T06:30:01.181 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-22T06:30:01.211 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 144/152 2024-04-22T06:30:01.853 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T06:30:01.892 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T06:30:01.913 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T06:30:02.705 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 146/152 2024-04-22T06:30:02.789 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-22T06:30:02.830 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-22T06:30:02.912 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-22T06:30:02.952 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-22T06:30:02.952 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T06:30:03.053 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T06:30:03.053 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T06:30:09.084 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 1/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 3/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 4/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 5/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 8/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 9/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 10/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 11/152 2024-04-22T06:30:09.085 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 13/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 14/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 15/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 16/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 17/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 18/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 19/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 20/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 21/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 22/152 2024-04-22T06:30:09.086 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 23/152 2024-04-22T06:30:09.087 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 24/152 2024-04-22T06:30:09.087 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 25/152 2024-04-22T06:30:09.087 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 26/152 2024-04-22T06:30:09.087 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 27/152 2024-04-22T06:30:09.087 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 28/152 2024-04-22T06:30:09.087 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 29/152 2024-04-22T06:30:09.087 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 30/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 31/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 32/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 33/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 34/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 35/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 36/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 37/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 38/152 2024-04-22T06:30:09.099 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 39/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-22T06:30:09.100 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-22T06:30:09.101 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-22T06:30:09.102 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-22T06:30:09.102 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-22T06:30:09.102 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-22T06:30:09.102 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-22T06:30:09.102 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-22T06:30:09.102 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-22T06:30:09.102 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-22T06:30:09.103 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-22T06:30:09.103 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-22T06:30:09.103 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-22T06:30:09.103 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-22T06:30:09.103 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-22T06:30:09.103 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-22T06:30:09.103 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-22T06:30:09.104 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-22T06:30:09.104 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-22T06:30:09.104 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-22T06:30:09.104 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-22T06:30:09.104 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-22T06:30:09.104 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-22T06:30:09.105 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-22T06:30:09.105 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-22T06:30:09.105 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-22T06:30:09.105 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-22T06:30:09.105 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-22T06:30:09.105 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-22T06:30:09.105 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-22T06:30:09.105 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-22T06:30:09.106 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-22T06:30:09.106 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-22T06:30:09.106 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-22T06:30:09.106 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-22T06:30:09.106 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-22T06:30:09.106 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-22T06:30:09.107 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-22T06:30:09.108 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-22T06:30:09.109 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-22T06:30:09.110 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 149/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-22T06:30:09.111 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 151/152 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout:Upgraded: 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout:Installed: 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout: automake-1.16.2-8.el9.noarch 2024-04-22T06:30:11.156 INFO:teuthology.orchestra.run.smithi113.stdout: bison-3.7.4-5.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-immutable-object-cache-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.157 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.158 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: flex-2.6.4-9.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-22T06:30:11.159 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.160 INFO:teuthology.orchestra.run.smithi113.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: lua-5.4.4-4.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-22T06:30:11.161 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-13.14-1.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.162 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-22T06:30:11.163 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-22T06:30:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ply-3.11-14.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-22T06:30:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-22T06:30:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-22T06:30:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.168 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.168 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:11.168 INFO:teuthology.orchestra.run.smithi113.stdout: re2-1:20211101-3.el9.x86_64 2024-04-22T06:30:11.168 INFO:teuthology.orchestra.run.smithi113.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-22T06:30:11.168 INFO:teuthology.orchestra.run.smithi113.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-22T06:30:11.168 INFO:teuthology.orchestra.run.smithi113.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-22T06:30:11.168 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-22T06:30:11.168 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-22T06:30:11.169 INFO:teuthology.orchestra.run.smithi113.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-22T06:30:11.169 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:11.169 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2024-04-22T06:30:11.545 DEBUG:teuthology.parallel:result is None 2024-04-22T06:30:12.157 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T06:30:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-04-22T06:30:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-04-22T06:30:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-04-22T06:30:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-04-22T06:30:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-04-22T06:30:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-04-22T06:30:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-04-22T06:30:12.158 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:12.341 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T06:30:12.357 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T06:30:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-22T06:30:12.357 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:13.826 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T06:30:13.853 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T06:30:13.853 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:13.853 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-22T06:30:13.853 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T06:30:13.853 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T06:30:13.853 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:14.094 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T06:30:14.117 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T06:30:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-22T06:30:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T06:30:14.117 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T06:30:14.117 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:14.571 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T06:30:14.594 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T06:30:14.594 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:14.594 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-22T06:30:14.594 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T06:30:14.594 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T06:30:14.594 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:14.701 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-22T06:30:14.758 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-22T06:30:14.822 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-22T06:30:15.010 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-22T06:30:15.064 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-22T06:30:15.142 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-22T06:30:15.256 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-22T06:30:15.397 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-22T06:30:15.446 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-22T06:30:15.478 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-22T06:30:15.506 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-22T06:30:15.901 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T06:30:15.930 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T06:30:15.954 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 122/152 2024-04-22T06:30:16.008 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 123/152 2024-04-22T06:30:16.036 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T06:30:17.078 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T06:30:17.113 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T06:30:18.076 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T06:30:18.105 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T06:30:18.208 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T06:30:18.377 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 127/152 2024-04-22T06:30:18.399 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T06:30:18.421 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T06:30:18.422 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:18.422 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-22T06:30:18.422 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T06:30:18.422 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T06:30:18.422 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:18.466 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T06:30:18.478 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T06:30:18.575 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 130/152 2024-04-22T06:30:18.623 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 131/152 2024-04-22T06:30:19.550 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-22T06:30:19.585 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T06:30:19.608 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T06:30:19.608 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:19.608 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-22T06:30:19.608 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T06:30:19.608 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T06:30:19.608 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:19.653 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T06:30:19.675 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T06:30:19.675 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:19.675 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-22T06:30:19.675 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:19.720 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T06:30:19.742 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T06:30:19.743 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:19.743 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-22T06:30:19.743 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T06:30:19.743 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T06:30:19.743 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:20.037 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T06:30:20.060 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T06:30:20.060 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T06:30:20.060 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-22T06:30:20.060 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T06:30:20.060 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T06:30:20.060 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:24.649 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 137/152 2024-04-22T06:30:24.689 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 138/152 2024-04-22T06:30:24.731 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 139/152 2024-04-22T06:30:24.771 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-22T06:30:24.798 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-22T06:30:24.987 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 142/152 2024-04-22T06:30:25.036 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-22T06:30:25.066 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 144/152 2024-04-22T06:30:25.634 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T06:30:25.672 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T06:30:25.692 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T06:30:26.479 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 146/152 2024-04-22T06:30:26.568 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-22T06:30:26.609 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-22T06:30:26.693 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-22T06:30:26.730 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-22T06:30:26.730 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T06:30:26.814 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T06:30:26.814 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T06:30:32.760 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T06:30:32.760 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 1/152 2024-04-22T06:30:32.760 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2/152 2024-04-22T06:30:32.760 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 3/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 4/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 5/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 8/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 9/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 10/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 11/152 2024-04-22T06:30:32.761 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 13/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 14/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 15/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 16/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 17/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 18/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 19/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 20/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 21/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 22/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 23/152 2024-04-22T06:30:32.762 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 24/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 25/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 26/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 27/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 28/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 29/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 30/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 31/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 32/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 33/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 34/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 35/152 2024-04-22T06:30:32.763 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 36/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 37/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 38/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 39/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-22T06:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-22T06:30:32.765 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-22T06:30:32.766 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-22T06:30:32.767 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-22T06:30:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-22T06:30:32.769 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-22T06:30:32.770 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-22T06:30:32.771 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 149/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-22T06:30:32.772 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 151/152 2024-04-22T06:30:34.900 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T06:30:34.900 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:34.900 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-04-22T06:30:34.900 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.900 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.900 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.2-8.el9.noarch 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.7.4-5.el9.x86_64 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.901 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.902 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.4-9.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-22T06:30:34.903 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-22T06:30:34.904 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: lua-5.4.4-4.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-22T06:30:34.905 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-13.14-1.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-22T06:30:34.906 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-22T06:30:34.907 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-22T06:30:34.908 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-22T06:30:34.909 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-22T06:30:34.910 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.911 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: re2-1:20211101-3.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-22T06:30:34.912 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:34.913 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-04-22T06:30:35.253 DEBUG:teuthology.parallel:result is None 2024-04-22T06:30:35.254 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T06:30:35.479 DEBUG:teuthology.orchestra.run.smithi113:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-22T06:30:35.504 INFO:teuthology.orchestra.run.smithi113.stdout:19.0.0-3156.g86f7587a.el9 2024-04-22T06:30:35.505 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.g86f7587a.el9 2024-04-22T06:30:35.505 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.g86f7587a is installed. 2024-04-22T06:30:35.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T06:30:35.729 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-22T06:30:35.751 INFO:teuthology.orchestra.run.smithi145.stdout:19.0.0-3156.g86f7587a.el9 2024-04-22T06:30:35.751 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.g86f7587a.el9 2024-04-22T06:30:35.751 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.g86f7587a is installed. 2024-04-22T06:30:35.753 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-22T06:30:35.753 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:35.753 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-22T06:30:35.783 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:30:35.783 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-22T06:30:35.819 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-22T06:30:35.819 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:35.819 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/daemon-helper 2024-04-22T06:30:35.851 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-22T06:30:35.918 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:30:35.919 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-04-22T06:30:35.944 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-22T06:30:36.010 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-22T06:30:36.010 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:36.010 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-22T06:30:36.036 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-22T06:30:36.102 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:30:36.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-22T06:30:36.126 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-22T06:30:36.189 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-22T06:30:36.190 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:36.190 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/stdin-killer 2024-04-22T06:30:36.214 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-22T06:30:36.277 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:30:36.277 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-04-22T06:30:36.303 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-22T06:30:36.368 INFO:teuthology.run_tasks:Running task ceph... 2024-04-22T06:30:36.449 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-22T06:30:36.449 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 777 /var/log/ceph 2024-04-22T06:30:36.451 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2024-04-22T06:30:36.487 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-22T06:30:36.488 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-22T06:30:36.530 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-22T06:30:36.554 INFO:tasks.ceph:Creating extra log directories... 2024-04-22T06:30:36.555 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-22T06:30:36.595 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-22T06:30:36.625 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-22T06:30:36.625 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-22T06:30:36.625 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-22T06:30:36.626 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:36.626 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-22T06:30:36.671 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-22T06:30:36.782 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-22T06:30:36.818 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:30:36.818 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-22T06:30:36.833 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-22T06:30:36.940 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-22T06:30:36.985 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-22T06:30:36.985 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-22T06:30:36.985 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/fs/trivial_sync}}', 'email': None, 'first_in_suite': False, 'job_id': '7668134', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4362, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'sleep_before_teardown': 0, 'subset': '222/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi113.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZ+77ifGZn2SiyzutY+8PjwaIY2E0agniXCAOSoNasPOzGOp5fR+Wle6IyCvhVhzh7Hc2OSF6w/MIKLr6txO14=', 'smithi145.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOWuUrUsYKZM9f3ntSvSFzMMULsB7naGYopwRAMwxaMNMQS4zAq7B1mBDsdK2ZH7UMBHL9Erac9RHCiWANJzEYI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-22_05:52:53', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-22T06:30:36.985 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-22T06:30:36.988 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-22T06:30:37.034 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/run/ceph 2024-04-22T06:30:37.046 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2024-04-22T06:30:37.097 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:37.097 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/scratch_devs of=/dev/stdout 2024-04-22T06:30:37.123 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-22T06:30:37.123 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_1 2024-04-22T06:30:37.177 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-22T06:30:37.177 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T06:30:37.177 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-22T06:30:37.177 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:30:37.177 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T06:30:37.177 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-22 06:30:03.553194713 +0000 2024-04-22T06:30:37.178 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-22 06:28:10.172257278 +0000 2024-04-22T06:30:37.178 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-22 06:28:10.172257278 +0000 2024-04-22T06:30:37.178 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-04-22 06:28:10.172257278 +0000 2024-04-22T06:30:37.178 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-22T06:30:37.238 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-22T06:30:37.238 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-22T06:30:37.238 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000211009 s, 2.4 MB/s 2024-04-22T06:30:37.240 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-22T06:30:37.296 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_2 2024-04-22T06:30:37.350 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-22T06:30:37.351 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T06:30:37.351 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-22T06:30:37.351 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:30:37.351 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T06:30:37.351 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-22 06:30:03.554194691 +0000 2024-04-22T06:30:37.351 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-22 06:28:10.515249784 +0000 2024-04-22T06:30:37.351 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-22 06:28:10.515249784 +0000 2024-04-22T06:30:37.351 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-04-22 06:28:10.515249784 +0000 2024-04-22T06:30:37.351 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-22T06:30:37.413 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-22T06:30:37.413 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-22T06:30:37.413 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000218324 s, 2.3 MB/s 2024-04-22T06:30:37.414 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-22T06:30:37.471 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_3 2024-04-22T06:30:37.525 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-22T06:30:37.525 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T06:30:37.525 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-22T06:30:37.526 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:30:37.526 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T06:30:37.526 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-22 06:30:03.554194691 +0000 2024-04-22T06:30:37.526 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-22 06:28:10.863242180 +0000 2024-04-22T06:30:37.526 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-22 06:28:10.863242180 +0000 2024-04-22T06:30:37.526 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-04-22 06:28:10.863242180 +0000 2024-04-22T06:30:37.526 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-22T06:30:37.588 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-22T06:30:37.588 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-22T06:30:37.588 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000213362 s, 2.4 MB/s 2024-04-22T06:30:37.589 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-22T06:30:37.644 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_4 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-04-22 06:30:03.554194691 +0000 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-22 06:28:11.220234380 +0000 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-22 06:28:11.220234380 +0000 2024-04-22T06:30:37.699 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-04-22 06:28:11.220234380 +0000 2024-04-22T06:30:37.699 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-22T06:30:37.761 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-04-22T06:30:37.761 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-04-22T06:30:37.761 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000206805 s, 2.5 MB/s 2024-04-22T06:30:37.763 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-22T06:30:37.818 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:37.818 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:30:37.818 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-04-22T06:30:37.834 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-22T06:30:37.834 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-04-22T06:30:37.889 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-22T06:30:37.889 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T06:30:37.889 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-22T06:30:37.889 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:30:37.889 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T06:30:37.890 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-04-22 06:30:27.333306189 +0000 2024-04-22T06:30:37.890 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-04-22 06:28:10.161515140 +0000 2024-04-22T06:30:37.890 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-04-22 06:28:10.161515140 +0000 2024-04-22T06:30:37.890 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-04-22 06:28:10.161515140 +0000 2024-04-22T06:30:37.890 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-22T06:30:37.953 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-04-22T06:30:37.953 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-04-22T06:30:37.953 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000212894 s, 2.4 MB/s 2024-04-22T06:30:37.954 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-22T06:30:38.010 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-04-22T06:30:38.065 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-22T06:30:38.065 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T06:30:38.065 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-22T06:30:38.065 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:30:38.065 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T06:30:38.065 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-04-22 06:30:27.334306169 +0000 2024-04-22T06:30:38.066 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-04-22 06:28:10.533507526 +0000 2024-04-22T06:30:38.066 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-04-22 06:28:10.533507526 +0000 2024-04-22T06:30:38.066 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-04-22 06:28:10.533507526 +0000 2024-04-22T06:30:38.066 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-22T06:30:38.128 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-04-22T06:30:38.128 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-04-22T06:30:38.128 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.00029364 s, 1.7 MB/s 2024-04-22T06:30:38.129 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-22T06:30:38.185 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-04-22T06:30:38.239 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-22T06:30:38.239 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T06:30:38.239 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-22T06:30:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:30:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T06:30:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-04-22 06:30:27.334306169 +0000 2024-04-22T06:30:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-04-22 06:28:10.868500670 +0000 2024-04-22T06:30:38.240 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-04-22 06:28:10.868500670 +0000 2024-04-22T06:30:38.240 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-04-22 06:28:10.868500670 +0000 2024-04-22T06:30:38.241 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-22T06:30:38.301 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-04-22T06:30:38.301 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-04-22T06:30:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000172899 s, 3.0 MB/s 2024-04-22T06:30:38.303 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-22T06:30:38.358 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-04-22 06:30:27.334306169 +0000 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-04-22 06:28:11.199493896 +0000 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-04-22 06:28:11.199493896 +0000 2024-04-22T06:30:38.412 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-04-22 06:28:11.199493896 +0000 2024-04-22T06:30:38.412 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-22T06:30:38.473 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-04-22T06:30:38.473 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-04-22T06:30:38.473 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000179682 s, 2.8 MB/s 2024-04-22T06:30:38.474 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-22T06:30:38.529 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:38.529 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-22T06:30:38.529 INFO:tasks.ceph:Generating config... 2024-04-22T06:30:38.531 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-22T06:30:38.531 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-22T06:30:38.531 INFO:tasks.ceph:[client] debug client = 20 2024-04-22T06:30:38.531 INFO:tasks.ceph:[client] debug ms = 1 2024-04-22T06:30:38.531 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-22T06:30:38.531 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-22T06:30:38.531 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-22T06:30:38.531 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-22T06:30:38.531 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-22T06:30:38.531 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-22T06:30:38.531 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-22T06:30:38.531 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-22T06:30:38.532 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-22T06:30:38.533 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-22T06:30:38.533 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-22T06:30:38.533 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-22T06:30:38.533 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-22T06:30:38.533 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-22T06:30:38.533 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-22T06:30:38.533 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-22T06:30:38.533 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-22T06:30:38.533 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-22T06:30:38.533 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-22T06:30:38.533 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-22T06:30:38.533 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-22T06:30:38.534 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-22T06:30:38.535 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-22T06:30:38.535 INFO:tasks.ceph:Setting up mon.a... 2024-04-22T06:30:38.535 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-22T06:30:38.592 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.keyring 2024-04-22T06:30:38.595 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-22T06:30:38.636 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T06:30:38.701 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.113'), ('mon.b', '172.21.15.145'), ('mon.c', '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]')] 2024-04-22T06:30:38.702 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.113,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-22T06:30:38.702 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:38.703 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-22T06:30:38.756 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.113 --add b 172.21.15.145 --addv c '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:38.843 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:38.843 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: generated fsid 3b8618c1-770c-4da4-9414-78b2efafbd55 2024-04-22T06:30:38.843 INFO:teuthology.orchestra.run.smithi113.stdout:setting min_mon_release = quincy 2024-04-22T06:30:38.843 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 0 2024-04-22T06:30:38.843 INFO:teuthology.orchestra.run.smithi113.stdout:fsid 3b8618c1-770c-4da4-9414-78b2efafbd55 2024-04-22T06:30:38.843 INFO:teuthology.orchestra.run.smithi113.stdout:last_changed 2024-04-22T06:30:38.845591+0000 2024-04-22T06:30:38.843 INFO:teuthology.orchestra.run.smithi113.stdout:created 2024-04-22T06:30:38.845591+0000 2024-04-22T06:30:38.844 INFO:teuthology.orchestra.run.smithi113.stdout:min_mon_release 17 (quincy) 2024-04-22T06:30:38.844 INFO:teuthology.orchestra.run.smithi113.stdout:election_strategy: 1 2024-04-22T06:30:38.844 INFO:teuthology.orchestra.run.smithi113.stdout:0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-04-22T06:30:38.844 INFO:teuthology.orchestra.run.smithi113.stdout:1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-04-22T06:30:38.844 INFO:teuthology.orchestra.run.smithi113.stdout:2: [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] mon.c 2024-04-22T06:30:38.844 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-22T06:30:38.845 DEBUG:teuthology.orchestra.run.smithi113:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-22T06:30:38.859 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3b8618c1-770c-4da4-9414-78b2efafbd55... 2024-04-22T06:30:38.860 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-22T06:30:38.902 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout:[global] 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: chdir = "" 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: auth supported = cephx 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: filestore xattr use omap = true 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: mon clock drift allowed = 1.000 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: osd crush chooseleaf type = 0 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: auth debug = true 2024-04-22T06:30:38.940 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on old message = true 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on bug = true 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: mon pg warn max object skew = 0 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: # disable pg_autoscaler by default for new pools 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default size = 2 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow primary affinity = true 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow pg remap = true 2024-04-22T06:30:38.941 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on legacy crush tunables = false 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on crush straw calc version zero = false 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on no sortbitwise = false 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on osd down out interval zero = false 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on too few osds = false 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: mon_allow_pool_size_one = true 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: osd default data pool replay window = 5 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.942 INFO:teuthology.orchestra.run.smithi113.stdout: mon allow pool delete = true 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: mon cluster log file level = debug 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: debug asserts on shutdown = true 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: mon health detail to clog = false 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: mon host = "172.21.15.113,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: fsid = 3b8618c1-770c-4da4-9414-78b2efafbd55 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout:[osd] 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: osd journal size = 100 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub load threshold = 5.0 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub max interval = 600 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: osd mclock profile = high_recovery_ops 2024-04-22T06:30:38.943 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd recover clone overlap = true 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd recovery max chunk = 1048576 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug shutdown = true 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug op order = true 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug verify stray on activate = true 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug trim objects = true 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd open classes on start = true 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug pg log writeout = true 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd deep scrub update digest min age = 30 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: osd map max advance = 10 2024-04-22T06:30:38.944 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: journal zero on create = true 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: filestore ondisk finisher threads = 3 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: filestore apply finisher threads = 3 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: bdev debug aio = true 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug misdirected ops = true 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore block size = 96636764160 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore fsck on mount = True 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluefs = 20 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluestore = 20 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: debug osd = 20 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: debug rocksdb = 10 2024-04-22T06:30:38.945 INFO:teuthology.orchestra.run.smithi113.stdout: mon client directed command retry = 5 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd backfillfull_ratio = 0.85 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd full ratio = 0.9 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd nearfull ratio = 0.8 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: ms inject delay max = 1 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: ms inject delay probability = 0.005 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: ms inject delay type = client mds 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: ms inject socket failures = 2500 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: osd blocked scrub grace period = 3600 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: osd failsafe full ratio = 0.95 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: osd max markdown count = 1000 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: osd objectstore = bluestore 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2024-04-22T06:30:38.946 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr] 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug mgr = 20 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: mgr/telemetry/nag = false 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout:[mon] 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug paxos = 20 2024-04-22T06:30:38.947 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: mon data avail warn = 5 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: mon mgr mkfs grace = 240 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd reporter subtree level = osd 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd prime pg temp = true 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: auth mon ticket ttl = 660 # 11m 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: auth service ticket ttl = 240 # 4m 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: # don't complain about insecure global_id in the test suite 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.948 INFO:teuthology.orchestra.run.smithi113.stdout: # 1m isn't quite enough 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: mon_down_mkfs_grace = 2m 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_filestore_osds = false 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: mon down mkfs grace = 300 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: mon op complaint time = 120 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout:[client] 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: rgw cache enabled = true 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable ops log = true 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable usage log = true 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: client mount timeout = 600 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: client_shutdown_timeout = 120 2024-04-22T06:30:38.949 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.a] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.b] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.c] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.e] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.f] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout:[mds] 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds = 20 2024-04-22T06:30:38.950 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds balancer = 20 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds bal fragment size max = 10000 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds bal merge size = 5 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds bal split bits = 3 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds bal split size = 100 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug frag = True 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug scatterstat = True 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds oft prefetch dirfrags = True 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds op complaint time = 180 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds verify scatter = True 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds_dir_prefetch = True 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mds_sleep_rank_change = 5000000.0 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: mon client directed command retry = 5 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: ms inject delay max = 1 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: ms inject delay probability = 0.005 2024-04-22T06:30:38.951 INFO:teuthology.orchestra.run.smithi113.stdout: ms inject delay type = client mds osd 2024-04-22T06:30:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: ms inject socket failures = 2500 2024-04-22T06:30:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2024-04-22T06:30:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2024-04-22T06:30:38.952 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2024-04-22T06:30:38.960 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2024-04-22T06:30:38.961 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2024-04-22T06:30:38.962 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = "172.21.15.113,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 3b8618c1-770c-4da4-9414-78b2efafbd55 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: osd mclock profile = high_recovery_ops 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2024-04-22T06:30:38.963 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug trim objects = true 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.964 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 20 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 20 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 10 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: mon client directed command retry = 5 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2024-04-22T06:30:38.965 INFO:teuthology.orchestra.run.smithi145.stdout: ms inject delay max = 1 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: ms inject delay probability = 0.005 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: ms inject delay type = client mds 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: ms inject socket failures = 2500 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: osd blocked scrub grace period = 3600 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: osd max markdown count = 1000 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-04-22T06:30:38.966 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2024-04-22T06:30:38.967 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2024-04-22T06:30:38.968 INFO:teuthology.orchestra.run.smithi145.stdout: mon down mkfs grace = 300 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: mon op complaint time = 120 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: client mount timeout = 600 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: client_shutdown_timeout = 120 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2024-04-22T06:30:38.969 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.b] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.c] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.e] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.f] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout:[mds] 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds = 20 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds balancer = 20 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal fragment size max = 10000 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal merge size = 5 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal split bits = 3 2024-04-22T06:30:38.970 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal split size = 100 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug frag = True 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug scatterstat = True 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: mds oft prefetch dirfrags = True 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: mds op complaint time = 180 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: mds verify scatter = True 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: mds_dir_prefetch = True 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: mds_sleep_rank_change = 5000000.0 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: mon client directed command retry = 5 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: ms inject delay max = 1 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: ms inject delay probability = 0.005 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: ms inject delay type = client mds osd 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: ms inject socket failures = 2500 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2024-04-22T06:30:38.971 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2024-04-22T06:30:38.972 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-22T06:30:38.972 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-22T06:30:39.045 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-22T06:30:39.045 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:39.045 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-22T06:30:39.059 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:39.059 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-22T06:30:39.114 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:30:39.114 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:39.114 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-22T06:30:39.114 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T06:30:39.186 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:30:39.186 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:39.241 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:30:39.241 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:30:39.241 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-22T06:30:39.241 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T06:30:39.274 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:30:39.274 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:39.329 INFO:tasks.ceph:Setting up mon nodes... 2024-04-22T06:30:39.329 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-22T06:30:39.329 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-22T06:30:39.377 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-22T06:30:39.379 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-22T06:30:39.469 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-22T06:30:39.472 INFO:tasks.ceph:Setting up mds nodes... 2024-04-22T06:30:39.472 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-22T06:30:39.520 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-22T06:30:39.522 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-22T06:30:39.546 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-22T06:30:39.633 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-22T06:30:39.636 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-22T06:30:39.658 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-22T06:30:39.746 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-22T06:30:39.749 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-22T06:30:39.771 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-22T06:30:39.820 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-22T06:30:39.822 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-22T06:30:39.845 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-22T06:30:39.933 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-22T06:30:39.935 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-22T06:30:39.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-22T06:30:40.045 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-22T06:30:40.047 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-22T06:30:40.070 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-22T06:30:40.070 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-22T06:30:40.109 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-22T06:30:40.121 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-22T06:30:40.121 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-22T06:30:40.121 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-22T06:30:40.184 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:40.185 INFO:tasks.ceph:role: osd.0 2024-04-22T06:30:40.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:30:40.185 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-22T06:30:40.255 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T06:30:40.255 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T06:30:40.255 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T06:30:40.255 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T06:30:40.255 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T06:30:40.255 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-04-22T06:30:40.256 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T06:30:40.256 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T06:30:40.256 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T06:30:40.256 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T06:30:40.780 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-04-22T06:30:40.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-04-22T06:30:40.782 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-22T06:30:40.889 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-22T06:30:40.918 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-22T06:30:40.981 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:40.981 INFO:tasks.ceph:role: osd.1 2024-04-22T06:30:40.981 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:30:40.981 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T06:30:41.052 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T06:30:41.534 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-04-22T06:30:41.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-04-22T06:30:41.536 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-22T06:30:41.633 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-22T06:30:41.663 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-22T06:30:41.727 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:41.727 INFO:tasks.ceph:role: osd.2 2024-04-22T06:30:41.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:30:41.727 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-22T06:30:41.800 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T06:30:41.800 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T06:30:41.800 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T06:30:41.800 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T06:30:41.800 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T06:30:41.800 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-04-22T06:30:41.800 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T06:30:41.800 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T06:30:41.801 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T06:30:41.801 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T06:30:42.321 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-04-22T06:30:42.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-04-22T06:30:42.323 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-22T06:30:42.417 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-22T06:30:42.447 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-22T06:30:42.511 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:42.511 INFO:tasks.ceph:role: osd.3 2024-04-22T06:30:42.512 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:30:42.512 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-22T06:30:42.584 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T06:30:42.584 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T06:30:42.584 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T06:30:42.584 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T06:30:42.584 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T06:30:42.584 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-04-22T06:30:42.584 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T06:30:42.584 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T06:30:42.585 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T06:30:42.585 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T06:30:43.112 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-04-22T06:30:43.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-04-22T06:30:43.114 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-22T06:30:43.230 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-22T06:30:43.259 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:43.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:43.349+0000 7fa3fc02c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-22T06:30:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:43.351+0000 7fa3fc02c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-22T06:30:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:43.351+0000 7fa3fc02c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T06:30:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:43.351+0000 7fa3fc02c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T06:30:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:43.351+0000 7fa3fc02c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T06:30:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:43.357+0000 7fa3fc02c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-22T06:30:46.213 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-22T06:30:46.241 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:46.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:46.330+0000 7f2c834b3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-22T06:30:46.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:46.330+0000 7f2c834b3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-22T06:30:46.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:46.330+0000 7f2c834b3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T06:30:46.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:46.330+0000 7f2c834b3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T06:30:46.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:46.330+0000 7f2c834b3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T06:30:46.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:46.331+0000 7f2c834b3640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-22T06:30:49.179 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-22T06:30:49.203 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:49.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:49.289+0000 7f291fa10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-22T06:30:49.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:49.290+0000 7f291fa10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-22T06:30:49.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:49.290+0000 7f291fa10640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T06:30:49.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:49.290+0000 7f291fa10640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T06:30:49.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:49.290+0000 7f291fa10640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T06:30:49.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:49.291+0000 7f291fa10640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-22T06:30:52.147 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-22T06:30:52.172 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:52.258+0000 7f98b661d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-22T06:30:52.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:52.258+0000 7f98b661d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-22T06:30:52.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:52.259+0000 7f98b661d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T06:30:52.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:52.259+0000 7f98b661d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T06:30:52.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:52.259+0000 7f98b661d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T06:30:52.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:30:52.259+0000 7f98b661d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-22T06:30:55.105 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-22T06:30:55.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-22T06:30:55.158 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:55.158 INFO:tasks.ceph:role: osd.4 2024-04-22T06:30:55.158 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:30:55.159 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-22T06:30:55.233 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T06:30:55.233 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T06:30:55.233 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T06:30:55.233 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T06:30:55.233 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T06:30:55.233 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-04-22T06:30:55.234 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T06:30:55.234 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T06:30:55.234 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T06:30:55.234 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T06:30:55.728 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-04-22T06:30:55.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-04-22T06:30:55.731 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-22T06:30:55.864 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-22T06:30:55.898 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-22T06:30:55.965 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:55.966 INFO:tasks.ceph:role: osd.5 2024-04-22T06:30:55.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:30:55.966 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-22T06:30:56.040 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T06:30:56.040 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T06:30:56.040 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T06:30:56.040 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T06:30:56.040 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T06:30:56.041 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-04-22T06:30:56.041 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T06:30:56.041 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T06:30:56.041 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T06:30:56.041 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T06:30:56.495 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-04-22T06:30:56.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-04-22T06:30:56.497 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-22T06:30:56.582 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-22T06:30:56.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-22T06:30:56.674 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:56.674 INFO:tasks.ceph:role: osd.6 2024-04-22T06:30:56.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:30:56.674 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-22T06:30:56.744 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T06:30:56.745 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T06:30:57.243 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-04-22T06:30:57.245 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-04-22T06:30:57.245 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-22T06:30:57.364 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-22T06:30:57.392 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-22T06:30:57.455 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T06:30:57.456 INFO:tasks.ceph:role: osd.7 2024-04-22T06:30:57.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:30:57.456 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-22T06:30:57.526 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T06:30:57.527 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T06:30:57.527 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T06:30:57.527 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T06:30:57.527 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T06:30:57.527 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-04-22T06:30:57.527 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T06:30:57.528 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T06:30:57.528 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T06:30:57.528 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T06:30:58.040 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-04-22T06:30:58.042 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-04-22T06:30:58.043 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-22T06:30:58.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-22T06:30:58.231 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:30:58.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:30:58.329+0000 7f0881e0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-22T06:30:58.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:30:58.330+0000 7f0881e0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-22T06:30:58.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:30:58.330+0000 7f0881e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T06:30:58.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:30:58.330+0000 7f0881e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T06:30:58.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:30:58.330+0000 7f0881e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T06:30:58.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:30:58.330+0000 7f0881e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-22T06:31:01.174 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-22T06:31:01.201 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:31:01.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:01.289+0000 7fa16b62e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-22T06:31:01.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:01.290+0000 7fa16b62e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-22T06:31:01.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:01.290+0000 7fa16b62e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T06:31:01.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:01.290+0000 7fa16b62e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T06:31:01.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:01.290+0000 7fa16b62e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T06:31:01.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:01.290+0000 7fa16b62e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-22T06:31:04.136 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-22T06:31:04.164 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:31:04.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:04.253+0000 7f7c95923640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-22T06:31:04.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:04.253+0000 7f7c95923640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-22T06:31:04.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:04.254+0000 7f7c95923640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T06:31:04.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:04.254+0000 7f7c95923640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T06:31:04.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:04.254+0000 7f7c95923640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T06:31:04.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:04.254+0000 7f7c95923640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-22T06:31:06.986 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:31:06.990 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:31:07.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-22T06:31:07.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:31:07.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:07.216+0000 7f2f1be2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-22T06:31:07.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:07.216+0000 7f2f1be2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-22T06:31:07.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:07.216+0000 7f2f1be2c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T06:31:07.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:07.216+0000 7f2f1be2c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T06:31:07.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:07.216+0000 7f2f1be2c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T06:31:07.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:07.217+0000 7f2f1be2c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-22T06:31:10.061 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-22T06:31:10.126 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-22T06:31:10.126 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:10.126 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-22T06:31:10.154 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:10.154 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-22T06:31:10.221 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:10.221 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-22T06:31:10.287 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:10.287 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-22T06:31:10.352 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:10.353 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-22T06:31:10.418 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:10.418 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-22T06:31:10.482 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:10.483 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-22T06:31:10.547 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:10.547 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-22T06:31:10.611 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:10.612 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-22T06:31:10.637 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:10.637 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-22T06:31:10.702 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:10.702 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-22T06:31:10.767 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:10.767 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-22T06:31:10.830 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:10.830 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-22T06:31:10.895 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:10.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-22T06:31:10.958 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:10.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-22T06:31:11.022 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:11.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-22T06:31:11.084 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:11.085 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-22T06:31:11.101 INFO:tasks.ceph:Adding keys to all mons... 2024-04-22T06:31:11.101 DEBUG:teuthology.orchestra.run.smithi113:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-22T06:31:11.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-22T06:31:11.164 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr.y] 2024-04-22T06:31:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAPBCZm5mqeFhAAL1RgLQzsm3Ej4Dl0DYDzIA== 2024-04-22T06:31:11.164 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2024-04-22T06:31:11.164 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAPBCZmWO0kHxAA041iEfMJVnxYFK22mkGDEQ== 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAPBCZmgI7qJRAAmAzwa6IaTeRJnhwip7qalQ== 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.e] 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAPBCZm4I6oLBAATqJCbIG43biXyokZP7t06Q== 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.0] 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQATBCZm+ErVFBAASi3FdcKqoPe5/lNLnEeyEg== 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.1] 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAWBCZmbvK3ExAAEgBQNKVr7o6jyIZlNRNTkQ== 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.2] 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAZBCZmRbxQERAAGeHTXkrFSYtsAmAlMTxtEg== 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.3] 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAcBCZmozpyDxAAs/wQcHyEhbw2mCBL5s7vig== 2024-04-22T06:31:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr.x] 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAPBCZmkmYlHBAAgejFJBZgFovb7rRRv2pYig== 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAPBCZmkbkFMRAA0N/OArKUSDv3kr2dOZ6xZg== 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAPBCZmhV3GNxAA7BMBfwh9q5zqh97CtYRNNQ== 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.f] 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAQBCZmhxjYAhAAndZ1b5BO9El5Vj8hBLWKFQ== 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.4] 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAiBCZm2iG5ExAAr718f3JFRPVVO154G53QBw== 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.5] 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAlBCZm0q9UERAAraF4u1OPy7KdmP2Im5r3cA== 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.6] 2024-04-22T06:31:11.166 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAoBCZmNoYtDxAAMqIosMVJZXxXdvfiAzCM2Q== 2024-04-22T06:31:11.167 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.7] 2024-04-22T06:31:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQArBCZmQH/zDBAAS6hy8r4X66gZ9ArM6NpAGQ== 2024-04-22T06:31:11.167 INFO:teuthology.orchestra.run.smithi113.stdout:[client.0] 2024-04-22T06:31:11.167 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAQBCZmnOCrBhAANN/wZVnT/mKd1ikwEzpGXQ== 2024-04-22T06:31:11.168 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.y] 2024-04-22T06:31:11.168 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAPBCZm5mqeFhAAL1RgLQzsm3Ej4Dl0DYDzIA== 2024-04-22T06:31:11.168 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2024-04-22T06:31:11.168 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAPBCZmWO0kHxAA041iEfMJVnxYFK22mkGDEQ== 2024-04-22T06:31:11.168 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAPBCZmgI7qJRAAmAzwa6IaTeRJnhwip7qalQ== 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.e] 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAPBCZm4I6oLBAATqJCbIG43biXyokZP7t06Q== 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQATBCZm+ErVFBAASi3FdcKqoPe5/lNLnEeyEg== 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAWBCZmbvK3ExAAEgBQNKVr7o6jyIZlNRNTkQ== 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAZBCZmRbxQERAAGeHTXkrFSYtsAmAlMTxtEg== 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAcBCZmozpyDxAAs/wQcHyEhbw2mCBL5s7vig== 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.x] 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAPBCZmkmYlHBAAgejFJBZgFovb7rRRv2pYig== 2024-04-22T06:31:11.169 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAPBCZmkbkFMRAA0N/OArKUSDv3kr2dOZ6xZg== 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAPBCZmhV3GNxAA7BMBfwh9q5zqh97CtYRNNQ== 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.f] 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAQBCZmhxjYAhAAndZ1b5BO9El5Vj8hBLWKFQ== 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.4] 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAiBCZm2iG5ExAAr718f3JFRPVVO154G53QBw== 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.5] 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAlBCZm0q9UERAAraF4u1OPy7KdmP2Im5r3cA== 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.6] 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAoBCZmNoYtDxAAMqIosMVJZXxXdvfiAzCM2Q== 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.7] 2024-04-22T06:31:11.170 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQArBCZmQH/zDBAAS6hy8r4X66gZ9ArM6NpAGQ== 2024-04-22T06:31:11.171 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2024-04-22T06:31:11.171 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQAQBCZmnOCrBhAANN/wZVnT/mKd1ikwEzpGXQ== 2024-04-22T06:31:11.171 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T06:31:11.210 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T06:31:11.259 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.262 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.313 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.315 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.366 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.368 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.420 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.422 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.470 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.472 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.520 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.522 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.570 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.573 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.621 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T06:31:11.623 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T06:31:11.671 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.674 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.724 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.778 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.780 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T06:31:11.831 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.833 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.883 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.885 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.935 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.937 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.985 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:11.988 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T06:31:12.037 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T06:31:12.039 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T06:31:12.091 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-22T06:31:12.092 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-22T06:31:12.115 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T06:31:12.211 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-22T06:31:12.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-22T06:31:12.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T06:31:12.352 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-22T06:31:12.375 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-22T06:31:12.439 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T06:31:12.532 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-22T06:31:12.556 DEBUG:teuthology.orchestra.run.smithi113:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:31:12.559 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-22T06:31:12.611 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-22T06:31:12.611 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-22T06:31:12.611 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-22T06:31:12.613 INFO:tasks.ceph.mon.a:Started 2024-04-22T06:31:12.613 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-22T06:31:12.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-22T06:31:12.653 INFO:tasks.ceph.mon.b:Started 2024-04-22T06:31:12.653 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-22T06:31:12.653 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-22T06:31:12.655 INFO:tasks.ceph.mon.c:Started 2024-04-22T06:31:12.655 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-22T06:31:12.655 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-22T06:31:12.655 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-22T06:31:12.658 INFO:tasks.ceph.mgr.y:Started 2024-04-22T06:31:12.658 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-22T06:31:12.658 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-22T06:31:12.660 INFO:tasks.ceph.mgr.x:Started 2024-04-22T06:31:12.660 INFO:tasks.ceph:Setting crush tunables to default 2024-04-22T06:31:12.660 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd crush tunables default 2024-04-22T06:31:12.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.757+0000 7f5263b84640 1 Processor -- start 2024-04-22T06:31:12.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.757+0000 7f5263b84640 1 -- start start 2024-04-22T06:31:12.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5263b84640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f525c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:12.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5263b84640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f525c0c60c0 0x7f525c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:12.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5263b84640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525c0c5900 con 0x7f525c155220 2024-04-22T06:31:12.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5263b84640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f525c15c040 con 0x7f525c0c60c0 2024-04-22T06:31:12.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5263b84640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f525c0ccb70 con 0x7f525c0cb270 2024-04-22T06:31:12.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5261920640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f525c155220 0x7f525c0d0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33518/0 (socket says 172.21.15.113:33518) 2024-04-22T06:31:12.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5261920640 1 -- 172.21.15.113:0/1213999553 learned_addr learned my addr 172.21.15.113:0/1213999553 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:12.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5262121640 1 --2- 172.21.15.113:0/1213999553 >> v2:172.21.15.145:3300/0 conn(0x7f525c0c60c0 0x7f525c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f526111f640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f525c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f526111f640 1 -- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 msgr2=0x7f525c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f526111f640 1 -- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 msgr2=0x7f525c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f526111f640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f525c06d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5262121640 1 -- 172.21.15.113:0/1213999553 >> v2:172.21.15.145:3300/0 conn(0x7f525c0c60c0 msgr2=0x7f525c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5262121640 1 -- 172.21.15.113:0/1213999553 >> v2:172.21.15.145:3300/0 conn(0x7f525c0c60c0 msgr2=0x7f525c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5262121640 1 --2- 172.21.15.113:0/1213999553 >> v2:172.21.15.145:3300/0 conn(0x7f525c0c60c0 0x7f525c0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f526111f640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f525c06d510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:31:12.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.758+0000 7f5262121640 1 --2- 172.21.15.113:0/1213999553 >> v2:172.21.15.145:3300/0 conn(0x7f525c0c60c0 0x7f525c0c6550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:31:12.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.920+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909209190 0 0) 0x7f525c0c5900 con 0x7f525c155220 2024-04-22T06:31:12.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.920+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5248003520 con 0x7f525c155220 2024-04-22T06:31:12.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 590424405 0 0) 0x7f5248003520 con 0x7f525c155220 2024-04-22T06:31:12.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 msgr2=0x7f525c06d510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:31:12.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f525c06d510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 >> v2:172.21.15.145:3300/0 conn(0x7f525c0c60c0 msgr2=0x7f525c0c6550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:31:12.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 --2- 172.21.15.113:0/1213999553 >> v2:172.21.15.145:3300/0 conn(0x7f525c0c60c0 0x7f525c0c6550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c0cc4f0 con 0x7f525c155220 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f5250001670 con 0x7f525c155220 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 >> v1:172.21.15.113:6789/0 conn(0x7f525c155220 legacy=0x7f525c0d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52480039b0 0x7f5248003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f5248004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5248004d40 0x7f52480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f525c15c040 con 0x7f52480039b0 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f524800ba70 con 0x7f5248004d40 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f524800bc70 con 0x7f525c0cb270 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f5261920640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52480039b0 0x7f5248003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f5262121640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5248004d40 0x7f52480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:12.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526111f640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f5248004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f5261920640 1 -- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 msgr2=0x7f5248004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f5261920640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f5248004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f5261920640 1 -- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5248004d40 msgr2=0x7f52480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f5261920640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5248004d40 0x7f52480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f5261920640 1 -- 172.21.15.113:0/1213999553 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5248003520 con 0x7f52480039b0 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f526111f640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f525c0cb270 0x7f5248004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.921+0000 7f5262121640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5248004d40 0x7f52480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.922+0000 7f5261920640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52480039b0 0x7f5248003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5250007fd0 tx=0x7f5248005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e5e761e7dd0fd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.922+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250007d50 con 0x7f52480039b0 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.922+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5250030070 con 0x7f52480039b0 2024-04-22T06:31:12.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.922+0000 7f526091e640 1 -- 172.21.15.113:0/1213999553 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525002cd40 con 0x7f52480039b0 2024-04-22T06:31:12.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.923+0000 7f5263b84640 1 -- 172.21.15.113:0/1213999553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52480039b0 msgr2=0x7f5248003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:12.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.923+0000 7f5263b84640 1 --2- 172.21.15.113:0/1213999553 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52480039b0 0x7f5248003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5250007fd0 tx=0x7f5248005830 comp rx=0 tx=0).stop 2024-04-22T06:31:12.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.923+0000 7f5262121640 1 -- 172.21.15.113:0/1213999553 reap_dead start 2024-04-22T06:31:12.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.923+0000 7f5263b84640 1 -- 172.21.15.113:0/1213999553 shutdown_connections 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.923+0000 7f5263b84640 1 -- 172.21.15.113:0/1213999553 >> 172.21.15.113:0/1213999553 conn(0x7f525c075170 msgr2=0x7f525c075580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.923+0000 7f5263b84640 1 -- 172.21.15.113:0/1213999553 shutdown_connections 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.923+0000 7f5263b84640 1 -- 172.21.15.113:0/1213999553 wait complete. 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.925+0000 7f5263b84640 1 Processor -- start 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.925+0000 7f5263b84640 1 -- start start 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5263b84640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52480039b0 0x7f525c0c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5263b84640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f525c15efd0 0x7f525c0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5263b84640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f525c15c2a0 0x7f525c15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5263b84640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f525c15bd60 con 0x7f525c15efd0 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5263b84640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0c5c30 con 0x7f525c15c2a0 2024-04-22T06:31:12.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f525c15efd0 0x7f525c0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5261920640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52480039b0 0x7f525c0c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f525c15efd0 0x7f525c0b5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45286/0 (socket says 172.21.15.113:45286) 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 -- 172.21.15.113:0/1837299787 learned_addr learned my addr 172.21.15.113:0/1837299787 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f525c155600 con 0x7f52480039b0 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5262121640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f525c15c2a0 0x7f525c15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 -- 172.21.15.113:0/1837299787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52480039b0 msgr2=0x7f525c0c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52480039b0 0x7f525c0c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 -- 172.21.15.113:0/1837299787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f525c15c2a0 msgr2=0x7f525c15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f525c15c2a0 0x7f525c15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 -- 172.21.15.113:0/1837299787 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c15cc70 con 0x7f525c15efd0 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f5262121640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f525c15c2a0 0x7f525c15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.926+0000 7f526111f640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f525c15efd0 0x7f525c0b5500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f525800f4c0 tx=0x7f525800f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:12.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.927+0000 7f524e7fc640 1 -- 172.21.15.113:0/1837299787 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258019070 con 0x7f525c15efd0 2024-04-22T06:31:12.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.927+0000 7f524e7fc640 1 -- 172.21.15.113:0/1837299787 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5258014870 con 0x7f525c15efd0 2024-04-22T06:31:12.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.927+0000 7f524e7fc640 1 -- 172.21.15.113:0/1837299787 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258014c60 con 0x7f525c15efd0 2024-04-22T06:31:12.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.927+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c14fcf0 con 0x7f525c15efd0 2024-04-22T06:31:12.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.927+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c1510e0 con 0x7f525c15efd0 2024-04-22T06:31:12.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.927+0000 7f524e7fc640 1 -- 172.21.15.113:0/1837299787 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f525801c070 con 0x7f525c15efd0 2024-04-22T06:31:12.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.927+0000 7f524e7fc640 1 -- 172.21.15.113:0/1837299787 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5258015770 con 0x7f525c15efd0 2024-04-22T06:31:12.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.928+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c0cb7a0 con 0x7f525c15efd0 2024-04-22T06:31:12.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.930+0000 7f524e7fc640 1 -- 172.21.15.113:0/1837299787 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f52580159c0 con 0x7f525c15efd0 2024-04-22T06:31:12.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.995+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f525c068e20 con 0x7f525c15efd0 2024-04-22T06:31:12.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.997+0000 7f524e7fc640 1 -- 172.21.15.113:0/1837299787 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5258015ba0 con 0x7f525c15efd0 2024-04-22T06:31:12.996 INFO:teuthology.orchestra.run.smithi113.stderr:adjusted tunables profile to default 2024-04-22T06:31:12.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.997+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f525c15efd0 msgr2=0x7f525c0b5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:12.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.997+0000 7f5263b84640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f525c15efd0 0x7f525c0b5500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f525800f4c0 tx=0x7f525800f980 comp rx=0 tx=0).stop 2024-04-22T06:31:12.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.997+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 shutdown_connections 2024-04-22T06:31:12.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.998+0000 7f5263b84640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f525c15c2a0 0x7f525c15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.998+0000 7f5263b84640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f525c15efd0 0x7f525c0b5500 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.998+0000 7f5263b84640 1 --2- 172.21.15.113:0/1837299787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52480039b0 0x7f525c0c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:12.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.998+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 >> 172.21.15.113:0/1837299787 conn(0x7f525c075170 msgr2=0x7f525c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:12.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.998+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 shutdown_connections 2024-04-22T06:31:12.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:12.998+0000 7f5263b84640 1 -- 172.21.15.113:0/1837299787 wait complete. 2024-04-22T06:31:13.008 INFO:tasks.ceph:check_enable_crimson: False 2024-04-22T06:31:13.008 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-22T06:31:13.008 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:13.008 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-22T06:31:13.027 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:13.028+0000 7efe3ebbb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-22T06:31:13.028 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:13.029+0000 7f8e71611040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-22T06:31:13.031 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:13.032 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-22T06:31:13.096 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:13.097 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-22T06:31:13.161 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:13.161 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-22T06:31:13.172 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:13.174+0000 7f8e71611040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-22T06:31:13.186 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:13.187+0000 7efe3ebbb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-22T06:31:13.209 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:13.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-22T06:31:13.226 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:13.227+0000 7f8e71611040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-22T06:31:13.232 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:13.232 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-22T06:31:13.242 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:13.243+0000 7efe3ebbb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-22T06:31:13.297 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:13.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-22T06:31:13.359 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-22T06:31:13.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-22T06:31:13.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d 0 2024-04-22T06:31:13.489 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:13.489+0000 7efe3ebbb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-22T06:31:13.534 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:13.534+0000 7efe3ebbb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-22T06:31:13.542 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:13.543+0000 7f8e71611040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-22T06:31:13.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.562+0000 7f0069a11640 1 Processor -- start 2024-04-22T06:31:13.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.562+0000 7f0069a11640 1 -- start start 2024-04-22T06:31:13.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f0069a11640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f0069a11640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00640c9ff0 0x7f00640ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f0069a11640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f006415e780 con 0x7f0064144220 2024-04-22T06:31:13.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f0069a11640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f006415f570 con 0x7f00640c9ff0 2024-04-22T06:31:13.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f0069a11640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f006415e9f0 con 0x7f0064144600 2024-04-22T06:31:13.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00627fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00627fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006415bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:51136/0 (socket says 172.21.15.145:51136) 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00627fc640 1 -- 172.21.15.145:0/692869541 learned_addr learned my addr 172.21.15.145:0/692869541 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00637fe640 1 --2- 172.21.15.145:0/692869541 >> v2:172.21.15.113:3300/0 conn(0x7f00640c9ff0 0x7f00640ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00627fc640 1 -- 172.21.15.145:0/692869541 >> v2:172.21.15.113:3300/0 conn(0x7f00640c9ff0 msgr2=0x7f00640ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00627fc640 1 --2- 172.21.15.145:0/692869541 >> v2:172.21.15.113:3300/0 conn(0x7f00640c9ff0 0x7f00640ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00627fc640 1 -- 172.21.15.145:0/692869541 >> v1:172.21.15.113:6789/0 conn(0x7f0064144220 legacy=0x7f00640cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00627fc640 1 -- 172.21.15.145:0/692869541 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006415ecd0 con 0x7f0064144600 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.563+0000 7f00637fe640 1 --2- 172.21.15.145:0/692869541 >> v2:172.21.15.113:3300/0 conn(0x7f00640c9ff0 0x7f00640ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.564+0000 7f00627fc640 1 --2- 172.21.15.145:0/692869541 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006415bc00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0054009870 tx=0x7f005402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e70196cf96a58592 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.564+0000 7f0061ffb640 1 -- 172.21.15.145:0/692869541 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054034070 con 0x7f0064144600 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.564+0000 7f0061ffb640 1 -- 172.21.15.145:0/692869541 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0054030840 con 0x7f0064144600 2024-04-22T06:31:13.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.564+0000 7f0061ffb640 1 -- 172.21.15.145:0/692869541 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054030c10 con 0x7f0064144600 2024-04-22T06:31:13.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.565+0000 7f0069a11640 1 -- 172.21.15.145:0/692869541 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 msgr2=0x7f006415bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.565+0000 7f0069a11640 1 --2- 172.21.15.145:0/692869541 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006415bc00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0054009870 tx=0x7f005402b980 comp rx=0 tx=0).stop 2024-04-22T06:31:13.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.565+0000 7f0069a11640 1 -- 172.21.15.145:0/692869541 shutdown_connections 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.565+0000 7f0069a11640 1 --2- 172.21.15.145:0/692869541 >> v2:172.21.15.113:3300/0 conn(0x7f00640c9ff0 0x7f00640ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.565+0000 7f0069a11640 1 --2- 172.21.15.145:0/692869541 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006415bc00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.565+0000 7f0069a11640 1 -- 172.21.15.145:0/692869541 >> 172.21.15.145:0/692869541 conn(0x7f006406b920 msgr2=0x7f006406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.565+0000 7f0069a11640 1 -- 172.21.15.145:0/692869541 shutdown_connections 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.565+0000 7f0069a11640 1 -- 172.21.15.145:0/692869541 wait complete. 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.566+0000 7f0069a11640 1 Processor -- start 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.566+0000 7f0069a11640 1 -- start start 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0069a11640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00640c9ff0 0x7f00640c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0069a11640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0064144220 0x7f006415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0069a11640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006413ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0069a11640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f00640cba90 con 0x7f0064144220 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0069a11640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f006415f290 con 0x7f00640c9ff0 2024-04-22T06:31:13.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0069a11640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f00640cc730 con 0x7f0064144600 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0062ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00640c9ff0 0x7f00640c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0062ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00640c9ff0 0x7f00640c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44702/0 (socket says 172.21.15.145:44702) 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0062ffd640 1 -- 172.21.15.145:0/4221913960 learned_addr learned my addr 172.21.15.145:0/4221913960 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f00637fe640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006413ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f00627fc640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0064144220 0x7f006415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0062ffd640 1 -- 172.21.15.145:0/4221913960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 msgr2=0x7f006413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0062ffd640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006413ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0062ffd640 1 -- 172.21.15.145:0/4221913960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0064144220 msgr2=0x7f006415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0062ffd640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0064144220 0x7f006415d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.567+0000 7f0062ffd640 1 -- 172.21.15.145:0/4221913960 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00640c8420 con 0x7f00640c9ff0 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.568+0000 7f0062ffd640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00640c9ff0 0x7f00640c9710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f005800c460 tx=0x7f005800c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.568+0000 7f004bfff640 1 -- 172.21.15.145:0/4221913960 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058016020 con 0x7f00640c9ff0 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.568+0000 7f004bfff640 1 -- 172.21.15.145:0/4221913960 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00580052f0 con 0x7f00640c9ff0 2024-04-22T06:31:13.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.568+0000 7f004bfff640 1 -- 172.21.15.145:0/4221913960 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058007260 con 0x7f00640c9ff0 2024-04-22T06:31:13.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.568+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006413e710 con 0x7f00640c9ff0 2024-04-22T06:31:13.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.568+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00640c86c0 con 0x7f00640c9ff0 2024-04-22T06:31:13.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.568+0000 7f004bfff640 1 -- 172.21.15.145:0/4221913960 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f00580067d0 con 0x7f00640c9ff0 2024-04-22T06:31:13.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.568+0000 7f004bfff640 1 -- 172.21.15.145:0/4221913960 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f0058012cf0 con 0x7f00640c9ff0 2024-04-22T06:31:13.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.569+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f006413e8e0 con 0x7f00640c9ff0 2024-04-22T06:31:13.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.571+0000 7f004bfff640 1 -- 172.21.15.145:0/4221913960 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0058020020 con 0x7f00640c9ff0 2024-04-22T06:31:13.590 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:13.592+0000 7f8e71611040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-22T06:31:13.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.643+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d", "id": 0} v 0) -- 0x7f0064068f50 con 0x7f00640c9ff0 2024-04-22T06:31:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.646+0000 7f004bfff640 1 -- 172.21.15.145:0/4221913960 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0058006cf0 con 0x7f00640c9ff0 2024-04-22T06:31:13.646 INFO:teuthology.orchestra.run.smithi145.stdout:0 2024-04-22T06:31:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00640c9ff0 msgr2=0x7f00640c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00640c9ff0 0x7f00640c9710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f005800c460 tx=0x7f005800c920 comp rx=0 tx=0).stop 2024-04-22T06:31:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 shutdown_connections 2024-04-22T06:31:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0064144600 0x7f006413ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0064144220 0x7f006415d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 --2- 172.21.15.145:0/4221913960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00640c9ff0 0x7f00640c9710 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 >> 172.21.15.145:0/4221913960 conn(0x7f006406b920 msgr2=0x7f006415a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 shutdown_connections 2024-04-22T06:31:13.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.647+0000 7f0069a11640 1 -- 172.21.15.145:0/4221913960 wait complete. 2024-04-22T06:31:13.657 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 8707a934-6ab7-40cf-973d-622d2ff5a1bb 1 2024-04-22T06:31:13.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.756+0000 7ffa821f4640 1 Processor -- start 2024-04-22T06:31:13.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.756+0000 7ffa821f4640 1 -- start start 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.757+0000 7ffa821f4640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ffa7c151fc0 0x7ffa7c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.757+0000 7ffa821f4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7c15b420 con 0x7ffa7c0ca470 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.757+0000 7ffa821f4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7c15b700 con 0x7ffa7c159d00 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.757+0000 7ffa821f4640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7ffa7c15b9e0 con 0x7ffa7c151fc0 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.757+0000 7ffa7b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ffa7c151fc0 0x7ffa7c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.757+0000 7ffa7bfff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7ffa7c159d00 0x7ffa7c0c8660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:48474/0 (socket says 172.21.15.145:48474) 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.757+0000 7ffa7bfff640 1 -- 172.21.15.145:0/4229639620 learned_addr learned my addr 172.21.15.145:0/4229639620 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.758+0000 7ffa7b7fe640 1 -- 172.21.15.145:0/4229639620 >> v1:172.21.15.145:6789/0 conn(0x7ffa7c159d00 legacy=0x7ffa7c0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.758+0000 7ffa7b7fe640 1 -- 172.21.15.145:0/4229639620 >> v1:172.21.15.113:6789/0 conn(0x7ffa7c0ca470 legacy=0x7ffa7c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.758+0000 7ffa7b7fe640 1 -- 172.21.15.145:0/4229639620 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c15bcc0 con 0x7ffa7c151fc0 2024-04-22T06:31:13.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.758+0000 7ffa7a7fc640 1 -- 172.21.15.145:0/4229639620 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541336311 0 0) 0x7ffa7c15b700 con 0x7ffa7c159d00 2024-04-22T06:31:13.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.758+0000 7ffa7b7fe640 1 --2- 172.21.15.145:0/4229639620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c151fc0 0x7ffa7c0c9f30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097a0 tx=0x7ffa7002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b24d8c45393e5db server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa7a7fc640 1 -- 172.21.15.145:0/4229639620 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7002f810 con 0x7ffa7c151fc0 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa7a7fc640 1 -- 172.21.15.145:0/4229639620 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7002f9b0 con 0x7ffa7c151fc0 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa7a7fc640 1 -- 172.21.15.145:0/4229639620 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7002fd80 con 0x7ffa7c151fc0 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa821f4640 1 -- 172.21.15.145:0/4229639620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c151fc0 msgr2=0x7ffa7c0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa821f4640 1 --2- 172.21.15.145:0/4229639620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c151fc0 0x7ffa7c0c9f30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097a0 tx=0x7ffa7002b9f0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa821f4640 1 -- 172.21.15.145:0/4229639620 shutdown_connections 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa821f4640 1 --2- 172.21.15.145:0/4229639620 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c151fc0 0x7ffa7c0c9f30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa821f4640 1 -- 172.21.15.145:0/4229639620 >> 172.21.15.145:0/4229639620 conn(0x7ffa7c06b920 msgr2=0x7ffa7c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa821f4640 1 -- 172.21.15.145:0/4229639620 shutdown_connections 2024-04-22T06:31:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.759+0000 7ffa821f4640 1 -- 172.21.15.145:0/4229639620 wait complete. 2024-04-22T06:31:13.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.760+0000 7ffa821f4640 1 Processor -- start 2024-04-22T06:31:13.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.760+0000 7ffa821f4640 1 -- start start 2024-04-22T06:31:13.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa821f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c0ca470 0x7ffa7c0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa821f4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa7c151fc0 0x7ffa7c153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa821f4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa7c159d00 0x7ffa7c1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa821f4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c1523a0 con 0x7ffa7c159d00 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa821f4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c158b80 con 0x7ffa7c0ca470 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa821f4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7c1e16f0 con 0x7ffa7c151fc0 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa7b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c0ca470 0x7ffa7c0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa7affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa7c151fc0 0x7ffa7c153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa7b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c0ca470 0x7ffa7c0ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44710/0 (socket says 172.21.15.145:44710) 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa7b7fe640 1 -- 172.21.15.145:0/3901025642 learned_addr learned my addr 172.21.15.145:0/3901025642 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.761+0000 7ffa7bfff640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa7c159d00 0x7ffa7c1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa7b7fe640 1 -- 172.21.15.145:0/3901025642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa7c151fc0 msgr2=0x7ffa7c153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa7b7fe640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa7c151fc0 0x7ffa7c153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa7b7fe640 1 -- 172.21.15.145:0/3901025642 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa7c159d00 msgr2=0x7ffa7c1540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa7b7fe640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa7c159d00 0x7ffa7c1540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa7b7fe640 1 -- 172.21.15.145:0/3901025642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c1e5010 con 0x7ffa7c0ca470 2024-04-22T06:31:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa7affd640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa7c151fc0 0x7ffa7c153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:13.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa7b7fe640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c0ca470 0x7ffa7c0ccae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa700098c0 tx=0x7ffa70004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:13.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa63fff640 1 -- 172.21.15.145:0/3901025642 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70047070 con 0x7ffa7c0ca470 2024-04-22T06:31:13.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa63fff640 1 -- 172.21.15.145:0/3901025642 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa70037c60 con 0x7ffa7c0ca470 2024-04-22T06:31:13.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa63fff640 1 -- 172.21.15.145:0/3901025642 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7002fe60 con 0x7ffa7c0ca470 2024-04-22T06:31:13.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7c154f90 con 0x7ffa7c0ca470 2024-04-22T06:31:13.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7c1e1380 con 0x7ffa7c0ca470 2024-04-22T06:31:13.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa63fff640 1 -- 172.21.15.145:0/3901025642 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa7004a070 con 0x7ffa7c0ca470 2024-04-22T06:31:13.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.762+0000 7ffa63fff640 1 -- 172.21.15.145:0/3901025642 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ffa7004c7f0 con 0x7ffa7c0ca470 2024-04-22T06:31:13.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.763+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7c068f50 con 0x7ffa7c0ca470 2024-04-22T06:31:13.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.765+0000 7ffa63fff640 1 -- 172.21.15.145:0/3901025642 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffa70033030 con 0x7ffa7c0ca470 2024-04-22T06:31:13.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.837+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8707a934-6ab7-40cf-973d-622d2ff5a1bb", "id": 1} v 0) -- 0x7ffa7c1517e0 con 0x7ffa7c0ca470 2024-04-22T06:31:13.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.840+0000 7ffa63fff640 1 -- 172.21.15.145:0/3901025642 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8707a934-6ab7-40cf-973d-622d2ff5a1bb", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ffa7002f8e0 con 0x7ffa7c0ca470 2024-04-22T06:31:13.839 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-04-22T06:31:13.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.841+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c0ca470 msgr2=0x7ffa7c0ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.841+0000 7ffa821f4640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c0ca470 0x7ffa7c0ccae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa700098c0 tx=0x7ffa70004730 comp rx=0 tx=0).stop 2024-04-22T06:31:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.841+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 shutdown_connections 2024-04-22T06:31:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.841+0000 7ffa821f4640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa7c159d00 0x7ffa7c1540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.841+0000 7ffa821f4640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa7c151fc0 0x7ffa7c153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.841+0000 7ffa821f4640 1 --2- 172.21.15.145:0/3901025642 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa7c0ca470 0x7ffa7c0ccae0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.841+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 >> 172.21.15.145:0/3901025642 conn(0x7ffa7c06b920 msgr2=0x7ffa7c070440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.842+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 shutdown_connections 2024-04-22T06:31:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.842+0000 7ffa821f4640 1 -- 172.21.15.145:0/3901025642 wait complete. 2024-04-22T06:31:13.851 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new e5330893-6259-4582-a7cf-d1a53f31dc35 2 2024-04-22T06:31:13.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.949+0000 7f43439db640 1 Processor -- start 2024-04-22T06:31:13.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.949+0000 7f43439db640 1 -- start start 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.950+0000 7f43439db640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.950+0000 7f43439db640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f433c073920 0x7f433c152d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.950+0000 7f43439db640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f433c0c8690 con 0x7f433c0c9810 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.950+0000 7f43439db640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f433c0c8930 con 0x7f433c073920 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.950+0000 7f43439db640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f433c0c5d60 con 0x7f433c0c9430 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.950+0000 7f4341777640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.950+0000 7f4341777640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c0c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:51172/0 (socket says 172.21.15.145:51172) 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.950+0000 7f4341777640 1 -- 172.21.15.145:0/104185057 learned_addr learned my addr 172.21.15.145:0/104185057 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.951+0000 7f4341f78640 1 --2- 172.21.15.145:0/104185057 >> v2:172.21.15.113:3300/0 conn(0x7f433c073920 0x7f433c152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.951+0000 7f4341777640 1 -- 172.21.15.145:0/104185057 >> v2:172.21.15.113:3300/0 conn(0x7f433c073920 msgr2=0x7f433c152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:13.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.951+0000 7f4341777640 1 --2- 172.21.15.145:0/104185057 >> v2:172.21.15.113:3300/0 conn(0x7f433c073920 0x7f433c152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.951+0000 7f4341777640 1 -- 172.21.15.145:0/104185057 >> v1:172.21.15.113:6789/0 conn(0x7f433c0c9810 legacy=0x7f433c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:13.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.951+0000 7f4341777640 1 -- 172.21.15.145:0/104185057 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433c0c6000 con 0x7f433c0c9430 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.951+0000 7f4341777640 1 --2- 172.21.15.145:0/104185057 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c0c7fc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f433c15a040 tx=0x7f432c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d210c4a04d7a5fdc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.951+0000 7f4333fff640 1 -- 172.21.15.145:0/104185057 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c035020 con 0x7f433c0c9430 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.951+0000 7f4333fff640 1 -- 172.21.15.145:0/104185057 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432c031830 con 0x7f433c0c9430 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f4333fff640 1 -- 172.21.15.145:0/104185057 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c031c00 con 0x7f433c0c9430 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f43439db640 1 -- 172.21.15.145:0/104185057 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 msgr2=0x7f433c0c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f43439db640 1 --2- 172.21.15.145:0/104185057 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c0c7fc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f433c15a040 tx=0x7f432c02b8d0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f43439db640 1 -- 172.21.15.145:0/104185057 shutdown_connections 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f43439db640 1 --2- 172.21.15.145:0/104185057 >> v2:172.21.15.113:3300/0 conn(0x7f433c073920 0x7f433c152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f43439db640 1 --2- 172.21.15.145:0/104185057 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c0c7fc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f43439db640 1 -- 172.21.15.145:0/104185057 >> 172.21.15.145:0/104185057 conn(0x7f433c06f840 msgr2=0x7f433c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f43439db640 1 -- 172.21.15.145:0/104185057 shutdown_connections 2024-04-22T06:31:13.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.952+0000 7f43439db640 1 -- 172.21.15.145:0/104185057 wait complete. 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.953+0000 7f43439db640 1 Processor -- start 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f43439db640 1 -- start start 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f43439db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f433c073920 0x7f433c1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f43439db640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c1473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f43439db640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f433c0c9810 0x7f433c1e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f43439db640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f433c0c6800 con 0x7f433c073920 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f43439db640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f433c073d50 con 0x7f433c0c9810 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f43439db640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f433c144160 con 0x7f433c0c9430 2024-04-22T06:31:13.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f4340f76640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c1473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f4341777640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f433c073920 0x7f433c1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f4341f78640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f433c0c9810 0x7f433c1e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f4340f76640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c1473a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:51180/0 (socket says 172.21.15.145:51180) 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.954+0000 7f4340f76640 1 -- 172.21.15.145:0/1438485507 learned_addr learned my addr 172.21.15.145:0/1438485507 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4340f76640 1 -- 172.21.15.145:0/1438485507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f433c0c9810 msgr2=0x7f433c1e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4340f76640 1 --2- 172.21.15.145:0/1438485507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f433c0c9810 0x7f433c1e48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4340f76640 1 -- 172.21.15.145:0/1438485507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f433c073920 msgr2=0x7f433c1439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4340f76640 1 --2- 172.21.15.145:0/1438485507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f433c073920 0x7f433c1439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4340f76640 1 -- 172.21.15.145:0/1438485507 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433c1e43e0 con 0x7f433c0c9430 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4341f78640 1 --2- 172.21.15.145:0/1438485507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f433c0c9810 0x7f433c1e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4340f76640 1 --2- 172.21.15.145:0/1438485507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c1473a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f433800b3f0 tx=0x7f433800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4331ffb640 1 -- 172.21.15.145:0/1438485507 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338015020 con 0x7f433c0c9430 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4331ffb640 1 -- 172.21.15.145:0/1438485507 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4338011830 con 0x7f433c0c9430 2024-04-22T06:31:13.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4331ffb640 1 -- 172.21.15.145:0/1438485507 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338011c20 con 0x7f433c0c9430 2024-04-22T06:31:13.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f433c1e23b0 con 0x7f433c0c9430 2024-04-22T06:31:13.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4331ffb640 1 -- 172.21.15.145:0/1438485507 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4338018020 con 0x7f433c0c9430 2024-04-22T06:31:13.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f433c1410a0 con 0x7f433c0c9430 2024-04-22T06:31:13.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.955+0000 7f4331ffb640 1 -- 172.21.15.145:0/1438485507 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f433801ade0 con 0x7f433c0c9430 2024-04-22T06:31:13.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.956+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f433c068f50 con 0x7f433c0c9430 2024-04-22T06:31:13.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:13.959+0000 7f4331ffb640 1 -- 172.21.15.145:0/1438485507 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f433801f020 con 0x7f433c0c9430 2024-04-22T06:31:14.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.040+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e5330893-6259-4582-a7cf-d1a53f31dc35", "id": 2} v 0) -- 0x7f433c0c7a80 con 0x7f433c0c9430 2024-04-22T06:31:14.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.046+0000 7f4331ffb640 1 -- 172.21.15.145:0/1438485507 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5330893-6259-4582-a7cf-d1a53f31dc35", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f4338011dc0 con 0x7f433c0c9430 2024-04-22T06:31:14.045 INFO:teuthology.orchestra.run.smithi145.stdout:2 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 msgr2=0x7f433c1473a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 --2- 172.21.15.145:0/1438485507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c1473a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f433800b3f0 tx=0x7f433800b8b0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 shutdown_connections 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 --2- 172.21.15.145:0/1438485507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f433c0c9810 0x7f433c1e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 --2- 172.21.15.145:0/1438485507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f433c0c9430 0x7f433c1473a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 --2- 172.21.15.145:0/1438485507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f433c073920 0x7f433c1439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 >> 172.21.15.145:0/1438485507 conn(0x7f433c06f840 msgr2=0x7f433c070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 shutdown_connections 2024-04-22T06:31:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.047+0000 7f43439db640 1 -- 172.21.15.145:0/1438485507 wait complete. 2024-04-22T06:31:14.056 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new e45d909c-200e-4bd0-9b5a-7ffc9956d48b 3 2024-04-22T06:31:14.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.155+0000 7f603faf2640 1 Processor -- start 2024-04-22T06:31:14.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.155+0000 7f603faf2640 1 -- start start 2024-04-22T06:31:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603faf2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6038151e90 0x7f60380cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603faf2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f60380c9ff0 0x7f60380ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603faf2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60381580a0 con 0x7f603815b880 2024-04-22T06:31:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603faf2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f60380cc180 con 0x7f60380c9ff0 2024-04-22T06:31:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603faf2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f603815b3f0 con 0x7f6038151e90 2024-04-22T06:31:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603d88e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6038151e90 0x7f60380cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603d88e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6038151e90 0x7f60380cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:51188/0 (socket says 172.21.15.145:51188) 2024-04-22T06:31:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603d88e640 1 -- 172.21.15.145:0/20793217 learned_addr learned my addr 172.21.15.145:0/20793217 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603d08d640 1 --2- 172.21.15.145:0/20793217 >> v2:172.21.15.113:3300/0 conn(0x7f60380c9ff0 0x7f60380ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603d88e640 1 -- 172.21.15.145:0/20793217 >> v2:172.21.15.113:3300/0 conn(0x7f60380c9ff0 msgr2=0x7f60380ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603d88e640 1 --2- 172.21.15.145:0/20793217 >> v2:172.21.15.113:3300/0 conn(0x7f60380c9ff0 0x7f60380ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603d88e640 1 -- 172.21.15.145:0/20793217 >> v1:172.21.15.113:6789/0 conn(0x7f603815b880 legacy=0x7f603815bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.156+0000 7f603d88e640 1 -- 172.21.15.145:0/20793217 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6038158380 con 0x7f6038151e90 2024-04-22T06:31:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.157+0000 7f603d88e640 1 --2- 172.21.15.145:0/20793217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6038151e90 0x7f60380cbc40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6034009870 tx=0x7f603402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce29d64400c01f9e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.157+0000 7f603c88c640 1 -- 172.21.15.145:0/20793217 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603402f840 con 0x7f6038151e90 2024-04-22T06:31:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.157+0000 7f603c88c640 1 -- 172.21.15.145:0/20793217 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603402f9e0 con 0x7f6038151e90 2024-04-22T06:31:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.157+0000 7f603c88c640 1 -- 172.21.15.145:0/20793217 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603402fdb0 con 0x7f6038151e90 2024-04-22T06:31:14.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.158+0000 7f603faf2640 1 -- 172.21.15.145:0/20793217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6038151e90 msgr2=0x7f60380cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.158+0000 7f603faf2640 1 --2- 172.21.15.145:0/20793217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6038151e90 0x7f60380cbc40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6034009870 tx=0x7f603402ba20 comp rx=0 tx=0).stop 2024-04-22T06:31:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.158+0000 7f603faf2640 1 -- 172.21.15.145:0/20793217 shutdown_connections 2024-04-22T06:31:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.158+0000 7f603faf2640 1 --2- 172.21.15.145:0/20793217 >> v2:172.21.15.113:3300/0 conn(0x7f60380c9ff0 0x7f60380ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.158+0000 7f603faf2640 1 --2- 172.21.15.145:0/20793217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6038151e90 0x7f60380cbc40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.158+0000 7f603faf2640 1 -- 172.21.15.145:0/20793217 >> 172.21.15.145:0/20793217 conn(0x7f603806b920 msgr2=0x7f603806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.158+0000 7f603faf2640 1 -- 172.21.15.145:0/20793217 shutdown_connections 2024-04-22T06:31:14.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.158+0000 7f603faf2640 1 -- 172.21.15.145:0/20793217 wait complete. 2024-04-22T06:31:14.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.159+0000 7f603faf2640 1 Processor -- start 2024-04-22T06:31:14.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.159+0000 7f603faf2640 1 -- start start 2024-04-22T06:31:14.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603faf2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60380c9ff0 0x7f60381f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603faf2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038151e90 0x7f60381576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603faf2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f603815b880 0x7f6038145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603faf2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6038158940 con 0x7f60380c9ff0 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603faf2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6038152270 con 0x7f6038151e90 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603faf2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6038158c20 con 0x7f603815b880 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038151e90 0x7f60381576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603e08f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f603815b880 0x7f6038145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038151e90 0x7f60381576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44722/0 (socket says 172.21.15.145:44722) 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 -- 172.21.15.145:0/3114558634 learned_addr learned my addr 172.21.15.145:0/3114558634 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d88e640 1 --2- 172.21.15.145:0/3114558634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60380c9ff0 0x7f60381f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 -- 172.21.15.145:0/3114558634 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f603815b880 msgr2=0x7f6038145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 --2- 172.21.15.145:0/3114558634 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f603815b880 0x7f6038145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 -- 172.21.15.145:0/3114558634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60380c9ff0 msgr2=0x7f60381f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 --2- 172.21.15.145:0/3114558634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60380c9ff0 0x7f60381f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 -- 172.21.15.145:0/3114558634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603814fab0 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603d08d640 1 --2- 172.21.15.145:0/3114558634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038151e90 0x7f60381576c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f602800e9b0 tx=0x7f602800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f602e7fc640 1 -- 172.21.15.145:0/3114558634 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028017070 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f602e7fc640 1 -- 172.21.15.145:0/3114558634 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602800c9a0 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f602e7fc640 1 -- 172.21.15.145:0/3114558634 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602800cd90 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6038150760 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.160+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6038150ce0 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.161+0000 7f602e7fc640 1 -- 172.21.15.145:0/3114558634 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f602801a070 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.161+0000 7f602e7fc640 1 -- 172.21.15.145:0/3114558634 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f60280066f0 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.161+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6038068f50 con 0x7f6038151e90 2024-04-22T06:31:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.163+0000 7f602e7fc640 1 -- 172.21.15.145:0/3114558634 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f603814fab0 con 0x7f6038151e90 2024-04-22T06:31:14.227 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:14.228+0000 7efe3ebbb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-22T06:31:14.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.235+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e45d909c-200e-4bd0-9b5a-7ffc9956d48b", "id": 3} v 0) -- 0x7f60380cc760 con 0x7f6038151e90 2024-04-22T06:31:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.240+0000 7f602e7fc640 1 -- 172.21.15.145:0/3114558634 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e45d909c-200e-4bd0-9b5a-7ffc9956d48b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f60280060f0 con 0x7f6038151e90 2024-04-22T06:31:14.239 INFO:teuthology.orchestra.run.smithi145.stdout:3 2024-04-22T06:31:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038151e90 msgr2=0x7f60381576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 --2- 172.21.15.145:0/3114558634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038151e90 0x7f60381576c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f602800e9b0 tx=0x7f602800ee70 comp rx=0 tx=0).stop 2024-04-22T06:31:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 shutdown_connections 2024-04-22T06:31:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 --2- 172.21.15.145:0/3114558634 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f603815b880 0x7f6038145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 --2- 172.21.15.145:0/3114558634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6038151e90 0x7f60381576c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 --2- 172.21.15.145:0/3114558634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f60380c9ff0 0x7f60381f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 >> 172.21.15.145:0/3114558634 conn(0x7f603806b920 msgr2=0x7f6038155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 shutdown_connections 2024-04-22T06:31:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.241+0000 7f603faf2640 1 -- 172.21.15.145:0/3114558634 wait complete. 2024-04-22T06:31:14.250 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 82a62abb-7b4e-4250-a570-a57f891c8eab 4 2024-04-22T06:31:14.314 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:14.314+0000 7efe3ebbb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-22T06:31:14.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.348+0000 7f2c97784640 1 Processor -- start 2024-04-22T06:31:14.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.348+0000 7f2c97784640 1 -- start start 2024-04-22T06:31:14.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c97784640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2c90144220 0x7f2c9015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c97784640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c900c9ff0 0x7f2c900ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c97784640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9015e780 con 0x7f2c90144600 2024-04-22T06:31:14.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c97784640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9015f570 con 0x7f2c90144220 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c97784640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9015e9f0 con 0x7f2c900c9ff0 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c95520640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2c90144220 0x7f2c9015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c94d1f640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f2c90144600 0x7f2c900cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:48482/0 (socket says 172.21.15.145:48482) 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c94d1f640 1 -- 172.21.15.145:0/650523229 learned_addr learned my addr 172.21.15.145:0/650523229 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c95d21640 1 --2- 172.21.15.145:0/650523229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c900c9ff0 0x7f2c900ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c95d21640 1 -- 172.21.15.145:0/650523229 >> v2:172.21.15.145:3300/0 conn(0x7f2c90144220 msgr2=0x7f2c9015bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c95d21640 1 --2- 172.21.15.145:0/650523229 >> v2:172.21.15.145:3300/0 conn(0x7f2c90144220 0x7f2c9015bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c95d21640 1 -- 172.21.15.145:0/650523229 >> v1:172.21.15.145:6789/0 conn(0x7f2c90144600 legacy=0x7f2c900cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c95d21640 1 -- 172.21.15.145:0/650523229 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9015ecd0 con 0x7f2c900c9ff0 2024-04-22T06:31:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.349+0000 7f2c95520640 1 --2- 172.21.15.145:0/650523229 >> v2:172.21.15.145:3300/0 conn(0x7f2c90144220 0x7f2c9015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.350+0000 7f2c95d21640 1 --2- 172.21.15.145:0/650523229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c900c9ff0 0x7f2c900ca4a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009dc0 tx=0x7f2c8802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a12af0058f7ec0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.350+0000 7f2c87fff640 1 -- 172.21.15.145:0/650523229 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88039070 con 0x7f2c900c9ff0 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.350+0000 7f2c87fff640 1 -- 172.21.15.145:0/650523229 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8802ccd0 con 0x7f2c900c9ff0 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.350+0000 7f2c87fff640 1 -- 172.21.15.145:0/650523229 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88034660 con 0x7f2c900c9ff0 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.351+0000 7f2c97784640 1 -- 172.21.15.145:0/650523229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c900c9ff0 msgr2=0x7f2c900ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.351+0000 7f2c97784640 1 --2- 172.21.15.145:0/650523229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c900c9ff0 0x7f2c900ca4a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009dc0 tx=0x7f2c8802bf20 comp rx=0 tx=0).stop 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.351+0000 7f2c97784640 1 -- 172.21.15.145:0/650523229 shutdown_connections 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.351+0000 7f2c97784640 1 --2- 172.21.15.145:0/650523229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c900c9ff0 0x7f2c900ca4a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.351+0000 7f2c97784640 1 --2- 172.21.15.145:0/650523229 >> v2:172.21.15.145:3300/0 conn(0x7f2c90144220 0x7f2c9015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.351+0000 7f2c97784640 1 -- 172.21.15.145:0/650523229 >> 172.21.15.145:0/650523229 conn(0x7f2c9006b920 msgr2=0x7f2c9006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.351+0000 7f2c97784640 1 -- 172.21.15.145:0/650523229 shutdown_connections 2024-04-22T06:31:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.351+0000 7f2c97784640 1 -- 172.21.15.145:0/650523229 wait complete. 2024-04-22T06:31:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.352+0000 7f2c97784640 1 Processor -- start 2024-04-22T06:31:14.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.352+0000 7f2c97784640 1 -- start start 2024-04-22T06:31:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c97784640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c900c9ff0 0x7f2c90157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c97784640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90144220 0x7f2c901f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c97784640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90144600 0x7f2c901f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c97784640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2c900cba90 con 0x7f2c900c9ff0 2024-04-22T06:31:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c97784640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9015f290 con 0x7f2c90144600 2024-04-22T06:31:14.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c97784640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c900cc730 con 0x7f2c90144220 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c94d1f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90144220 0x7f2c901f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90144600 0x7f2c901f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90144600 0x7f2c901f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44736/0 (socket says 172.21.15.145:44736) 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c94d1f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90144220 0x7f2c901f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:51206/0 (socket says 172.21.15.145:51206) 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 -- 172.21.15.145:0/3291421870 learned_addr learned my addr 172.21.15.145:0/3291421870 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95520640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c900c9ff0 0x7f2c90157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 -- 172.21.15.145:0/3291421870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90144220 msgr2=0x7f2c901f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90144220 0x7f2c901f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 -- 172.21.15.145:0/3291421870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c900c9ff0 msgr2=0x7f2c90157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c900c9ff0 0x7f2c90157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 -- 172.21.15.145:0/3291421870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c901f2570 con 0x7f2c90144600 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c94d1f640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90144220 0x7f2c901f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:14.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.353+0000 7f2c95d21640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90144600 0x7f2c901f43a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009dc0 tx=0x7f2c88004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.354+0000 7f2c85ffb640 1 -- 172.21.15.145:0/3291421870 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88039050 con 0x7f2c90144600 2024-04-22T06:31:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.354+0000 7f2c85ffb640 1 -- 172.21.15.145:0/3291421870 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c88045070 con 0x7f2c90144600 2024-04-22T06:31:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.354+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c900732f0 con 0x7f2c90144600 2024-04-22T06:31:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.354+0000 7f2c85ffb640 1 -- 172.21.15.145:0/3291421870 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88009450 con 0x7f2c90144600 2024-04-22T06:31:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.354+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c90157210 con 0x7f2c90144600 2024-04-22T06:31:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.354+0000 7f2c85ffb640 1 -- 172.21.15.145:0/3291421870 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c88003990 con 0x7f2c90144600 2024-04-22T06:31:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.354+0000 7f2c85ffb640 1 -- 172.21.15.145:0/3291421870 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2c88004530 con 0x7f2c90144600 2024-04-22T06:31:14.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.355+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c90068f50 con 0x7f2c90144600 2024-04-22T06:31:14.356 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:14.356+0000 7efe3ebbb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-22T06:31:14.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.357+0000 7f2c85ffb640 1 -- 172.21.15.145:0/3291421870 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2c8804e020 con 0x7f2c90144600 2024-04-22T06:31:14.375 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:14.376+0000 7f8e71611040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-22T06:31:14.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.430+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82a62abb-7b4e-4250-a570-a57f891c8eab", "id": 4} v 0) -- 0x7f2c900ce3f0 con 0x7f2c90144600 2024-04-22T06:31:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.435+0000 7f2c85ffb640 1 -- 172.21.15.145:0/3291421870 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82a62abb-7b4e-4250-a570-a57f891c8eab", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f2c88004810 con 0x7f2c90144600 2024-04-22T06:31:14.434 INFO:teuthology.orchestra.run.smithi145.stdout:4 2024-04-22T06:31:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90144600 msgr2=0x7f2c901f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90144600 0x7f2c901f43a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009dc0 tx=0x7f2c88004a40 comp rx=0 tx=0).stop 2024-04-22T06:31:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 shutdown_connections 2024-04-22T06:31:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c90144600 0x7f2c901f43a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c90144220 0x7f2c901f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 --2- 172.21.15.145:0/3291421870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c900c9ff0 0x7f2c90157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 >> 172.21.15.145:0/3291421870 conn(0x7f2c9006b920 msgr2=0x7f2c90073ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 shutdown_connections 2024-04-22T06:31:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.436+0000 7f2c97784640 1 -- 172.21.15.145:0/3291421870 wait complete. 2024-04-22T06:31:14.445 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 0f5a7cbb-2f26-405d-b09a-275fc05a262c 5 2024-04-22T06:31:14.467 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:14.468+0000 7f8e71611040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-22T06:31:14.513 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:14.513+0000 7f8e71611040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-22T06:31:14.519 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:14.519+0000 7efe3ebbb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-22T06:31:14.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.543+0000 7f87a21b2640 1 Processor -- start 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f87a21b2640 1 -- start start 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f87a21b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f879c144510 0x7f879c075230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f87a21b2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f879c0c8140 0x7f879c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f87a21b2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c072c80 0x7f879c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f87a21b2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f879c0c8c00 con 0x7f879c144510 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f87a21b2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f879c1448f0 con 0x7f879c0c8140 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f87a21b2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f879c15be80 con 0x7f879c072c80 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f879affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f879c0c8140 0x7f879c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f879affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f879c0c8140 0x7f879c0cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44746/0 (socket says 172.21.15.145:44746) 2024-04-22T06:31:14.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f879affd640 1 -- 172.21.15.145:0/1961987212 learned_addr learned my addr 172.21.15.145:0/1961987212 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.544+0000 7f879bfff640 1 --2- 172.21.15.145:0/1961987212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c072c80 0x7f879c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.545+0000 7f879b7fe640 1 --2- 172.21.15.145:0/1961987212 >> v2:172.21.15.113:3300/0 conn(0x7f879c144510 0x7f879c075230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.545+0000 7f879affd640 1 -- 172.21.15.145:0/1961987212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c072c80 msgr2=0x7f879c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.545+0000 7f879affd640 1 --2- 172.21.15.145:0/1961987212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c072c80 0x7f879c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.545+0000 7f879affd640 1 -- 172.21.15.145:0/1961987212 >> v2:172.21.15.113:3300/0 conn(0x7f879c144510 msgr2=0x7f879c075230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.545+0000 7f879affd640 1 --2- 172.21.15.145:0/1961987212 >> v2:172.21.15.113:3300/0 conn(0x7f879c144510 0x7f879c075230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.545+0000 7f879affd640 1 -- 172.21.15.145:0/1961987212 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c075770 con 0x7f879c0c8140 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.545+0000 7f879affd640 1 --2- 172.21.15.145:0/1961987212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c0c8140 0x7f879c0cd690 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f879c06eed0 tx=0x7f879002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2db17ce9883a4a2a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f879a7fc640 1 -- 172.21.15.145:0/1961987212 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790035020 con 0x7f879c0c8140 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f879a7fc640 1 -- 172.21.15.145:0/1961987212 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8790031870 con 0x7f879c0c8140 2024-04-22T06:31:14.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f879a7fc640 1 -- 172.21.15.145:0/1961987212 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790031c40 con 0x7f879c0c8140 2024-04-22T06:31:14.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 -- 172.21.15.145:0/1961987212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c0c8140 msgr2=0x7f879c0cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 --2- 172.21.15.145:0/1961987212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c0c8140 0x7f879c0cd690 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f879c06eed0 tx=0x7f879002b910 comp rx=0 tx=0).stop 2024-04-22T06:31:14.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 -- 172.21.15.145:0/1961987212 shutdown_connections 2024-04-22T06:31:14.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 --2- 172.21.15.145:0/1961987212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c072c80 0x7f879c0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 --2- 172.21.15.145:0/1961987212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c0c8140 0x7f879c0cd690 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 --2- 172.21.15.145:0/1961987212 >> v2:172.21.15.113:3300/0 conn(0x7f879c144510 0x7f879c075230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 -- 172.21.15.145:0/1961987212 >> 172.21.15.145:0/1961987212 conn(0x7f879c06e8b0 msgr2=0x7f879c06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 -- 172.21.15.145:0/1961987212 shutdown_connections 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.546+0000 7f87a21b2640 1 -- 172.21.15.145:0/1961987212 wait complete. 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.547+0000 7f87a21b2640 1 Processor -- start 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f87a21b2640 1 -- start start 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f87a21b2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c072c80 0x7f879c070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f87a21b2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c0c8140 0x7f879c140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f87a21b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f879c144510 0x7f879c141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f87a21b2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f879c15b830 con 0x7f879c144510 2024-04-22T06:31:14.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f87a21b2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f879c15b550 con 0x7f879c072c80 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f87a21b2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f879c15bb10 con 0x7f879c0c8140 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f879b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c072c80 0x7f879c070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f879b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c072c80 0x7f879c070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44752/0 (socket says 172.21.15.145:44752) 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f879b7fe640 1 -- 172.21.15.145:0/3108636363 learned_addr learned my addr 172.21.15.145:0/3108636363 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f879affd640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c0c8140 0x7f879c140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.548+0000 7f879bfff640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f879c144510 0x7f879c141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f879b7fe640 1 -- 172.21.15.145:0/3108636363 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c0c8140 msgr2=0x7f879c140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f879b7fe640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c0c8140 0x7f879c140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f879b7fe640 1 -- 172.21.15.145:0/3108636363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f879c144510 msgr2=0x7f879c141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f879b7fe640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f879c144510 0x7f879c141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f879b7fe640 1 -- 172.21.15.145:0/3108636363 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c1439e0 con 0x7f879c072c80 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f879b7fe640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c072c80 0x7f879c070070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f878c00e870 tx=0x7f878c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f8783fff640 1 -- 172.21.15.145:0/3108636363 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c017070 con 0x7f879c072c80 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f8783fff640 1 -- 172.21.15.145:0/3108636363 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c00c940 con 0x7f879c072c80 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f8783fff640 1 -- 172.21.15.145:0/3108636363 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c00cd30 con 0x7f879c072c80 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c1583e0 con 0x7f879c072c80 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c1f43f0 con 0x7f879c072c80 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f8783fff640 1 -- 172.21.15.145:0/3108636363 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f878c01a070 con 0x7f879c072c80 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.549+0000 7f8783fff640 1 -- 172.21.15.145:0/3108636363 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f878c0064d0 con 0x7f879c072c80 2024-04-22T06:31:14.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.550+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879c068f50 con 0x7f879c072c80 2024-04-22T06:31:14.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.554+0000 7f8783fff640 1 -- 172.21.15.145:0/3108636363 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f878c006770 con 0x7f879c072c80 2024-04-22T06:31:14.571 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:14.572+0000 7efe3ebbb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-22T06:31:14.623 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:14.624+0000 7efe3ebbb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-22T06:31:14.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.626+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0f5a7cbb-2f26-405d-b09a-275fc05a262c", "id": 5} v 0) -- 0x7f879c142510 con 0x7f879c072c80 2024-04-22T06:31:14.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.632+0000 7f8783fff640 1 -- 172.21.15.145:0/3108636363 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f5a7cbb-2f26-405d-b09a-275fc05a262c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f878c005990 con 0x7f879c072c80 2024-04-22T06:31:14.631 INFO:teuthology.orchestra.run.smithi145.stdout:5 2024-04-22T06:31:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c072c80 msgr2=0x7f879c070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c072c80 0x7f879c070070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f878c00e870 tx=0x7f878c00ed30 comp rx=0 tx=0).stop 2024-04-22T06:31:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 shutdown_connections 2024-04-22T06:31:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f879c144510 0x7f879c141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f879c0c8140 0x7f879c140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 --2- 172.21.15.145:0/3108636363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f879c072c80 0x7f879c070070 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 >> 172.21.15.145:0/3108636363 conn(0x7f879c06e8b0 msgr2=0x7f879c0c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 shutdown_connections 2024-04-22T06:31:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.633+0000 7f87a21b2640 1 -- 172.21.15.145:0/3108636363 wait complete. 2024-04-22T06:31:14.642 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new c607e613-01ff-4908-a157-3f87c5bea33b 6 2024-04-22T06:31:14.689 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:14.691+0000 7f8e71611040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-22T06:31:14.733 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:14.734+0000 7efe3ebbb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-22T06:31:14.745 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:14.746+0000 7f8e71611040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-22T06:31:14.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.780+0000 7f2beb8eb640 1 Processor -- start 2024-04-22T06:31:14.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.780+0000 7f2beb8eb640 1 -- start start 2024-04-22T06:31:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2beb8eb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2be4144600 0x7f2be415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2beb8eb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2be40c9ff0 0x7f2be40ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2beb8eb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be415e780 con 0x7f2be4144220 2024-04-22T06:31:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2beb8eb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f2be415f570 con 0x7f2be40c9ff0 2024-04-22T06:31:14.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2beb8eb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f2be415e9f0 con 0x7f2be4144600 2024-04-22T06:31:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2be8e86640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2be4144600 0x7f2be415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2be8e86640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2be4144600 0x7f2be415bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44756/0 (socket says 172.21.15.145:44756) 2024-04-22T06:31:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2be8e86640 1 -- 172.21.15.145:0/1258293976 learned_addr learned my addr 172.21.15.145:0/1258293976 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2be9e88640 1 --2- 172.21.15.145:0/1258293976 >> v2:172.21.15.113:3300/0 conn(0x7f2be40c9ff0 0x7f2be40ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2be8e86640 1 -- 172.21.15.145:0/1258293976 >> v2:172.21.15.113:3300/0 conn(0x7f2be40c9ff0 msgr2=0x7f2be40ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2be8e86640 1 --2- 172.21.15.145:0/1258293976 >> v2:172.21.15.113:3300/0 conn(0x7f2be40c9ff0 0x7f2be40ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2be8e86640 1 -- 172.21.15.145:0/1258293976 >> v1:172.21.15.113:6789/0 conn(0x7f2be4144220 legacy=0x7f2be40cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.781+0000 7f2be8e86640 1 -- 172.21.15.145:0/1258293976 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be415ecd0 con 0x7f2be4144600 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.782+0000 7f2be8e86640 1 --2- 172.21.15.145:0/1258293976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be415bc00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40098a0 tx=0x7f2bd402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d776a271fd952fc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.782+0000 7f2bdbfff640 1 -- 172.21.15.145:0/1258293976 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4034070 con 0x7f2be4144600 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2bdbfff640 1 -- 172.21.15.145:0/1258293976 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd4030840 con 0x7f2be4144600 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2bdbfff640 1 -- 172.21.15.145:0/1258293976 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4030c10 con 0x7f2be4144600 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2beb8eb640 1 -- 172.21.15.145:0/1258293976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 msgr2=0x7f2be415bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2beb8eb640 1 --2- 172.21.15.145:0/1258293976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be415bc00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40098a0 tx=0x7f2bd402b980 comp rx=0 tx=0).stop 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2beb8eb640 1 -- 172.21.15.145:0/1258293976 shutdown_connections 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2beb8eb640 1 --2- 172.21.15.145:0/1258293976 >> v2:172.21.15.113:3300/0 conn(0x7f2be40c9ff0 0x7f2be40ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2beb8eb640 1 --2- 172.21.15.145:0/1258293976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be415bc00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2beb8eb640 1 -- 172.21.15.145:0/1258293976 >> 172.21.15.145:0/1258293976 conn(0x7f2be406b920 msgr2=0x7f2be406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2beb8eb640 1 -- 172.21.15.145:0/1258293976 shutdown_connections 2024-04-22T06:31:14.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.783+0000 7f2beb8eb640 1 -- 172.21.15.145:0/1258293976 wait complete. 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.784+0000 7f2beb8eb640 1 Processor -- start 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.784+0000 7f2beb8eb640 1 -- start start 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2beb8eb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2be40c9ff0 0x7f2be413ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2beb8eb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2be4144220 0x7f2be4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2beb8eb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be4158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2beb8eb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2be40cba90 con 0x7f2be40c9ff0 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2beb8eb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2be415f290 con 0x7f2be4144600 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2beb8eb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2be40cc730 con 0x7f2be4144220 2024-04-22T06:31:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9e88640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be4158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be8e86640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2be4144220 0x7f2be4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9e88640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be4158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44768/0 (socket says 172.21.15.145:44768) 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9e88640 1 -- 172.21.15.145:0/705835407 learned_addr learned my addr 172.21.15.145:0/705835407 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9687640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2be40c9ff0 0x7f2be413ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9e88640 1 -- 172.21.15.145:0/705835407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2be4144220 msgr2=0x7f2be4158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9e88640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2be4144220 0x7f2be4158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9e88640 1 -- 172.21.15.145:0/705835407 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2be40c9ff0 msgr2=0x7f2be413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9e88640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2be40c9ff0 0x7f2be413ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be9e88640 1 -- 172.21.15.145:0/705835407 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be41e7070 con 0x7f2be4144600 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.785+0000 7f2be8e86640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2be4144220 0x7f2be4158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.786+0000 7f2be9e88640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be4158740 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc007e70 tx=0x7f2bdc00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.786+0000 7f2bd9ffb640 1 -- 172.21.15.145:0/705835407 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc014620 con 0x7f2be4144600 2024-04-22T06:31:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.786+0000 7f2bd9ffb640 1 -- 172.21.15.145:0/705835407 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bdc019070 con 0x7f2be4144600 2024-04-22T06:31:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.786+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be41f4280 con 0x7f2be4144600 2024-04-22T06:31:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.786+0000 7f2bd9ffb640 1 -- 172.21.15.145:0/705835407 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc014a20 con 0x7f2be4144600 2024-04-22T06:31:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.786+0000 7f2bd9ffb640 1 -- 172.21.15.145:0/705835407 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2bdc014bc0 con 0x7f2be4144600 2024-04-22T06:31:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.786+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be41f4840 con 0x7f2be4144600 2024-04-22T06:31:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.786+0000 7f2bd9ffb640 1 -- 172.21.15.145:0/705835407 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f2bdc01ea50 con 0x7f2be4144600 2024-04-22T06:31:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.787+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be4068f50 con 0x7f2be4144600 2024-04-22T06:31:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.789+0000 7f2bd9ffb640 1 -- 172.21.15.145:0/705835407 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2bdc01e460 con 0x7f2be4144600 2024-04-22T06:31:14.801 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:14.802+0000 7f8e71611040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-22T06:31:14.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.861+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c607e613-01ff-4908-a157-3f87c5bea33b", "id": 6} v 0) -- 0x7f2be4073540 con 0x7f2be4144600 2024-04-22T06:31:14.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.867+0000 7f2bd9ffb640 1 -- 172.21.15.145:0/705835407 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c607e613-01ff-4908-a157-3f87c5bea33b", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f2bdc01e640 con 0x7f2be4144600 2024-04-22T06:31:14.866 INFO:teuthology.orchestra.run.smithi145.stdout:6 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 msgr2=0x7f2be4158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be4158740 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc007e70 tx=0x7f2bdc00e4b0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 shutdown_connections 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2be4144600 0x7f2be4158740 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2be4144220 0x7f2be4158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 --2- 172.21.15.145:0/705835407 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2be40c9ff0 0x7f2be413ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 >> 172.21.15.145:0/705835407 conn(0x7f2be406b920 msgr2=0x7f2be4158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 shutdown_connections 2024-04-22T06:31:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:14.868+0000 7f2beb8eb640 1 -- 172.21.15.145:0/705835407 wait complete. 2024-04-22T06:31:14.877 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 3c031c2b-cf7e-48ad-957c-c709ad95c360 7 2024-04-22T06:31:14.918 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:14.919+0000 7f8e71611040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-22T06:31:15.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.016+0000 7f3658f60640 1 Processor -- start 2024-04-22T06:31:15.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.016+0000 7f3658f60640 1 -- start start 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3658f60640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f36541553b0 0x7f3654070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3658f60640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36540722a0 0x7f3654070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3658f60640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36540754d0 con 0x7f3654074d50 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3658f60640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f365415e920 con 0x7f36541553b0 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3658f60640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f365415ec00 con 0x7f36540722a0 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3651d9b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36540722a0 0x7f3654070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3651d9b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36540722a0 0x7f3654070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:51240/0 (socket says 172.21.15.145:51240) 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3651d9b640 1 -- 172.21.15.145:0/1392587919 learned_addr learned my addr 172.21.15.145:0/1392587919 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f365259c640 1 --2- 172.21.15.145:0/1392587919 >> v2:172.21.15.113:3300/0 conn(0x7f36541553b0 0x7f3654070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3651d9b640 1 -- 172.21.15.145:0/1392587919 >> v2:172.21.15.113:3300/0 conn(0x7f36541553b0 msgr2=0x7f3654070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:15.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3651d9b640 1 --2- 172.21.15.145:0/1392587919 >> v2:172.21.15.113:3300/0 conn(0x7f36541553b0 0x7f3654070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3651d9b640 1 -- 172.21.15.145:0/1392587919 >> v1:172.21.15.113:6789/0 conn(0x7f3654074d50 legacy=0x7f365415b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f3651d9b640 1 -- 172.21.15.145:0/1392587919 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365415eee0 con 0x7f36540722a0 2024-04-22T06:31:15.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.018+0000 7f365259c640 1 --2- 172.21.15.145:0/1392587919 >> v2:172.21.15.113:3300/0 conn(0x7f36541553b0 0x7f3654070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:15.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.019+0000 7f3651d9b640 1 --2- 172.21.15.145:0/1392587919 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36540722a0 0x7f3654070870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3644009870 tx=0x7f364402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b494c41855c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:15.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.019+0000 7f365159a640 1 -- 172.21.15.145:0/1392587919 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644034070 con 0x7f36540722a0 2024-04-22T06:31:15.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.019+0000 7f365159a640 1 -- 172.21.15.145:0/1392587919 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644030840 con 0x7f36540722a0 2024-04-22T06:31:15.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.019+0000 7f365159a640 1 -- 172.21.15.145:0/1392587919 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644030c10 con 0x7f36540722a0 2024-04-22T06:31:15.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.020+0000 7f3658f60640 1 -- 172.21.15.145:0/1392587919 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36540722a0 msgr2=0x7f3654070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.020+0000 7f3658f60640 1 --2- 172.21.15.145:0/1392587919 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36540722a0 0x7f3654070870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3644009870 tx=0x7f364402b980 comp rx=0 tx=0).stop 2024-04-22T06:31:15.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.020+0000 7f3658f60640 1 -- 172.21.15.145:0/1392587919 shutdown_connections 2024-04-22T06:31:15.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.020+0000 7f3658f60640 1 --2- 172.21.15.145:0/1392587919 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36540722a0 0x7f3654070870 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.020+0000 7f3658f60640 1 --2- 172.21.15.145:0/1392587919 >> v2:172.21.15.113:3300/0 conn(0x7f36541553b0 0x7f3654070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.020+0000 7f3658f60640 1 -- 172.21.15.145:0/1392587919 >> 172.21.15.145:0/1392587919 conn(0x7f365406e1a0 msgr2=0x7f365406e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:15.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.020+0000 7f3658f60640 1 -- 172.21.15.145:0/1392587919 shutdown_connections 2024-04-22T06:31:15.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.020+0000 7f3658f60640 1 -- 172.21.15.145:0/1392587919 wait complete. 2024-04-22T06:31:15.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.022+0000 7f3658f60640 1 Processor -- start 2024-04-22T06:31:15.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.022+0000 7f3658f60640 1 -- start start 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3658f60640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36540722a0 0x7f3654145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3658f60640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3654074d50 0x7f36541595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3658f60640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36541553b0 0x7f3654159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3658f60640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3654155790 con 0x7f3654074d50 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3658f60640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f365415f4a0 con 0x7f36540722a0 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3658f60640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f36540759d0 con 0x7f36541553b0 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f365259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36540722a0 0x7f3654145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3652d9d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36541553b0 0x7f3654159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f365259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36540722a0 0x7f3654145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:44778/0 (socket says 172.21.15.145:44778) 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3652d9d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36541553b0 0x7f3654159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:51244/0 (socket says 172.21.15.145:51244) 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f365259c640 1 -- 172.21.15.145:0/4136964992 learned_addr learned my addr 172.21.15.145:0/4136964992 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-22T06:31:15.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.023+0000 7f3651d9b640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3654074d50 0x7f36541595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3652d9d640 1 -- 172.21.15.145:0/4136964992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36540722a0 msgr2=0x7f3654145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3652d9d640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36540722a0 0x7f3654145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3652d9d640 1 -- 172.21.15.145:0/4136964992 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3654074d50 msgr2=0x7f36541595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3652d9d640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3654074d50 0x7f36541595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3652d9d640 1 -- 172.21.15.145:0/4136964992 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36541f0ac0 con 0x7f36541553b0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f365259c640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36540722a0 0x7f3654145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3652d9d640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36541553b0 0x7f3654159b00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c6f0 tx=0x7f364c00cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3642ffd640 1 -- 172.21.15.145:0/4136964992 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c003970 con 0x7f36541553b0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3642ffd640 1 -- 172.21.15.145:0/4136964992 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c003b10 con 0x7f36541553b0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3642ffd640 1 -- 172.21.15.145:0/4136964992 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c00a850 con 0x7f36541553b0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36540c7a20 con 0x7f36541553b0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36540c4de0 con 0x7f36541553b0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3642ffd640 1 -- 172.21.15.145:0/4136964992 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f364c00a9f0 con 0x7f36541553b0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.024+0000 7f3642ffd640 1 -- 172.21.15.145:0/4136964992 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f364c00ace0 con 0x7f36541553b0 2024-04-22T06:31:15.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.025+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3654068f50 con 0x7f36541553b0 2024-04-22T06:31:15.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.027+0000 7f3642ffd640 1 -- 172.21.15.145:0/4136964992 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f36540754d0 con 0x7f36541553b0 2024-04-22T06:31:15.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.099+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3c031c2b-cf7e-48ad-957c-c709ad95c360", "id": 7} v 0) -- 0x7f3654152680 con 0x7f36541553b0 2024-04-22T06:31:15.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.105+0000 7f3642ffd640 1 -- 172.21.15.145:0/4136964992 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c031c2b-cf7e-48ad-957c-c709ad95c360", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f364c0050d0 con 0x7f36541553b0 2024-04-22T06:31:15.104 INFO:teuthology.orchestra.run.smithi145.stdout:7 2024-04-22T06:31:15.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.106+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36541553b0 msgr2=0x7f3654159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.106+0000 7f3658f60640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36541553b0 0x7f3654159b00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c6f0 tx=0x7f364c00cbb0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.106+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 shutdown_connections 2024-04-22T06:31:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.106+0000 7f3658f60640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36541553b0 0x7f3654159b00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.106+0000 7f3658f60640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3654074d50 0x7f36541595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.106+0000 7f3658f60640 1 --2- 172.21.15.145:0/4136964992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36540722a0 0x7f3654145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.106+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 >> 172.21.15.145:0/4136964992 conn(0x7f365406e1a0 msgr2=0x7f365415dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.107+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 shutdown_connections 2024-04-22T06:31:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-22T06:31:15.107+0000 7f3658f60640 1 -- 172.21.15.145:0/4136964992 wait complete. 2024-04-22T06:31:15.109 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:15.110+0000 7efe3ebbb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-22T06:31:15.115 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-22T06:31:15.116 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-22T06:31:15.118 INFO:tasks.ceph.osd.0:Started 2024-04-22T06:31:15.118 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-22T06:31:15.118 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-22T06:31:15.121 INFO:tasks.ceph.osd.1:Started 2024-04-22T06:31:15.122 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-22T06:31:15.122 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-22T06:31:15.124 INFO:tasks.ceph.osd.2:Started 2024-04-22T06:31:15.124 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-22T06:31:15.124 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-22T06:31:15.126 INFO:tasks.ceph.osd.3:Started 2024-04-22T06:31:15.126 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-22T06:31:15.126 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-22T06:31:15.128 INFO:tasks.ceph.osd.4:Started 2024-04-22T06:31:15.128 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-22T06:31:15.129 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-22T06:31:15.130 INFO:tasks.ceph.osd.5:Started 2024-04-22T06:31:15.130 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-22T06:31:15.131 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-22T06:31:15.132 INFO:tasks.ceph.osd.6:Started 2024-04-22T06:31:15.133 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-22T06:31:15.133 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-22T06:31:15.135 INFO:tasks.ceph.osd.7:Started 2024-04-22T06:31:15.135 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:15.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.261+0000 7fa2c82f1640 1 Processor -- start 2024-04-22T06:31:15.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.261+0000 7fa2c82f1640 1 -- start start 2024-04-22T06:31:15.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c82f1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa2c00c92f0 0x7fa2c00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c82f1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c015b5a0 con 0x7fa2c0155380 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c82f1640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c015b880 con 0x7fa2c015b0f0 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c82f1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fa2c00c86e0 con 0x7fa2c00c92f0 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c608d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa2c0155380 0x7fa2c00c7fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33556/0 (socket says 172.21.15.113:33556) 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c608d640 1 -- 172.21.15.113:0/2044274400 learned_addr learned my addr 172.21.15.113:0/2044274400 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c688e640 1 --2- 172.21.15.113:0/2044274400 >> v2:172.21.15.113:3300/0 conn(0x7fa2c00c92f0 0x7fa2c00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c688e640 1 -- 172.21.15.113:0/2044274400 >> v1:172.21.15.145:6789/0 conn(0x7fa2c015b0f0 legacy=0x7fa2c006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c688e640 1 -- 172.21.15.113:0/2044274400 >> v1:172.21.15.113:6789/0 conn(0x7fa2c0155380 legacy=0x7fa2c00c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c508b640 1 -- 172.21.15.113:0/2044274400 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441552423 0 0) 0x7fa2c015b5a0 con 0x7fa2c0155380 2024-04-22T06:31:15.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.262+0000 7fa2c688e640 1 -- 172.21.15.113:0/2044274400 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c015bb60 con 0x7fa2c00c92f0 2024-04-22T06:31:15.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.263+0000 7fa2c688e640 1 --2- 172.21.15.113:0/2044274400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c00c92f0 0x7fa2c00c9740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009d90 tx=0x7fa2b802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e7868486c4bf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.263+0000 7fa2c508b640 1 -- 172.21.15.113:0/2044274400 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8039070 con 0x7fa2c00c92f0 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.263+0000 7fa2c508b640 1 -- 172.21.15.113:0/2044274400 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b802cc60 con 0x7fa2c00c92f0 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.263+0000 7fa2c508b640 1 -- 172.21.15.113:0/2044274400 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8034660 con 0x7fa2c00c92f0 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.264+0000 7fa2c82f1640 1 -- 172.21.15.113:0/2044274400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c00c92f0 msgr2=0x7fa2c00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.264+0000 7fa2c82f1640 1 --2- 172.21.15.113:0/2044274400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c00c92f0 0x7fa2c00c9740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009d90 tx=0x7fa2b802beb0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.264+0000 7fa2c82f1640 1 -- 172.21.15.113:0/2044274400 shutdown_connections 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.264+0000 7fa2c82f1640 1 --2- 172.21.15.113:0/2044274400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c00c92f0 0x7fa2c00c9740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.264+0000 7fa2c82f1640 1 -- 172.21.15.113:0/2044274400 >> 172.21.15.113:0/2044274400 conn(0x7fa2c00ca0d0 msgr2=0x7fa2c00ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.264+0000 7fa2c82f1640 1 -- 172.21.15.113:0/2044274400 shutdown_connections 2024-04-22T06:31:15.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.264+0000 7fa2c82f1640 1 -- 172.21.15.113:0/2044274400 wait complete. 2024-04-22T06:31:15.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.265+0000 7fa2c82f1640 1 Processor -- start 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.265+0000 7fa2c82f1640 1 -- start start 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c82f1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2c00c92f0 0x7fa2c01f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c82f1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c0155380 0x7fa2c00cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c82f1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2c015b0f0 0x7fa2c00cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c82f1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c0155760 con 0x7fa2c0155380 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c82f1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c006fab0 con 0x7fa2c00c92f0 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c82f1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c0070650 con 0x7fa2c015b0f0 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c0155380 0x7fa2c00cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c0155380 0x7fa2c00cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45350/0 (socket says 172.21.15.113:45350) 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 -- 172.21.15.113:0/3455110560 learned_addr learned my addr 172.21.15.113:0/3455110560 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c608d640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2c00c92f0 0x7fa2c01f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c688e640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2c015b0f0 0x7fa2c00cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:15.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 -- 172.21.15.113:0/3455110560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2c015b0f0 msgr2=0x7fa2c00cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2c015b0f0 0x7fa2c00cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 -- 172.21.15.113:0/3455110560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2c00c92f0 msgr2=0x7fa2c01f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2c00c92f0 0x7fa2c01f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 -- 172.21.15.113:0/3455110560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c00c49d0 con 0x7fa2c0155380 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.266+0000 7fa2c588c640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c0155380 0x7fa2c00cdda0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00c430 tx=0x7fa2bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.267+0000 7fa2b6ffd640 1 -- 172.21.15.113:0/3455110560 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc017070 con 0x7fa2c0155380 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.267+0000 7fa2b6ffd640 1 -- 172.21.15.113:0/3455110560 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2bc0052d0 con 0x7fa2c0155380 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.267+0000 7fa2b6ffd640 1 -- 172.21.15.113:0/3455110560 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc003830 con 0x7fa2c0155380 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.267+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c00cb590 con 0x7fa2c0155380 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.267+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c00cbb50 con 0x7fa2c0155380 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.267+0000 7fa2b6ffd640 1 -- 172.21.15.113:0/3455110560 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2bc01a070 con 0x7fa2c0155380 2024-04-22T06:31:15.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.267+0000 7fa2b6ffd640 1 -- 172.21.15.113:0/3455110560 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa2bc011d40 con 0x7fa2c0155380 2024-04-22T06:31:15.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.268+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c0152e40 con 0x7fa2c0155380 2024-04-22T06:31:15.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.270+0000 7fa2b6ffd640 1 -- 172.21.15.113:0/3455110560 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa2c0152e40 con 0x7fa2c0155380 2024-04-22T06:31:15.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.329+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2c0068e40 con 0x7fa2c0155380 2024-04-22T06:31:15.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.330+0000 7fa2b6ffd640 1 -- 172.21.15.113:0/3455110560 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa2bc011590 con 0x7fa2c0155380 2024-04-22T06:31:15.330 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:15.330 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":10,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:15.101467+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c0155380 msgr2=0x7fa2c00cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c0155380 0x7fa2c00cdda0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00c430 tx=0x7fa2bc00c8f0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 shutdown_connections 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa2c015b0f0 0x7fa2c00cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2c0155380 0x7fa2c00cdda0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 --2- 172.21.15.113:0/3455110560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2c00c92f0 0x7fa2c01f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 >> 172.21.15.113:0/3455110560 conn(0x7fa2c00ca0d0 msgr2=0x7fa2c00720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 shutdown_connections 2024-04-22T06:31:15.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:15.331+0000 7fa2c82f1640 1 -- 172.21.15.113:0/3455110560 wait complete. 2024-04-22T06:31:15.341 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-22T06:31:15.341 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-22T06:31:15.345 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:15.346+0000 7f8e71611040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-22T06:31:15.409 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:15.410+0000 7efe3ebbb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-22T06:31:15.461 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:15.462+0000 7efe3ebbb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-22T06:31:15.578 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:15.579+0000 7efe3ebbb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-22T06:31:15.604 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:15.605+0000 7f8e71611040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-22T06:31:15.655 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:15.657+0000 7f8e71611040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-22T06:31:15.735 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-22T06:31:15.735+0000 7f906191c640 -1 Falling back to public interface 2024-04-22T06:31:15.735 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-04-22T06:31:15.735+0000 7f1bf6580640 -1 Falling back to public interface 2024-04-22T06:31:15.735 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-22T06:31:15.735+0000 7f90608cb640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-04-22T06:31:15.742 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-04-22T06:31:15.743+0000 7f1701c11640 -1 Falling back to public interface 2024-04-22T06:31:15.743 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-04-22T06:31:15.743+0000 7ff540db8640 -1 Falling back to public interface 2024-04-22T06:31:15.743 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-04-22T06:31:15.744+0000 7f1700591640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-04-22T06:31:15.745 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-04-22T06:31:15.746+0000 7f69c8a10640 -1 Falling back to public interface 2024-04-22T06:31:15.745 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-04-22T06:31:15.746+0000 7f7dd5026640 -1 Falling back to public interface 2024-04-22T06:31:15.747 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-04-22T06:31:15.748+0000 7f73c7813640 -1 Falling back to public interface 2024-04-22T06:31:15.752 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-04-22T06:31:15.753+0000 7fb78b211640 -1 Falling back to public interface 2024-04-22T06:31:15.776 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:15.778+0000 7f8e71611040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-22T06:31:15.856 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:15.857+0000 7efe3ebbb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-22T06:31:15.903 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:15.903+0000 7efe3ebbb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-22T06:31:16.058 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:16.059+0000 7f8e71611040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-22T06:31:16.060 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:16.060+0000 7efe3ebbb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-22T06:31:16.105 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:16.106+0000 7f8e71611040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-22T06:31:16.147 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:16.196 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:16.197+0000 7efe3ebbb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-22T06:31:16.237 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.237+0000 7fb799d0e640 1 Processor -- start 2024-04-22T06:31:16.237 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.237+0000 7fb799d0e640 1 -- start start 2024-04-22T06:31:16.239 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb799d0e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940c6fa0 0x7fb7940733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:16.239 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb799d0e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb7940c48d0 0x7fb7940c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:16.239 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb799d0e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7940c52a0 con 0x7fb7940b2230 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb799d0e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb794067ea0 con 0x7fb7940c48d0 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb799d0e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb794073900 con 0x7fb7940c6fa0 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb793fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb7940c48d0 0x7fb7940c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb793fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb7940c48d0 0x7fb7940c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45352/0 (socket says 172.21.15.113:45352) 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb793fff640 1 -- 172.21.15.113:0/674477548 learned_addr learned my addr 172.21.15.113:0/674477548 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb78affd640 1 --2- 172.21.15.113:0/674477548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940c6fa0 0x7fb7940733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb793fff640 1 -- 172.21.15.113:0/674477548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940c6fa0 msgr2=0x7fb7940733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb793fff640 1 --2- 172.21.15.113:0/674477548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940c6fa0 0x7fb7940733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb793fff640 1 -- 172.21.15.113:0/674477548 >> v1:172.21.15.145:6789/0 conn(0x7fb7940b2230 legacy=0x7fb7940c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.238+0000 7fb793fff640 1 -- 172.21.15.113:0/674477548 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb794073b40 con 0x7fb7940c48d0 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.239+0000 7fb793fff640 1 --2- 172.21.15.113:0/674477548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb7940c4d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009e50 tx=0x7fb78c02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dd1cf49fbc1a01 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.239+0000 7fb792ffd640 1 -- 172.21.15.113:0/674477548 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c02cb90 con 0x7fb7940c48d0 2024-04-22T06:31:16.240 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.239+0000 7fb792ffd640 1 -- 172.21.15.113:0/674477548 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78c02cd30 con 0x7fb7940c48d0 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.239+0000 7fb792ffd640 1 -- 172.21.15.113:0/674477548 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c034610 con 0x7fb7940c48d0 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.240+0000 7fb799d0e640 1 -- 172.21.15.113:0/674477548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 msgr2=0x7fb7940c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.240+0000 7fb799d0e640 1 --2- 172.21.15.113:0/674477548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb7940c4d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009e50 tx=0x7fb78c02bff0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.240+0000 7fb799d0e640 1 -- 172.21.15.113:0/674477548 shutdown_connections 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.240+0000 7fb799d0e640 1 --2- 172.21.15.113:0/674477548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb7940c4d60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.240+0000 7fb799d0e640 1 --2- 172.21.15.113:0/674477548 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940c6fa0 0x7fb7940733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.240+0000 7fb799d0e640 1 -- 172.21.15.113:0/674477548 >> 172.21.15.113:0/674477548 conn(0x7fb79406f410 msgr2=0x7fb79406f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.240+0000 7fb799d0e640 1 -- 172.21.15.113:0/674477548 shutdown_connections 2024-04-22T06:31:16.241 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.240+0000 7fb799d0e640 1 -- 172.21.15.113:0/674477548 wait complete. 2024-04-22T06:31:16.243 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.241+0000 7fb799d0e640 1 Processor -- start 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.241+0000 7fb799d0e640 1 -- start start 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb799d0e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940b2230 0x7fb79415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb799d0e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb79415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb799d0e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7940c6fa0 0x7fb7941556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb799d0e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb79415b800 con 0x7fb7940c48d0 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb799d0e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb79415c130 con 0x7fb7940c6fa0 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb799d0e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb79415bae0 con 0x7fb7940b2230 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb78affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb79415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb78affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb79415aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45368/0 (socket says 172.21.15.113:45368) 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb78affd640 1 -- 172.21.15.113:0/1673679263 learned_addr learned my addr 172.21.15.113:0/1673679263 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb793fff640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7940c6fa0 0x7fb7941556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb7937fe640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940b2230 0x7fb79415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:16.244 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb78affd640 1 -- 172.21.15.113:0/1673679263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940b2230 msgr2=0x7fb79415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb78affd640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940b2230 0x7fb79415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb78affd640 1 -- 172.21.15.113:0/1673679263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7940c6fa0 msgr2=0x7fb7941556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb78affd640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7940c6fa0 0x7fb7941556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.242+0000 7fb78affd640 1 -- 172.21.15.113:0/1673679263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb794153d30 con 0x7fb7940c48d0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.243+0000 7fb78affd640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb79415aa40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00e870 tx=0x7fb77c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.243+0000 7fb790ff9640 1 -- 172.21.15.113:0/1673679263 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c017070 con 0x7fb7940c48d0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.243+0000 7fb790ff9640 1 -- 172.21.15.113:0/1673679263 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c00c940 con 0x7fb7940c48d0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.243+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79415ccf0 con 0x7fb7940c48d0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.243+0000 7fb790ff9640 1 -- 172.21.15.113:0/1673679263 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00cd30 con 0x7fb7940c48d0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.243+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb794153fd0 con 0x7fb7940c48d0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.243+0000 7fb790ff9640 1 -- 172.21.15.113:0/1673679263 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb77c01a070 con 0x7fb7940c48d0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.243+0000 7fb790ff9640 1 -- 172.21.15.113:0/1673679263 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb77c013b40 con 0x7fb7940c48d0 2024-04-22T06:31:16.245 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.244+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb794068e00 con 0x7fb7940c48d0 2024-04-22T06:31:16.247 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.247+0000 7fb790ff9640 1 -- 172.21.15.113:0/1673679263 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb77c013d40 con 0x7fb7940c48d0 2024-04-22T06:31:16.249 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:16.250+0000 7efe3ebbb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-22T06:31:16.260 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:16.261+0000 7f8e71611040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-22T06:31:16.308 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.309+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb79404fdc0 con 0x7fb7940c48d0 2024-04-22T06:31:16.309 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.310+0000 7fb790ff9640 1 -- 172.21.15.113:0/1673679263 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb77c006520 con 0x7fb7940c48d0 2024-04-22T06:31:16.309 INFO:teuthology.misc.health.smithi113.stdout: 2024-04-22T06:31:16.309 INFO:teuthology.misc.health.smithi113.stdout:{"epoch":10,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:15.101467+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:16.310 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 msgr2=0x7fb79415aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:16.310 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb79415aa40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00e870 tx=0x7fb77c00ed30 comp rx=0 tx=0).stop 2024-04-22T06:31:16.311 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 shutdown_connections 2024-04-22T06:31:16.311 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb7940c6fa0 0x7fb7941556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.311 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7940c48d0 0x7fb79415aa40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.311 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 --2- 172.21.15.113:0/1673679263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7940b2230 0x7fb79415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:16.311 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 >> 172.21.15.113:0/1673679263 conn(0x7fb79406f410 msgr2=0x7fb7941585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:16.311 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 shutdown_connections 2024-04-22T06:31:16.311 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:16.311+0000 7fb799d0e640 1 -- 172.21.15.113:0/1673679263 wait complete. 2024-04-22T06:31:16.320 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-22T06:31:16.323 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:16.324+0000 7efe3ebbb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-22T06:31:16.368 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:16.369+0000 7efe3ebbb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-22T06:31:16.395 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:16.397+0000 7f8e71611040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-22T06:31:16.445 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:16.446+0000 7f8e71611040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-22T06:31:16.513 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:16.514+0000 7f8e71611040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-22T06:31:16.559 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:16.560+0000 7f8e71611040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-22T06:31:16.839 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:16.839+0000 7efe3ebbb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-22T06:31:16.956 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:16.957+0000 7efe3ebbb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-22T06:31:17.041 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:17.042+0000 7f8e71611040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-22T06:31:17.157 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-04-22T06:31:17.159+0000 7f8e71611040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-22T06:31:17.972 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:17.973+0000 7efdde51c640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-22T06:31:17.973 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:31:17.973+0000 7efdde51c640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-22T06:31:19.204 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-04-22T06:31:19.205+0000 7ff540db8640 -1 osd.3 0 log_to_monitors true 2024-04-22T06:31:19.217 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-04-22T06:31:19.218+0000 7fb78b211640 -1 osd.7 0 log_to_monitors true 2024-04-22T06:31:19.217 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-04-22T06:31:19.219+0000 7f7dd5026640 -1 osd.5 0 log_to_monitors true 2024-04-22T06:31:19.250 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-04-22T06:31:19.251+0000 7f69c8a10640 -1 osd.4 0 log_to_monitors true 2024-04-22T06:31:19.269 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-04-22T06:31:19.270+0000 7f73c7813640 -1 osd.6 0 log_to_monitors true 2024-04-22T06:31:19.269 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-04-22T06:31:19.270+0000 7f1bf6580640 -1 osd.0 0 log_to_monitors true 2024-04-22T06:31:19.274 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-22T06:31:19.275+0000 7f906191c640 -1 osd.1 0 log_to_monitors true 2024-04-22T06:31:19.281 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-04-22T06:31:19.282+0000 7f1701c11640 -1 osd.2 0 log_to_monitors true 2024-04-22T06:31:22.459 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-04-22T06:31:22.460+0000 7ff53cd4e640 -1 osd.3 0 waiting for initial osdmap 2024-04-22T06:31:22.478 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-04-22T06:31:22.480+0000 7f1bf2516640 -1 osd.0 0 waiting for initial osdmap 2024-04-22T06:31:22.478 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-04-22T06:31:22.480+0000 7ff534b6e640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T06:31:22.478 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-22T06:31:22.480+0000 7f905e0c6640 -1 osd.1 0 waiting for initial osdmap 2024-04-22T06:31:22.485 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-04-22T06:31:22.487+0000 7f16fd578640 -1 osd.2 0 waiting for initial osdmap 2024-04-22T06:31:22.492 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-04-22T06:31:22.494+0000 7f1bea336640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T06:31:22.492 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-22T06:31:22.494+0000 7f90556d2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T06:31:22.501 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-04-22T06:31:22.503+0000 7f16f5398640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T06:31:22.997 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-04-22T06:31:22.998+0000 7fb786b78640 -1 osd.7 0 waiting for initial osdmap 2024-04-22T06:31:23.015 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-04-22T06:31:23.017+0000 7fb77e998640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T06:31:23.052 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-04-22T06:31:23.054+0000 7f73c38f4640 -1 osd.6 0 waiting for initial osdmap 2024-04-22T06:31:23.067 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-04-22T06:31:23.069+0000 7f69c4c89640 -1 osd.4 0 waiting for initial osdmap 2024-04-22T06:31:23.069 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-04-22T06:31:23.071+0000 7f73baf00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T06:31:23.079 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-04-22T06:31:23.081+0000 7f69bc295640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T06:31:23.102 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-04-22T06:31:23.103+0000 7f7dd0a15640 -1 osd.5 0 waiting for initial osdmap 2024-04-22T06:31:23.120 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-04-22T06:31:23.121+0000 7f7dc8835640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T06:31:23.126 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:23.219 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.220+0000 7ff4b7db2640 1 Processor -- start 2024-04-22T06:31:23.219 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.221+0000 7ff4b7db2640 1 -- start start 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.221+0000 7ff4b7db2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff4b00cb740 0x7ff4b0143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.221+0000 7ff4b7db2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b015c0e0 con 0x7ff4b015f160 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.221+0000 7ff4b7db2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b015b280 con 0x7ff4b00cbb20 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.221+0000 7ff4b7db2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7ff4b015b560 con 0x7ff4b00cb740 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.222+0000 7ff4b5b4e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff4b00cb740 0x7ff4b0143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.222+0000 7ff4b634f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff4b015f160 0x7ff4b0073cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:53750/0 (socket says 172.21.15.113:53750) 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.222+0000 7ff4b5b4e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff4b00cb740 0x7ff4b0143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55834/0 (socket says 172.21.15.113:55834) 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.222+0000 7ff4b634f640 1 -- 172.21.15.113:0/3448090637 learned_addr learned my addr 172.21.15.113:0/3448090637 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:23.221 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.222+0000 7ff4b5b4e640 1 -- 172.21.15.113:0/3448090637 >> v1:172.21.15.145:6789/0 conn(0x7ff4b00cbb20 legacy=0x7ff4b015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:23.222 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.222+0000 7ff4b5b4e640 1 -- 172.21.15.113:0/3448090637 >> v1:172.21.15.113:6789/0 conn(0x7ff4b015f160 legacy=0x7ff4b0073cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:23.222 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.222+0000 7ff4b5b4e640 1 -- 172.21.15.113:0/3448090637 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b015b840 con 0x7ff4b00cb740 2024-04-22T06:31:23.222 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.222+0000 7ff4b4b4c640 1 -- 172.21.15.113:0/3448090637 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25839447 0 0) 0x7ff4b015c0e0 con 0x7ff4b015f160 2024-04-22T06:31:23.222 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b5b4e640 1 --2- 172.21.15.113:0/3448090637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b0143fc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00097a0 tx=0x7ff4a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412c5e380b0b2da3 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:23.222 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b4b4c640 1 -- 172.21.15.113:0/3448090637 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0035020 con 0x7ff4b00cb740 2024-04-22T06:31:23.222 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b4b4c640 1 -- 172.21.15.113:0/3448090637 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a0031830 con 0x7ff4b00cb740 2024-04-22T06:31:23.222 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b4b4c640 1 -- 172.21.15.113:0/3448090637 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0031c00 con 0x7ff4b00cb740 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b7db2640 1 -- 172.21.15.113:0/3448090637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 msgr2=0x7ff4b0143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b7db2640 1 --2- 172.21.15.113:0/3448090637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b0143fc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00097a0 tx=0x7ff4a002b8d0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b7db2640 1 -- 172.21.15.113:0/3448090637 shutdown_connections 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b7db2640 1 --2- 172.21.15.113:0/3448090637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b0143fc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b7db2640 1 -- 172.21.15.113:0/3448090637 >> 172.21.15.113:0/3448090637 conn(0x7ff4b00ce8f0 msgr2=0x7ff4b00ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b7db2640 1 -- 172.21.15.113:0/3448090637 shutdown_connections 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.223+0000 7ff4b7db2640 1 -- 172.21.15.113:0/3448090637 wait complete. 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b7db2640 1 Processor -- start 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b7db2640 1 -- start start 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b7db2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b01577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b7db2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b00cbb20 0x7ff4b01f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b7db2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b015f160 0x7ff4b01581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b7db2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b00c91f0 con 0x7ff4b00cb740 2024-04-22T06:31:23.225 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b7db2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b015be00 con 0x7ff4b00cbb20 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b7db2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b00c9370 con 0x7ff4b015f160 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b5b4e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b01577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b5b4e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b01577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55850/0 (socket says 172.21.15.113:55850) 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.225+0000 7ff4b5b4e640 1 -- 172.21.15.113:0/2993554690 learned_addr learned my addr 172.21.15.113:0/2993554690 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b534d640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b00cbb20 0x7ff4b01f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b5b4e640 1 -- 172.21.15.113:0/2993554690 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b015f160 msgr2=0x7ff4b01581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b5b4e640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b015f160 0x7ff4b01581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b5b4e640 1 -- 172.21.15.113:0/2993554690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b00cbb20 msgr2=0x7ff4b01f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b5b4e640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b00cbb20 0x7ff4b01f4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b5b4e640 1 -- 172.21.15.113:0/2993554690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b015cdc0 con 0x7ff4b00cb740 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b5b4e640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b01577e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00098c0 tx=0x7ff4a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:23.226 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4a67fc640 1 -- 172.21.15.113:0/2993554690 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0004230 con 0x7ff4b00cb740 2024-04-22T06:31:23.227 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4a67fc640 1 -- 172.21.15.113:0/2993554690 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a00043d0 con 0x7ff4b00cb740 2024-04-22T06:31:23.227 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4a67fc640 1 -- 172.21.15.113:0/2993554690 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a003ca50 con 0x7ff4b00cb740 2024-04-22T06:31:23.227 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b015c2f0 con 0x7ff4b00cb740 2024-04-22T06:31:23.227 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.226+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b015d060 con 0x7ff4b00cb740 2024-04-22T06:31:23.228 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.227+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b004fdc0 con 0x7ff4b00cb740 2024-04-22T06:31:23.228 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.227+0000 7ff4a67fc640 1 -- 172.21.15.113:0/2993554690 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7ff4a0038020 con 0x7ff4b00cb740 2024-04-22T06:31:23.228 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.228+0000 7ff4a67fc640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff49406c860 0x7ff49406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:23.228 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.228+0000 7ff4b534d640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff49406c860 0x7ff49406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:23.228 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.228+0000 7ff4a67fc640 1 -- 172.21.15.113:0/2993554690 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7ff4a00ace70 con 0x7ff4b00cb740 2024-04-22T06:31:23.228 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.228+0000 7ff4b534d640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff49406c860 0x7ff49406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff4b013fff0 tx=0x7ff4ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:23.231 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.232+0000 7ff4a67fc640 1 -- 172.21.15.113:0/2993554690 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff4a0041070 con 0x7ff4b00cb740 2024-04-22T06:31:23.406 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.407+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4b015eca0 con 0x7ff4b00cb740 2024-04-22T06:31:23.406 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.408+0000 7ff4a67fc640 1 -- 172.21.15.113:0/2993554690 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7ff4a007c1a0 con 0x7ff4b00cb740 2024-04-22T06:31:23.407 INFO:teuthology.misc.health.smithi113.stdout: 2024-04-22T06:31:23.407 INFO:teuthology.misc.health.smithi113.stdout:{"epoch":12,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:20.975640+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:23.408 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff49406c860 msgr2=0x7ff49406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:23.408 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff49406c860 0x7ff49406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff4b013fff0 tx=0x7ff4ac009040 comp rx=0 tx=0).stop 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 msgr2=0x7ff4b01577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b01577e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00098c0 tx=0x7ff4a00046c0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 shutdown_connections 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff4b015f160 0x7ff4b01581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4b00cbb20 0x7ff4b01f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff49406c860 0x7ff49406ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 --2- 172.21.15.113:0/2993554690 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4b00cb740 0x7ff4b01577e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 >> 172.21.15.113:0/2993554690 conn(0x7ff4b00ce8f0 msgr2=0x7ff4b0070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 shutdown_connections 2024-04-22T06:31:23.409 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:23.410+0000 7ff4b7db2640 1 -- 172.21.15.113:0/2993554690 wait complete. 2024-04-22T06:31:23.418 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-22T06:31:30.225 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:30.325 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.326+0000 7f646282c640 1 Processor -- start 2024-04-22T06:31:30.325 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.327+0000 7f646282c640 1 -- start start 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.327+0000 7f646282c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f645c0c5b60 0x7f645c15e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.327+0000 7f646282c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f645c15ebf0 0x7f645c0d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.327+0000 7f646282c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f645c0ce2f0 con 0x7f645c1553a0 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.327+0000 7f646282c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f645c15f080 con 0x7f645c15ebf0 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.327+0000 7f646282c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f645c15f360 con 0x7f645c0c5b60 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.327+0000 7f645bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f645c1553a0 0x7f645c0cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54934/0 (socket says 172.21.15.113:54934) 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.327+0000 7f645bfff640 1 -- 172.21.15.113:0/3157352963 learned_addr learned my addr 172.21.15.113:0/3157352963 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441870866 0 0) 0x7f645c0ce2f0 con 0x7f645c1553a0 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645b7fe640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f645c0c5b60 0x7f645c15e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f6460dc9640 1 --2- 172.21.15.113:0/3157352963 >> v2:172.21.15.145:3300/0 conn(0x7f645c15ebf0 0x7f645c0d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6444003520 con 0x7f645c1553a0 2024-04-22T06:31:30.329 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3244278700 0 0) 0x7f6444003520 con 0x7f645c1553a0 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f645c0c5b60 msgr2=0x7f645c15e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f645c0c5b60 0x7f645c15e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 >> v2:172.21.15.145:3300/0 conn(0x7f645c15ebf0 msgr2=0x7f645c0d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 --2- 172.21.15.113:0/3157352963 >> v2:172.21.15.145:3300/0 conn(0x7f645c15ebf0 0x7f645c0d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c0cd100 con 0x7f645c1553a0 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f644c001670 con 0x7f645c1553a0 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 >> v1:172.21.15.113:6789/0 conn(0x7f645c1553a0 legacy=0x7f645c0cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64440039b0 0x7f6444003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f645c0c5b60 0x7f6444004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6444004d40 0x7f64440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f645c15f080 con 0x7f6444004d40 2024-04-22T06:31:30.330 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f645c15f360 con 0x7f64440039b0 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f644400b9c0 con 0x7f645c0c5b60 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f6460dc9640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6444004d40 0x7f64440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645b7fe640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f645c0c5b60 0x7f6444004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f645bfff640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64440039b0 0x7f6444003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f6460dc9640 1 -- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f645c0c5b60 msgr2=0x7f6444004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f6460dc9640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f645c0c5b60 0x7f6444004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f6460dc9640 1 -- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64440039b0 msgr2=0x7f6444003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f6460dc9640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64440039b0 0x7f6444003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.328+0000 7f6460dc9640 1 -- 172.21.15.113:0/3157352963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6444003520 con 0x7f6444004d40 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.329+0000 7f6460dc9640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6444004d40 0x7f64440051c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6454009f90 tx=0x7f6444005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa5789e5290689e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.329+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454039070 con 0x7f6444004d40 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.329+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645402cc20 con 0x7f6444004d40 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.329+0000 7f645affd640 1 -- 172.21.15.113:0/3157352963 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454009c10 con 0x7f6444004d40 2024-04-22T06:31:30.331 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.330+0000 7f646282c640 1 -- 172.21.15.113:0/3157352963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6444004d40 msgr2=0x7f64440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.332 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.330+0000 7f646282c640 1 --2- 172.21.15.113:0/3157352963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6444004d40 0x7f64440051c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6454009f90 tx=0x7f6444005830 comp rx=0 tx=0).stop 2024-04-22T06:31:30.332 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.330+0000 7f6460dc9640 1 -- 172.21.15.113:0/3157352963 reap_dead start 2024-04-22T06:31:30.332 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.330+0000 7f646282c640 1 -- 172.21.15.113:0/3157352963 shutdown_connections 2024-04-22T06:31:30.332 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.330+0000 7f646282c640 1 -- 172.21.15.113:0/3157352963 >> 172.21.15.113:0/3157352963 conn(0x7f645c06c070 msgr2=0x7f645c073060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:30.332 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.330+0000 7f646282c640 1 -- 172.21.15.113:0/3157352963 shutdown_connections 2024-04-22T06:31:30.332 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.330+0000 7f646282c640 1 -- 172.21.15.113:0/3157352963 wait complete. 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.331+0000 7f646282c640 1 Processor -- start 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.331+0000 7f646282c640 1 -- start start 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f646282c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6444004d40 0x7f645c0b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f646282c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f645c0b3250 0x7f645c1f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f646282c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f645c1f25a0 0x7f645c1f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f646282c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f645c0c5f80 con 0x7f645c0b3250 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f646282c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f645c0c6260 con 0x7f645c1f25a0 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f646282c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f645c155780 con 0x7f6444004d40 2024-04-22T06:31:30.335 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f645c0b3250 0x7f645c1f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f645c0b3250 0x7f645c1f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55694/0 (socket says 172.21.15.113:55694) 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645b7fe640 1 -- 172.21.15.113:0/719416909 learned_addr learned my addr 172.21.15.113:0/719416909 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645bfff640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6444004d40 0x7f645c0b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f6460dc9640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f645c1f25a0 0x7f645c1f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645b7fe640 1 -- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6444004d40 msgr2=0x7f645c0b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645b7fe640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6444004d40 0x7f645c0b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645b7fe640 1 -- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f645c1f25a0 msgr2=0x7f645c1f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645b7fe640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f645c1f25a0 0x7f645c1f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f645b7fe640 1 -- 172.21.15.113:0/719416909 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c156810 con 0x7f645c0b3250 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.332+0000 7f6460dc9640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f645c1f25a0 0x7f645c1f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.333+0000 7f645b7fe640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f645c0b3250 0x7f645c1f2060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f64500119a0 tx=0x7f6450011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.333+0000 7f6458ff9640 1 -- 172.21.15.113:0/719416909 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645000f9d0 con 0x7f645c0b3250 2024-04-22T06:31:30.336 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.333+0000 7f6458ff9640 1 -- 172.21.15.113:0/719416909 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645000fb70 con 0x7f645c0b3250 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.333+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c156af0 con 0x7f645c0b3250 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.333+0000 7f6458ff9640 1 -- 172.21.15.113:0/719416909 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450014440 con 0x7f645c0b3250 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.333+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c1570b0 con 0x7f645c0b3250 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.334+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645c1f2980 con 0x7f645c0b3250 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.334+0000 7f6458ff9640 1 -- 172.21.15.113:0/719416909 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6450012040 con 0x7f645c0b3250 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.335+0000 7f6458ff9640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f644806c920 0x7f644806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.335+0000 7f645bfff640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f644806c920 0x7f644806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.335+0000 7f6458ff9640 1 -- 172.21.15.113:0/719416909 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f645008bec0 con 0x7f645c0b3250 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.335+0000 7f645bfff640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f644806c920 0x7f644806ede0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f644c007d70 tx=0x7f644c0078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.337 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.339+0000 7f6458ff9640 1 -- 172.21.15.113:0/719416909 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f645c1f2980 con 0x7f645c0b3250 2024-04-22T06:31:30.513 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.514+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f645c14f420 con 0x7f645c0b3250 2024-04-22T06:31:30.513 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.515+0000 7f6458ff9640 1 -- 172.21.15.113:0/719416909 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7f6450019030 con 0x7f645c0b3250 2024-04-22T06:31:30.514 INFO:teuthology.misc.health.smithi113.stdout: 2024-04-22T06:31:30.514 INFO:teuthology.misc.health.smithi113.stdout:{"epoch":16,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:27.086857+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:30.515 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f644806c920 msgr2=0x7f644806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f644806c920 0x7f644806ede0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f644c007d70 tx=0x7f644c0078f0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f645c0b3250 msgr2=0x7f645c1f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f645c0b3250 0x7f645c1f2060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f64500119a0 tx=0x7f6450011da0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 shutdown_connections 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f645c1f25a0 0x7f645c1f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f644806c920 0x7f644806ede0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f645c0b3250 0x7f645c1f2060 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 --2- 172.21.15.113:0/719416909 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6444004d40 0x7f645c0b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 >> 172.21.15.113:0/719416909 conn(0x7f645c06c070 msgr2=0x7f645c0cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 shutdown_connections 2024-04-22T06:31:30.516 INFO:teuthology.misc.health.smithi113.stderr:2024-04-22T06:31:30.517+0000 7f646282c640 1 -- 172.21.15.113:0/719416909 wait complete. 2024-04-22T06:31:30.525 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-22T06:31:30.525 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-22T06:31:30.525 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-22T06:31:30.526 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-22T06:31:30.528 INFO:tasks.ceph.mds.a:Started 2024-04-22T06:31:30.528 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-22T06:31:30.528 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-22T06:31:30.530 INFO:tasks.ceph.mds.c:Started 2024-04-22T06:31:30.530 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-22T06:31:30.530 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-22T06:31:30.532 INFO:tasks.ceph.mds.e:Started 2024-04-22T06:31:30.532 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-22T06:31:30.532 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-22T06:31:30.535 INFO:tasks.ceph.mds.b:Started 2024-04-22T06:31:30.535 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-22T06:31:30.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-22T06:31:30.538 INFO:tasks.ceph.mds.d:Started 2024-04-22T06:31:30.538 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-22T06:31:30.538 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-22T06:31:30.540 INFO:tasks.ceph.mds.f:Started 2024-04-22T06:31:30.540 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-22T06:31:30.540 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:30.602 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2024-04-22T06:31:30.604 INFO:tasks.ceph.mds.e.smithi113.stdout:starting mds.e at 2024-04-22T06:31:30.605 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2024-04-22T06:31:30.619 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2024-04-22T06:31:30.619 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2024-04-22T06:31:30.621 INFO:tasks.ceph.mds.f.smithi145.stdout:starting mds.f at 2024-04-22T06:31:30.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.646+0000 7fa521a25640 1 Processor -- start 2024-04-22T06:31:30.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa521a25640 1 -- start start 2024-04-22T06:31:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa521a25640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa51c1553a0 0x7fa51c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa521a25640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa51c15bb80 0x7fa51c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa521a25640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa51c06c850 con 0x7fa51c0c8070 2024-04-22T06:31:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa521a25640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fa51c06cb30 con 0x7fa51c15bb80 2024-04-22T06:31:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa521a25640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fa51c06ce10 con 0x7fa51c1553a0 2024-04-22T06:31:30.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa51b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa51c15bb80 0x7fa51c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa51a7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa51c0c8070 0x7fa51c0ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54968/0 (socket says 172.21.15.113:54968) 2024-04-22T06:31:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa51a7fc640 1 -- 172.21.15.113:0/3421157474 learned_addr learned my addr 172.21.15.113:0/3421157474 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.647+0000 7fa51b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa51c15bb80 0x7fa51c0c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55742/0 (socket says 172.21.15.113:55742) 2024-04-22T06:31:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.648+0000 7fa51b7fe640 1 -- 172.21.15.113:0/3421157474 >> v2:172.21.15.145:3300/0 conn(0x7fa51c1553a0 msgr2=0x7fa51c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.648+0000 7fa51b7fe640 1 --2- 172.21.15.113:0/3421157474 >> v2:172.21.15.145:3300/0 conn(0x7fa51c1553a0 0x7fa51c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.648+0000 7fa51b7fe640 1 -- 172.21.15.113:0/3421157474 >> v1:172.21.15.113:6789/0 conn(0x7fa51c0c8070 legacy=0x7fa51c0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.648+0000 7fa51b7fe640 1 -- 172.21.15.113:0/3421157474 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c06d0f0 con 0x7fa51c15bb80 2024-04-22T06:31:30.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.648+0000 7fa51b7fe640 1 --2- 172.21.15.113:0/3421157474 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c15bb80 0x7fa51c0c8c40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa51c06db00 tx=0x7fa51402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ae2a76d21432b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa519ffb640 1 -- 172.21.15.113:0/3421157474 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514039070 con 0x7fa51c15bb80 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa519ffb640 1 -- 172.21.15.113:0/3421157474 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51402cd00 con 0x7fa51c15bb80 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa519ffb640 1 -- 172.21.15.113:0/3421157474 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514034660 con 0x7fa51c15bb80 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa521a25640 1 -- 172.21.15.113:0/3421157474 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c15bb80 msgr2=0x7fa51c0c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa521a25640 1 --2- 172.21.15.113:0/3421157474 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c15bb80 0x7fa51c0c8c40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa51c06db00 tx=0x7fa51402bf50 comp rx=0 tx=0).stop 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa521a25640 1 -- 172.21.15.113:0/3421157474 shutdown_connections 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa521a25640 1 --2- 172.21.15.113:0/3421157474 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c15bb80 0x7fa51c0c8c40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa521a25640 1 --2- 172.21.15.113:0/3421157474 >> v2:172.21.15.145:3300/0 conn(0x7fa51c1553a0 0x7fa51c0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa521a25640 1 -- 172.21.15.113:0/3421157474 >> 172.21.15.113:0/3421157474 conn(0x7fa51c073010 msgr2=0x7fa51c073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa521a25640 1 -- 172.21.15.113:0/3421157474 shutdown_connections 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.649+0000 7fa521a25640 1 -- 172.21.15.113:0/3421157474 wait complete. 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.650+0000 7fa521a25640 1 Processor -- start 2024-04-22T06:31:30.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.650+0000 7fa521a25640 1 -- start start 2024-04-22T06:31:30.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa521a25640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa51c0c8070 0x7fa51c0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa521a25640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c1553a0 0x7fa51c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa521a25640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa51c15bb80 0x7fa51c157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa521a25640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c0cd4d0 con 0x7fa51c1553a0 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa521a25640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c155780 con 0x7fa51c15bb80 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa521a25640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa51c0cd650 con 0x7fa51c0c8070 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa51a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c1553a0 0x7fa51c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa51a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c1553a0 0x7fa51c0c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55750/0 (socket says 172.21.15.113:55750) 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa51a7fc640 1 -- 172.21.15.113:0/2431979619 learned_addr learned my addr 172.21.15.113:0/2431979619 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa51b7fe640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa51c15bb80 0x7fa51c157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.651+0000 7fa51affd640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa51c0c8070 0x7fa51c0c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa51a7fc640 1 -- 172.21.15.113:0/2431979619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa51c0c8070 msgr2=0x7fa51c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa51a7fc640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa51c0c8070 0x7fa51c0c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa51a7fc640 1 -- 172.21.15.113:0/2431979619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa51c15bb80 msgr2=0x7fa51c157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa51a7fc640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa51c15bb80 0x7fa51c157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa51a7fc640 1 -- 172.21.15.113:0/2431979619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c1563d0 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa51a7fc640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c1553a0 0x7fa51c0c4f70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c400 tx=0x7fa50c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa503fff640 1 -- 172.21.15.113:0/2431979619 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c017070 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa503fff640 1 -- 172.21.15.113:0/2431979619 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c005ce0 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c156690 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa503fff640 1 -- 172.21.15.113:0/2431979619 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0072f0 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.652+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c156c50 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.653+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51c068e40 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.653+0000 7fa503fff640 1 -- 172.21.15.113:0/2431979619 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa50c01a070 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.654+0000 7fa503fff640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa50806c8f0 0x7fa50806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.654+0000 7fa51affd640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa50806c8f0 0x7fa50806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.654+0000 7fa503fff640 1 -- 172.21.15.113:0/2431979619 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa50c08ab40 con 0x7fa51c1553a0 2024-04-22T06:31:30.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.654+0000 7fa51affd640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa50806c8f0 0x7fa50806edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa510009990 tx=0x7fa510009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.658+0000 7fa503fff640 1 -- 172.21.15.113:0/2431979619 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa50c058bd0 con 0x7fa51c1553a0 2024-04-22T06:31:30.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.834+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa51c069440 con 0x7fa51c1553a0 2024-04-22T06:31:30.833 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.834+0000 7fa503fff640 1 -- 172.21.15.113:0/2431979619 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7fa50c05ced0 con 0x7fa51c1553a0 2024-04-22T06:31:30.833 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:30.833 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:27.086857+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:30.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa50806c8f0 msgr2=0x7fa50806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa50806c8f0 0x7fa50806edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa510009990 tx=0x7fa510009110 comp rx=0 tx=0).stop 2024-04-22T06:31:30.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c1553a0 msgr2=0x7fa51c0c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c1553a0 0x7fa51c0c4f70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c400 tx=0x7fa50c00c800 comp rx=0 tx=0).stop 2024-04-22T06:31:30.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 shutdown_connections 2024-04-22T06:31:30.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa51c15bb80 0x7fa51c157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa50806c8f0 0x7fa50806edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa51c1553a0 0x7fa51c0c4f70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 --2- 172.21.15.113:0/2431979619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa51c0c8070 0x7fa51c0c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.836+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 >> 172.21.15.113:0/2431979619 conn(0x7fa51c073010 msgr2=0x7fa51c0733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:30.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.837+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 shutdown_connections 2024-04-22T06:31:30.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.837+0000 7fa521a25640 1 -- 172.21.15.113:0/2431979619 wait complete. 2024-04-22T06:31:30.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T06:31:30.846 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:31:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.947+0000 7fb857d15640 1 Processor -- start 2024-04-22T06:31:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.947+0000 7fb857d15640 1 -- start start 2024-04-22T06:31:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb857d15640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb8500caa30 0x7fb8500d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb857d15640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb8500b3c90 0x7fb8500d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb857d15640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85015f580 con 0x7fb8500b3870 2024-04-22T06:31:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb857d15640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb8500cc840 con 0x7fb8500b3c90 2024-04-22T06:31:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb857d15640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb8500cb6b0 con 0x7fb8500caa30 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb8562b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb8500b3c90 0x7fb8500d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb8562b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb8500b3c90 0x7fb8500d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55756/0 (socket says 172.21.15.113:55756) 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb8562b2640 1 -- 172.21.15.113:0/1138379346 learned_addr learned my addr 172.21.15.113:0/1138379346 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb855ab1640 1 --2- 172.21.15.113:0/1138379346 >> v2:172.21.15.145:3300/0 conn(0x7fb8500caa30 0x7fb8500d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb8562b2640 1 -- 172.21.15.113:0/1138379346 >> v2:172.21.15.145:3300/0 conn(0x7fb8500caa30 msgr2=0x7fb8500d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb8562b2640 1 --2- 172.21.15.113:0/1138379346 >> v2:172.21.15.145:3300/0 conn(0x7fb8500caa30 0x7fb8500d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb8562b2640 1 -- 172.21.15.113:0/1138379346 >> v1:172.21.15.113:6789/0 conn(0x7fb8500b3870 legacy=0x7fb85015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb8562b2640 1 -- 172.21.15.113:0/1138379346 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8500cb990 con 0x7fb8500b3c90 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb854aaf640 1 -- 172.21.15.113:0/1138379346 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852572176 0 0) 0x7fb85015f580 con 0x7fb8500b3870 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.948+0000 7fb855ab1640 1 --2- 172.21.15.113:0/1138379346 >> v2:172.21.15.145:3300/0 conn(0x7fb8500caa30 0x7fb8500d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb8562b2640 1 --2- 172.21.15.113:0/1138379346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3c90 0x7fb8500d0e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8500ce430 tx=0x7fb84802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b2ce2e033481a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb854aaf640 1 -- 172.21.15.113:0/1138379346 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84802cb20 con 0x7fb8500b3c90 2024-04-22T06:31:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb854aaf640 1 -- 172.21.15.113:0/1138379346 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84802ccc0 con 0x7fb8500b3c90 2024-04-22T06:31:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb854aaf640 1 -- 172.21.15.113:0/1138379346 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848034610 con 0x7fb8500b3c90 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb857d15640 1 -- 172.21.15.113:0/1138379346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3c90 msgr2=0x7fb8500d0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb857d15640 1 --2- 172.21.15.113:0/1138379346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3c90 0x7fb8500d0e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8500ce430 tx=0x7fb84802bf80 comp rx=0 tx=0).stop 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb857d15640 1 -- 172.21.15.113:0/1138379346 shutdown_connections 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb857d15640 1 --2- 172.21.15.113:0/1138379346 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3c90 0x7fb8500d0e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb857d15640 1 --2- 172.21.15.113:0/1138379346 >> v2:172.21.15.145:3300/0 conn(0x7fb8500caa30 0x7fb8500d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.949+0000 7fb857d15640 1 -- 172.21.15.113:0/1138379346 >> 172.21.15.113:0/1138379346 conn(0x7fb850068360 msgr2=0x7fb850074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.950+0000 7fb857d15640 1 -- 172.21.15.113:0/1138379346 shutdown_connections 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.950+0000 7fb857d15640 1 -- 172.21.15.113:0/1138379346 wait complete. 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb857d15640 1 Processor -- start 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb857d15640 1 -- start start 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb857d15640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3870 0x7fb8501f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb857d15640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8500b3c90 0x7fb8501571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb857d15640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8500caa30 0x7fb850157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb857d15640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb85015f1b0 con 0x7fb8500b3870 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb857d15640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb8500cc4d0 con 0x7fb8500b3c90 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb857d15640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb85015f330 con 0x7fb8500caa30 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb855ab1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3870 0x7fb8501f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb855ab1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3870 0x7fb8501f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55766/0 (socket says 172.21.15.113:55766) 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.951+0000 7fb855ab1640 1 -- 172.21.15.113:0/4253884385 learned_addr learned my addr 172.21.15.113:0/4253884385 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb8562b2640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8500caa30 0x7fb850157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb8552b0640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8500b3c90 0x7fb8501571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb855ab1640 1 -- 172.21.15.113:0/4253884385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8500caa30 msgr2=0x7fb850157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb855ab1640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8500caa30 0x7fb850157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb855ab1640 1 -- 172.21.15.113:0/4253884385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8500b3c90 msgr2=0x7fb8501571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:30.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb855ab1640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8500b3c90 0x7fb8501571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb855ab1640 1 -- 172.21.15.113:0/4253884385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb850155ba0 con 0x7fb8500b3870 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb855ab1640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3870 0x7fb8501f2030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00e810 tx=0x7fb84c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb8467fc640 1 -- 172.21.15.113:0/4253884385 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00f040 con 0x7fb8500b3870 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb8467fc640 1 -- 172.21.15.113:0/4253884385 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c004030 con 0x7fb8500b3870 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb850155e60 con 0x7fb8500b3870 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb8467fc640 1 -- 172.21.15.113:0/4253884385 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c004400 con 0x7fb8500b3870 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.952+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb850156420 con 0x7fb8500b3870 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.953+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85015f580 con 0x7fb8500b3870 2024-04-22T06:31:30.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.953+0000 7fb8467fc640 1 -- 172.21.15.113:0/4253884385 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb84c00c6d0 con 0x7fb8500b3870 2024-04-22T06:31:30.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.954+0000 7fb8467fc640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb83406c8f0 0x7fb83406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:30.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.954+0000 7fb8467fc640 1 -- 172.21.15.113:0/4253884385 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb84c08b6a0 con 0x7fb8500b3870 2024-04-22T06:31:30.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.954+0000 7fb8552b0640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb83406c8f0 0x7fb83406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:30.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.954+0000 7fb8552b0640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb83406c8f0 0x7fb83406edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb840007fd0 tx=0x7fb840009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:30.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:30.958+0000 7fb8467fc640 1 -- 172.21.15.113:0/4253884385 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb85015f580 con 0x7fb8500b3870 2024-04-22T06:31:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.130+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb850068f50 con 0x7fb8500b3870 2024-04-22T06:31:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.131+0000 7fb8467fc640 1 -- 172.21.15.113:0/4253884385 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fb84c017020 con 0x7fb8500b3870 2024-04-22T06:31:31.129 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:31:31.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb83406c8f0 msgr2=0x7fb83406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:31.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb83406c8f0 0x7fb83406edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb840007fd0 tx=0x7fb840009040 comp rx=0 tx=0).stop 2024-04-22T06:31:31.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3870 msgr2=0x7fb8501f2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:31.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3870 0x7fb8501f2030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00e810 tx=0x7fb84c00ecd0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 shutdown_connections 2024-04-22T06:31:31.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb8500caa30 0x7fb850157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8500b3c90 0x7fb8501571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb83406c8f0 0x7fb83406edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 --2- 172.21.15.113:0/4253884385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8500b3870 0x7fb8501f2030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 >> 172.21.15.113:0/4253884385 conn(0x7fb850068360 msgr2=0x7fb8500c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:31.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 shutdown_connections 2024-04-22T06:31:31.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.133+0000 7fb857d15640 1 -- 172.21.15.113:0/4253884385 wait complete. 2024-04-22T06:31:31.142 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:31:31.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.239+0000 7f1b35e69640 1 Processor -- start 2024-04-22T06:31:31.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.239+0000 7f1b35e69640 1 -- start start 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.239+0000 7f1b35e69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b30155550 0x7f1b3015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.239+0000 7f1b35e69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b300c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.239+0000 7f1b35e69640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b300ccf00 con 0x7f1b30155170 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.239+0000 7f1b35e69640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b300cddf0 con 0x7f1b30155550 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.239+0000 7f1b35e69640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3015f430 con 0x7f1b300cb9e0 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2ffff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b300c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b30155550 0x7f1b3015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2f7fe640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f1b30155170 0x7f1b300d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:36986/0 (socket says 172.21.15.113:36986) 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b30155550 0x7f1b3015eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57992/0 (socket says 172.21.15.113:57992) 2024-04-22T06:31:31.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2ffff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b300c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:41164/0 (socket says 172.21.15.113:41164) 2024-04-22T06:31:31.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2f7fe640 1 -- 172.21.15.113:0/2354193750 learned_addr learned my addr 172.21.15.113:0/2354193750 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:31.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2effd640 1 -- 172.21.15.113:0/2354193750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 msgr2=0x7f1b300c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:31.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2effd640 1 --2- 172.21.15.113:0/2354193750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b300c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2effd640 1 -- 172.21.15.113:0/2354193750 >> v1:172.21.15.145:6789/0 conn(0x7f1b30155170 legacy=0x7f1b300d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:31.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2effd640 1 -- 172.21.15.113:0/2354193750 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b300cd1e0 con 0x7f1b30155550 2024-04-22T06:31:31.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.240+0000 7f1b2ffff640 1 --2- 172.21.15.113:0/2354193750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b300c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:31.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.241+0000 7f1b2effd640 1 --2- 172.21.15.113:0/2354193750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155550 0x7f1b3015eef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b180097a0 tx=0x7f1b1802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14695cbbd0e958ef server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:31.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.241+0000 7f1b2e7fc640 1 -- 172.21.15.113:0/2354193750 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18035020 con 0x7f1b30155550 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.241+0000 7f1b2e7fc640 1 -- 172.21.15.113:0/2354193750 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b18031810 con 0x7f1b30155550 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.241+0000 7f1b2e7fc640 1 -- 172.21.15.113:0/2354193750 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18031be0 con 0x7f1b30155550 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.242+0000 7f1b35e69640 1 -- 172.21.15.113:0/2354193750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155550 msgr2=0x7f1b3015eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.242+0000 7f1b35e69640 1 --2- 172.21.15.113:0/2354193750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155550 0x7f1b3015eef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b180097a0 tx=0x7f1b1802b8b0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.242+0000 7f1b35e69640 1 -- 172.21.15.113:0/2354193750 shutdown_connections 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.242+0000 7f1b35e69640 1 --2- 172.21.15.113:0/2354193750 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b300c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.242+0000 7f1b35e69640 1 --2- 172.21.15.113:0/2354193750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155550 0x7f1b3015eef0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.242+0000 7f1b35e69640 1 -- 172.21.15.113:0/2354193750 >> 172.21.15.113:0/2354193750 conn(0x7f1b30072570 msgr2=0x7f1b30074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.242+0000 7f1b35e69640 1 -- 172.21.15.113:0/2354193750 shutdown_connections 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.242+0000 7f1b35e69640 1 -- 172.21.15.113:0/2354193750 wait complete. 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.243+0000 7f1b35e69640 1 Processor -- start 2024-04-22T06:31:31.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.243+0000 7f1b35e69640 1 -- start start 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b35e69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b301f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b35e69640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155170 0x7f1b3014c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b35e69640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1b30155550 0x7f1b3015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b35e69640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300cda80 con 0x7f1b30155550 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b35e69640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300cd7a0 con 0x7f1b30155170 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b35e69640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b300ccae0 con 0x7f1b300cb9e0 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1b30155550 0x7f1b3015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1b30155550 0x7f1b3015b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55772/0 (socket says 172.21.15.113:55772) 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 -- 172.21.15.113:0/3579049852 learned_addr learned my addr 172.21.15.113:0/3579049852 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2f7fe640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b301f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2effd640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155170 0x7f1b3014c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 -- 172.21.15.113:0/3579049852 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 msgr2=0x7f1b301f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b301f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 -- 172.21.15.113:0/3579049852 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155170 msgr2=0x7f1b3014c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155170 0x7f1b3014c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 -- 172.21.15.113:0/3579049852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3014cc00 con 0x7f1b30155550 2024-04-22T06:31:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b2ffff640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1b30155550 0x7f1b3015b290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800e880 tx=0x7f1b2800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b27fff640 1 -- 172.21.15.113:0/3579049852 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28017070 con 0x7f1b30155550 2024-04-22T06:31:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b27fff640 1 -- 172.21.15.113:0/3579049852 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2800c940 con 0x7f1b30155550 2024-04-22T06:31:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3014cee0 con 0x7f1b30155550 2024-04-22T06:31:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b27fff640 1 -- 172.21.15.113:0/3579049852 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800cd30 con 0x7f1b30155550 2024-04-22T06:31:31.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.244+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b301588b0 con 0x7f1b30155550 2024-04-22T06:31:31.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.246+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b30068e40 con 0x7f1b30155550 2024-04-22T06:31:31.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.246+0000 7f1b27fff640 1 -- 172.21.15.113:0/3579049852 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b2801a070 con 0x7f1b30155550 2024-04-22T06:31:31.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.246+0000 7f1b27fff640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1b1006c8f0 0x7f1b1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:31.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.246+0000 7f1b27fff640 1 -- 172.21.15.113:0/3579049852 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1b2808b9c0 con 0x7f1b30155550 2024-04-22T06:31:31.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.246+0000 7f1b2f7fe640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1b1006c8f0 0x7f1b1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:31.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.247+0000 7f1b2f7fe640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1b1006c8f0 0x7f1b1006edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1b200012e0 tx=0x7f1b20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:31.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.251+0000 7f1b27fff640 1 -- 172.21.15.113:0/3579049852 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b2808de20 con 0x7f1b30155550 2024-04-22T06:31:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.462+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b300b3000 con 0x7f1b30155550 2024-04-22T06:31:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.462+0000 7f1b27fff640 1 -- 172.21.15.113:0/3579049852 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f1b2805a140 con 0x7f1b30155550 2024-04-22T06:31:31.461 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:31.461 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-22T06:31:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 2 2024-04-22T06:31:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1b1006c8f0 msgr2=0x7f1b1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1b1006c8f0 0x7f1b1006edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1b200012e0 tx=0x7f1b20009040 comp rx=0 tx=0).stop 2024-04-22T06:31:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1b30155550 msgr2=0x7f1b3015b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1b30155550 0x7f1b3015b290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800e880 tx=0x7f1b2800ed40 comp rx=0 tx=0).stop 2024-04-22T06:31:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 shutdown_connections 2024-04-22T06:31:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1b1006c8f0 0x7f1b1006edb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1b30155550 0x7f1b3015b290 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b30155170 0x7f1b3014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 --2- 172.21.15.113:0/3579049852 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b300cb9e0 0x7f1b301f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 >> 172.21.15.113:0/3579049852 conn(0x7f1b30072570 msgr2=0x7f1b300cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.464+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 shutdown_connections 2024-04-22T06:31:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:31.465+0000 7f1b35e69640 1 -- 172.21.15.113:0/3579049852 wait complete. 2024-04-22T06:31:33.474 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:31:33.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.583+0000 7f7d990eb640 1 Processor -- start 2024-04-22T06:31:33.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.583+0000 7f7d990eb640 1 -- start start 2024-04-22T06:31:33.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.583+0000 7f7d990eb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7d940c5f20 0x7f7d9415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.583+0000 7f7d990eb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940ccf00 con 0x7f7d94155170 2024-04-22T06:31:33.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.583+0000 7f7d990eb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940cd1e0 con 0x7f7d94155550 2024-04-22T06:31:33.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.583+0000 7f7d990eb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7d940cddf0 con 0x7f7d940c5f20 2024-04-22T06:31:33.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.584+0000 7f7d9359e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7d940c5f20 0x7f7d9415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.584+0000 7f7d92d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7d94155170 0x7f7d940d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54986/0 (socket says 172.21.15.113:54986) 2024-04-22T06:31:33.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.584+0000 7f7d92d9d640 1 -- 172.21.15.113:0/4239434799 learned_addr learned my addr 172.21.15.113:0/4239434799 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:33.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.584+0000 7f7d9359e640 1 -- 172.21.15.113:0/4239434799 >> v1:172.21.15.145:6789/0 conn(0x7f7d94155550 legacy=0x7f7d940c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:33.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.584+0000 7f7d9359e640 1 -- 172.21.15.113:0/4239434799 >> v1:172.21.15.113:6789/0 conn(0x7f7d94155170 legacy=0x7f7d940d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.584+0000 7f7d9359e640 1 -- 172.21.15.113:0/4239434799 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d940cd4c0 con 0x7f7d940c5f20 2024-04-22T06:31:33.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d9359e640 1 --2- 172.21.15.113:0/4239434799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d940c5f20 0x7f7d9415eef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d840097a0 tx=0x7f7d8402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c1ca300c7bb836 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:33.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d91d9b640 1 -- 172.21.15.113:0/4239434799 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84035020 con 0x7f7d940c5f20 2024-04-22T06:31:33.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d91d9b640 1 -- 172.21.15.113:0/4239434799 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d84031830 con 0x7f7d940c5f20 2024-04-22T06:31:33.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d91d9b640 1 -- 172.21.15.113:0/4239434799 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84031c00 con 0x7f7d940c5f20 2024-04-22T06:31:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d990eb640 1 -- 172.21.15.113:0/4239434799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d940c5f20 msgr2=0x7f7d9415eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d990eb640 1 --2- 172.21.15.113:0/4239434799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d940c5f20 0x7f7d9415eef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d840097a0 tx=0x7f7d8402b8d0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d990eb640 1 -- 172.21.15.113:0/4239434799 shutdown_connections 2024-04-22T06:31:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d990eb640 1 --2- 172.21.15.113:0/4239434799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d940c5f20 0x7f7d9415eef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d990eb640 1 -- 172.21.15.113:0/4239434799 >> 172.21.15.113:0/4239434799 conn(0x7f7d94072570 msgr2=0x7f7d94074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:33.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d990eb640 1 -- 172.21.15.113:0/4239434799 shutdown_connections 2024-04-22T06:31:33.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.585+0000 7f7d990eb640 1 -- 172.21.15.113:0/4239434799 wait complete. 2024-04-22T06:31:33.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.587+0000 7f7d990eb640 1 Processor -- start 2024-04-22T06:31:33.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.587+0000 7f7d990eb640 1 -- start start 2024-04-22T06:31:33.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d990eb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d94155170 0x7f7d941f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d990eb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d94155550 0x7f7d9414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d990eb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d941598c0 0x7f7d940b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d990eb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f7d940cda80 con 0x7f7d94155170 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d990eb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9415f430 con 0x7f7d941598c0 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d990eb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7d940ccae0 con 0x7f7d94155550 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d94155170 0x7f7d941f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d94155170 0x7f7d941f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55790/0 (socket says 172.21.15.113:55790) 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 -- 172.21.15.113:0/286787374 learned_addr learned my addr 172.21.15.113:0/286787374 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d9359e640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d941598c0 0x7f7d940b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 -- 172.21.15.113:0/286787374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d94155550 msgr2=0x7f7d9414ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d94155550 0x7f7d9414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 -- 172.21.15.113:0/286787374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d941598c0 msgr2=0x7f7d940b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d941598c0 0x7f7d940b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 -- 172.21.15.113:0/286787374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d94158ed0 con 0x7f7d94155170 2024-04-22T06:31:33.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d92d9d640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d94155170 0x7f7d941f18f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00cb40 tx=0x7f7d8c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:33.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d7b7fe640 1 -- 172.21.15.113:0/286787374 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c017070 con 0x7f7d94155170 2024-04-22T06:31:33.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d7b7fe640 1 -- 172.21.15.113:0/286787374 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c00ac40 con 0x7f7d94155170 2024-04-22T06:31:33.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d7b7fe640 1 -- 172.21.15.113:0/286787374 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c012400 con 0x7f7d94155170 2024-04-22T06:31:33.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d941f5090 con 0x7f7d94155170 2024-04-22T06:31:33.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.588+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d941515b0 con 0x7f7d94155170 2024-04-22T06:31:33.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.589+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d94068e40 con 0x7f7d94155170 2024-04-22T06:31:33.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.590+0000 7f7d7b7fe640 1 -- 172.21.15.113:0/286787374 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d8c01a070 con 0x7f7d94155170 2024-04-22T06:31:33.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.590+0000 7f7d7b7fe640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7d8006c920 0x7f7d8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.590+0000 7f7d7b7fe640 1 -- 172.21.15.113:0/286787374 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7d8c08b500 con 0x7f7d94155170 2024-04-22T06:31:33.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.590+0000 7f7d9259c640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7d8006c920 0x7f7d8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.591+0000 7f7d9259c640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7d8006c920 0x7f7d8006ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d88006fd0 tx=0x7f7d88006bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:33.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.595+0000 7f7d7b7fe640 1 -- 172.21.15.113:0/286787374 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d8c059d10 con 0x7f7d94155170 2024-04-22T06:31:33.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.811+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d940b3210 con 0x7f7d94155170 2024-04-22T06:31:33.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.812+0000 7f7d7b7fe640 1 -- 172.21.15.113:0/286787374 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5518 (secure 0 0 0) 0x7f7d8c059610 con 0x7f7d94155170 2024-04-22T06:31:33.811 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:33.811 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4308,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-22T06:31:33.812 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 3 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7d8006c920 msgr2=0x7f7d8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7d8006c920 0x7f7d8006ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d88006fd0 tx=0x7f7d88006bc0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d94155170 msgr2=0x7f7d941f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d94155170 0x7f7d941f18f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00cb40 tx=0x7f7d8c00a060 comp rx=0 tx=0).stop 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 shutdown_connections 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d941598c0 0x7f7d940b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7d94155550 0x7f7d9414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7d8006c920 0x7f7d8006ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 --2- 172.21.15.113:0/286787374 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d94155170 0x7f7d941f18f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 >> 172.21.15.113:0/286787374 conn(0x7f7d94072570 msgr2=0x7f7d94151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:33.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 shutdown_connections 2024-04-22T06:31:33.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.814+0000 7f7d990eb640 1 -- 172.21.15.113:0/286787374 wait complete. 2024-04-22T06:31:33.824 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:33.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.921+0000 7f2f7f843640 1 Processor -- start 2024-04-22T06:31:33.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.922+0000 7f2f7f843640 1 -- start start 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.922+0000 7f2f7f843640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 0x7f2f7815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.922+0000 7f2f7f843640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2f78155550 0x7f2f780d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.922+0000 7f2f7f843640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f780ccf00 con 0x7f2f780cb9e0 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.922+0000 7f2f7f843640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f2f780cddf0 con 0x7f2f78155550 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.922+0000 7f2f7f843640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7815f430 con 0x7f2f78155170 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.922+0000 7f2f7dde0640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2f780cb9e0 0x7f2f780c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54996/0 (socket says 172.21.15.113:54996) 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.922+0000 7f2f7dde0640 1 -- 172.21.15.113:0/3313815060 learned_addr learned my addr 172.21.15.113:0/3313815060 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 0x7f2f7815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641819849 0 0) 0x7f2f780ccf00 con 0x7f2f780cb9e0 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7cdde640 1 --2- 172.21.15.113:0/3313815060 >> v2:172.21.15.145:3300/0 conn(0x7f2f78155550 0x7f2f780d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f64003520 con 0x7f2f780cb9e0 2024-04-22T06:31:33.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3441423664 0 0) 0x7f2f64003520 con 0x7f2f780cb9e0 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 msgr2=0x7f2f7815eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 0x7f2f7815eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 >> v2:172.21.15.145:3300/0 conn(0x7f2f78155550 msgr2=0x7f2f780d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 --2- 172.21.15.113:0/3313815060 >> v2:172.21.15.145:3300/0 conn(0x7f2f78155550 0x7f2f780d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f780cd1e0 con 0x7f2f780cb9e0 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f2f700019f0 con 0x7f2f780cb9e0 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 0x7f2f7815eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7cdde640 1 --2- 172.21.15.113:0/3313815060 >> v2:172.21.15.145:3300/0 conn(0x7f2f78155550 0x7f2f780d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 >> v1:172.21.15.113:6789/0 conn(0x7f2f780cb9e0 legacy=0x7f2f780c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f640039b0 0x7f2f64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f64004800 0x7f2f64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 0x7f2f640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2f780cddf0 con 0x7f2f640039b0 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7815f430 con 0x7f2f64004800 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6400baf0 con 0x7f2f78155170 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f640039b0 0x7f2f64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7cdde640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f64004800 0x7f2f64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7dde0640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 0x7f2f640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7d5df640 1 -- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 msgr2=0x7f2f640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 0x7f2f640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7d5df640 1 -- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f64004800 msgr2=0x7f2f64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f64004800 0x7f2f64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7d5df640 1 -- 172.21.15.113:0/3313815060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f64003520 con 0x7f2f640039b0 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.923+0000 7f2f7dde0640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f78155170 0x7f2f640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.924+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f640039b0 0x7f2f64003dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f68006fd0 tx=0x7f2f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afd3b52e28efc54 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.924+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800f040 con 0x7f2f640039b0 2024-04-22T06:31:33.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.924+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f68004230 con 0x7f2f640039b0 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.924+0000 7f2f6ffff640 1 -- 172.21.15.113:0/3313815060 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68003610 con 0x7f2f640039b0 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.925+0000 7f2f7f843640 1 -- 172.21.15.113:0/3313815060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f640039b0 msgr2=0x7f2f64003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.925+0000 7f2f7f843640 1 --2- 172.21.15.113:0/3313815060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f640039b0 0x7f2f64003dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f68006fd0 tx=0x7f2f64005830 comp rx=0 tx=0).stop 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.925+0000 7f2f7dde0640 1 -- 172.21.15.113:0/3313815060 reap_dead start 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.925+0000 7f2f7f843640 1 -- 172.21.15.113:0/3313815060 shutdown_connections 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.925+0000 7f2f7f843640 1 -- 172.21.15.113:0/3313815060 >> 172.21.15.113:0/3313815060 conn(0x7f2f78072570 msgr2=0x7f2f78074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.925+0000 7f2f7f843640 1 -- 172.21.15.113:0/3313815060 shutdown_connections 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.925+0000 7f2f7f843640 1 -- 172.21.15.113:0/3313815060 wait complete. 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.926+0000 7f2f7f843640 1 Processor -- start 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.926+0000 7f2f7f843640 1 -- start start 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7f843640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f640039b0 0x7f2f781e7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7f843640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f781f0d20 0x7f2f781f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7f843640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f7814e0c0 0x7f2f7815da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7f843640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2f780cda80 con 0x7f2f7814e0c0 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7f843640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f780cd7a0 con 0x7f2f640039b0 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7f843640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2f780ccae0 con 0x7f2f781f0d20 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f7814e0c0 0x7f2f7815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f7814e0c0 0x7f2f7815da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55816/0 (socket says 172.21.15.113:55816) 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 -- 172.21.15.113:0/1229265670 learned_addr learned my addr 172.21.15.113:0/1229265670 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 -- 172.21.15.113:0/1229265670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f781f0d20 msgr2=0x7f2f781f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f781f0d20 0x7f2f781f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f640039b0 0x7f2f781e7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 -- 172.21.15.113:0/1229265670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f640039b0 msgr2=0x7f2f781e7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:33.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f640039b0 0x7f2f781e7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 -- 172.21.15.113:0/1229265670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f781f5170 con 0x7f2f7814e0c0 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7dde0640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f7814e0c0 0x7f2f7815da70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f78075a40 tx=0x7f2f7000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f6dffb640 1 -- 172.21.15.113:0/1229265670 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000eb60 con 0x7f2f7814e0c0 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f6dffb640 1 -- 172.21.15.113:0/1229265670 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7000ed20 con 0x7f2f7814e0c0 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f6dffb640 1 -- 172.21.15.113:0/1229265670 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70014670 con 0x7f2f7814e0c0 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7814e650 con 0x7f2f7814e0c0 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.927+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7814ec10 con 0x7f2f7814e0c0 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.928+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f78068e40 con 0x7f2f7814e0c0 2024-04-22T06:31:33.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.929+0000 7f2f6dffb640 1 -- 172.21.15.113:0/1229265670 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f70014810 con 0x7f2f7814e0c0 2024-04-22T06:31:33.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.929+0000 7f2f6dffb640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2f5c06c8f0 0x7f2f5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:33.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.929+0000 7f2f6dffb640 1 -- 172.21.15.113:0/1229265670 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2f7008b580 con 0x7f2f7814e0c0 2024-04-22T06:31:33.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.929+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2f5c06c8f0 0x7f2f5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:33.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.930+0000 7f2f7d5df640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2f5c06c8f0 0x7f2f5c06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f68035000 tx=0x7f2f6803a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:33.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:33.933+0000 7f2f6dffb640 1 -- 172.21.15.113:0/1229265670 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f70059d00 con 0x7f2f7814e0c0 2024-04-22T06:31:34.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.110+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f780cc2b0 con 0x7f2f7814e0c0 2024-04-22T06:31:34.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.110+0000 7f2f6dffb640 1 -- 172.21.15.113:0/1229265670 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7f2f70059600 con 0x7f2f7814e0c0 2024-04-22T06:31:34.109 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:34.109 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:27.086857+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:34.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2f5c06c8f0 msgr2=0x7f2f5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2f5c06c8f0 0x7f2f5c06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f68035000 tx=0x7f2f6803a040 comp rx=0 tx=0).stop 2024-04-22T06:31:34.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f7814e0c0 msgr2=0x7f2f7815da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f7814e0c0 0x7f2f7815da70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f78075a40 tx=0x7f2f7000e530 comp rx=0 tx=0).stop 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 shutdown_connections 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2f5c06c8f0 0x7f2f5c06edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f7814e0c0 0x7f2f7815da70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f781f0d20 0x7f2f781f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 --2- 172.21.15.113:0/1229265670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f640039b0 0x7f2f781e7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 >> 172.21.15.113:0/1229265670 conn(0x7f2f78072570 msgr2=0x7f2f780b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 shutdown_connections 2024-04-22T06:31:34.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.113+0000 7f2f7f843640 1 -- 172.21.15.113:0/1229265670 wait complete. 2024-04-22T06:31:34.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T06:31:34.122 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:31:34.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.224+0000 7f8da499f640 1 Processor -- start 2024-04-22T06:31:34.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.224+0000 7f8da499f640 1 -- start start 2024-04-22T06:31:34.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8da499f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8da0155250 0x7f8da00cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8da499f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8da015ae90 0x7f8da00cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8da499f640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da00cc490 con 0x7f8da00c5a60 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8da499f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8da00cdc70 con 0x7f8da015ae90 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8da499f640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8da0074d50 con 0x7f8da0155250 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8da015ae90 0x7f8da00cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8da015ae90 0x7f8da00cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55822/0 (socket says 172.21.15.113:55822) 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9ffff640 1 -- 172.21.15.113:0/3179786688 learned_addr learned my addr 172.21.15.113:0/3179786688 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9f7fe640 1 --2- 172.21.15.113:0/3179786688 >> v2:172.21.15.145:3300/0 conn(0x7f8da0155250 0x7f8da00cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9ffff640 1 -- 172.21.15.113:0/3179786688 >> v2:172.21.15.145:3300/0 conn(0x7f8da0155250 msgr2=0x7f8da00cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9ffff640 1 --2- 172.21.15.113:0/3179786688 >> v2:172.21.15.145:3300/0 conn(0x7f8da0155250 0x7f8da00cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9ffff640 1 -- 172.21.15.113:0/3179786688 >> v1:172.21.15.145:6789/0 conn(0x7f8da00c5a60 legacy=0x7f8da00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9ffff640 1 -- 172.21.15.113:0/3179786688 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da015b6d0 con 0x7f8da015ae90 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.225+0000 7f8d9f7fe640 1 --2- 172.21.15.113:0/3179786688 >> v2:172.21.15.145:3300/0 conn(0x7f8da0155250 0x7f8da00cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:34.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.226+0000 7f8d9ffff640 1 --2- 172.21.15.113:0/3179786688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da015ae90 0x7f8da00cb4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8da006c470 tx=0x7f8d9802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4422a92b6ecf1b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.226+0000 7f8d9e7fc640 1 -- 172.21.15.113:0/3179786688 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9802cb20 con 0x7f8da015ae90 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.226+0000 7f8d9e7fc640 1 -- 172.21.15.113:0/3179786688 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9802ccc0 con 0x7f8da015ae90 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.226+0000 7f8d9e7fc640 1 -- 172.21.15.113:0/3179786688 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98034610 con 0x7f8da015ae90 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.227+0000 7f8da499f640 1 -- 172.21.15.113:0/3179786688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da015ae90 msgr2=0x7f8da00cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.227+0000 7f8da499f640 1 --2- 172.21.15.113:0/3179786688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da015ae90 0x7f8da00cb4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8da006c470 tx=0x7f8d9802bf80 comp rx=0 tx=0).stop 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.227+0000 7f8da499f640 1 -- 172.21.15.113:0/3179786688 shutdown_connections 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.227+0000 7f8da499f640 1 --2- 172.21.15.113:0/3179786688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da015ae90 0x7f8da00cb4a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.227+0000 7f8da499f640 1 --2- 172.21.15.113:0/3179786688 >> v2:172.21.15.145:3300/0 conn(0x7f8da0155250 0x7f8da00cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.227+0000 7f8da499f640 1 -- 172.21.15.113:0/3179786688 >> 172.21.15.113:0/3179786688 conn(0x7f8da006ca90 msgr2=0x7f8da006ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.227+0000 7f8da499f640 1 -- 172.21.15.113:0/3179786688 shutdown_connections 2024-04-22T06:31:34.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.227+0000 7f8da499f640 1 -- 172.21.15.113:0/3179786688 wait complete. 2024-04-22T06:31:34.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.228+0000 7f8da499f640 1 Processor -- start 2024-04-22T06:31:34.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.228+0000 7f8da499f640 1 -- start start 2024-04-22T06:31:34.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8da499f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da00c5a60 0x7f8da0158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8da499f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8da0155250 0x7f8da00cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8da499f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8da015ae90 0x7f8da0159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8da499f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8da0074fa0 con 0x7f8da00c5a60 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8da499f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8da015bc90 con 0x7f8da015ae90 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8da499f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8da0075280 con 0x7f8da0155250 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da00c5a60 0x7f8da0158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da00c5a60 0x7f8da0158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55836/0 (socket says 172.21.15.113:55836) 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 -- 172.21.15.113:0/717780737 learned_addr learned my addr 172.21.15.113:0/717780737 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9effd640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8da0155250 0x7f8da00cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9ffff640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8da015ae90 0x7f8da0159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 -- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8da0155250 msgr2=0x7f8da00cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8da0155250 0x7f8da00cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 -- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8da015ae90 msgr2=0x7f8da0159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8da015ae90 0x7f8da0159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 -- 172.21.15.113:0/717780737 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da014c700 con 0x7f8da00c5a60 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9ffff640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8da015ae90 0x7f8da0159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d9f7fe640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da00c5a60 0x7f8da0158560 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000e810 tx=0x7f8d9000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d87fff640 1 -- 172.21.15.113:0/717780737 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000f040 con 0x7f8da00c5a60 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d87fff640 1 -- 172.21.15.113:0/717780737 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d90004030 con 0x7f8da00c5a60 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da014c440 con 0x7f8da00c5a60 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8d87fff640 1 -- 172.21.15.113:0/717780737 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90004400 con 0x7f8da00c5a60 2024-04-22T06:31:34.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.229+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da01f18c0 con 0x7f8da00c5a60 2024-04-22T06:31:34.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.230+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da0068cc0 con 0x7f8da00c5a60 2024-04-22T06:31:34.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.231+0000 7f8d87fff640 1 -- 172.21.15.113:0/717780737 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d9000c6d0 con 0x7f8da00c5a60 2024-04-22T06:31:34.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.231+0000 7f8d87fff640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8d8c06c8f0 0x7f8d8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.231+0000 7f8d9effd640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8d8c06c8f0 0x7f8d8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.231+0000 7f8d87fff640 1 -- 172.21.15.113:0/717780737 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8d9008b5e0 con 0x7f8da00c5a60 2024-04-22T06:31:34.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.232+0000 7f8d9effd640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8d8c06c8f0 0x7f8d8c06edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d94007fd0 tx=0x7f8d94009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.235+0000 7f8d87fff640 1 -- 172.21.15.113:0/717780737 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d90017020 con 0x7f8da00c5a60 2024-04-22T06:31:34.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.412+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8da00c7a90 con 0x7f8da00c5a60 2024-04-22T06:31:34.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.413+0000 7f8d87fff640 1 -- 172.21.15.113:0/717780737 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f8d90059cd0 con 0x7f8da00c5a60 2024-04-22T06:31:34.411 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:31:34.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8d8c06c8f0 msgr2=0x7f8d8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8d8c06c8f0 0x7f8d8c06edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d94007fd0 tx=0x7f8d94009040 comp rx=0 tx=0).stop 2024-04-22T06:31:34.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da00c5a60 msgr2=0x7f8da0158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da00c5a60 0x7f8da0158560 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000e810 tx=0x7f8d9000ecd0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 shutdown_connections 2024-04-22T06:31:34.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8da015ae90 0x7f8da0159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8da0155250 0x7f8da00cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8d8c06c8f0 0x7f8d8c06edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 --2- 172.21.15.113:0/717780737 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8da00c5a60 0x7f8da0158560 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 >> 172.21.15.113:0/717780737 conn(0x7f8da006ca90 msgr2=0x7f8da014b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:34.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 shutdown_connections 2024-04-22T06:31:34.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.415+0000 7f8da499f640 1 -- 172.21.15.113:0/717780737 wait complete. 2024-04-22T06:31:34.424 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-22T06:31:34.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.522+0000 7fd44252e640 1 Processor -- start 2024-04-22T06:31:34.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.522+0000 7fd44252e640 1 -- start start 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.523+0000 7fd44252e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd43c152f70 0x7fd43c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.523+0000 7fd44252e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c158fe0 con 0x7fd43c0c8870 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.523+0000 7fd44252e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c1592c0 con 0x7fd43c15cbd0 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.523+0000 7fd44252e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fd43c1595a0 con 0x7fd43c152f70 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.523+0000 7fd43bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd43c152f70 0x7fd43c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.523+0000 7fd43bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd43c152f70 0x7fd43c0c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55848/0 (socket says 172.21.15.113:55848) 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.523+0000 7fd43b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd43c0c8870 0x7fd43c15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54998/0 (socket says 172.21.15.113:54998) 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.523+0000 7fd43bfff640 1 -- 172.21.15.113:0/2010369575 learned_addr learned my addr 172.21.15.113:0/2010369575 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.524+0000 7fd43bfff640 1 -- 172.21.15.113:0/2010369575 >> v1:172.21.15.145:6789/0 conn(0x7fd43c15cbd0 legacy=0x7fd43c073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:34.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.524+0000 7fd43bfff640 1 -- 172.21.15.113:0/2010369575 >> v1:172.21.15.113:6789/0 conn(0x7fd43c0c8870 legacy=0x7fd43c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.524+0000 7fd43bfff640 1 -- 172.21.15.113:0/2010369575 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c159880 con 0x7fd43c152f70 2024-04-22T06:31:34.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.524+0000 7fd43affd640 1 -- 172.21.15.113:0/2010369575 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230282304 0 0) 0x7fd43c158fe0 con 0x7fd43c0c8870 2024-04-22T06:31:34.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.524+0000 7fd43bfff640 1 --2- 172.21.15.113:0/2010369575 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c0c5b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009870 tx=0x7fd42c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f705542b21a024f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.524+0000 7fd43affd640 1 -- 172.21.15.113:0/2010369575 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c034070 con 0x7fd43c152f70 2024-04-22T06:31:34.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.524+0000 7fd43affd640 1 -- 172.21.15.113:0/2010369575 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c030860 con 0x7fd43c152f70 2024-04-22T06:31:34.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.524+0000 7fd43affd640 1 -- 172.21.15.113:0/2010369575 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c030c30 con 0x7fd43c152f70 2024-04-22T06:31:34.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.525+0000 7fd44252e640 1 -- 172.21.15.113:0/2010369575 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 msgr2=0x7fd43c0c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.525+0000 7fd44252e640 1 --2- 172.21.15.113:0/2010369575 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c0c5b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009870 tx=0x7fd42c02b9a0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.525+0000 7fd44252e640 1 -- 172.21.15.113:0/2010369575 shutdown_connections 2024-04-22T06:31:34.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.525+0000 7fd44252e640 1 --2- 172.21.15.113:0/2010369575 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c0c5b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.525+0000 7fd44252e640 1 -- 172.21.15.113:0/2010369575 >> 172.21.15.113:0/2010369575 conn(0x7fd43c074d50 msgr2=0x7fd43c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.525+0000 7fd44252e640 1 -- 172.21.15.113:0/2010369575 shutdown_connections 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.525+0000 7fd44252e640 1 -- 172.21.15.113:0/2010369575 wait complete. 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.526+0000 7fd44252e640 1 Processor -- start 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.526+0000 7fd44252e640 1 -- start start 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd44252e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd43c0c8870 0x7fd43c0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd44252e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd44252e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd43c15cbd0 0x7fd43c0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd44252e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1534d0 con 0x7fd43c152f70 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd44252e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c153350 con 0x7fd43c0c8870 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd44252e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c074140 con 0x7fd43c15cbd0 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55854/0 (socket says 172.21.15.113:55854) 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 -- 172.21.15.113:0/2442351357 learned_addr learned my addr 172.21.15.113:0/2442351357 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:34.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43bfff640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd43c0c8870 0x7fd43c0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd440acb640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd43c15cbd0 0x7fd43c0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 -- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd43c15cbd0 msgr2=0x7fd43c0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd43c15cbd0 0x7fd43c0cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 -- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd43c0c8870 msgr2=0x7fd43c0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd43c0c8870 0x7fd43c0cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 -- 172.21.15.113:0/2442351357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c0c9e20 con 0x7fd43c152f70 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43bfff640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd43c0c8870 0x7fd43c0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd440acb640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd43c15cbd0 0x7fd43c0cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.527+0000 7fd43b7fe640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c157d00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd43000c4b0 tx=0x7fd43000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.528+0000 7fd438ff9640 1 -- 172.21.15.113:0/2442351357 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430018070 con 0x7fd43c152f70 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.528+0000 7fd438ff9640 1 -- 172.21.15.113:0/2442351357 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd430007500 con 0x7fd43c152f70 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.528+0000 7fd438ff9640 1 -- 172.21.15.113:0/2442351357 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430004a20 con 0x7fd43c152f70 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.528+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c1f26a0 con 0x7fd43c152f70 2024-04-22T06:31:34.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.528+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c158240 con 0x7fd43c152f70 2024-04-22T06:31:34.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.529+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43c0caa70 con 0x7fd43c152f70 2024-04-22T06:31:34.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.529+0000 7fd438ff9640 1 -- 172.21.15.113:0/2442351357 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd43001b070 con 0x7fd43c152f70 2024-04-22T06:31:34.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.529+0000 7fd438ff9640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd42806c8f0 0x7fd42806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.530+0000 7fd438ff9640 1 -- 172.21.15.113:0/2442351357 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd43008aac0 con 0x7fd43c152f70 2024-04-22T06:31:34.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.530+0000 7fd43bfff640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd42806c8f0 0x7fd42806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.530+0000 7fd43bfff640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd42806c8f0 0x7fd42806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd42c036000 tx=0x7fd42c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.534+0000 7fd438ff9640 1 -- 172.21.15.113:0/2442351357 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd430059390 con 0x7fd43c152f70 2024-04-22T06:31:34.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.711+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd43c068e40 con 0x7fd43c152f70 2024-04-22T06:31:34.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.711+0000 7fd438ff9640 1 -- 172.21.15.113:0/2442351357 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fd430058c90 con 0x7fd43c152f70 2024-04-22T06:31:34.710 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:34.710 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2024-04-22T06:31:34.710 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-04-22T06:31:34.710 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2024-04-22T06:31:34.711 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2024-04-22T06:31:34.711 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-04-22T06:31:34.711 INFO:teuthology.orchestra.run.smithi113.stdout:] 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd42806c8f0 msgr2=0x7fd42806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd42806c8f0 0x7fd42806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd42c036000 tx=0x7fd42c008030 comp rx=0 tx=0).stop 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 msgr2=0x7fd43c157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c157d00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd43000c4b0 tx=0x7fd43000c970 comp rx=0 tx=0).stop 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 shutdown_connections 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd43c15cbd0 0x7fd43c0cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd42806c8f0 0x7fd42806edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd43c152f70 0x7fd43c157d00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 --2- 172.21.15.113:0/2442351357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd43c0c8870 0x7fd43c0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 >> 172.21.15.113:0/2442351357 conn(0x7fd43c074d50 msgr2=0x7fd43c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:34.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 shutdown_connections 2024-04-22T06:31:34.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.713+0000 7fd44252e640 1 -- 172.21.15.113:0/2442351357 wait complete. 2024-04-22T06:31:34.722 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-22T06:31:34.722 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-22T06:31:34.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.824+0000 7feb276e0640 1 Processor -- start 2024-04-22T06:31:34.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.824+0000 7feb276e0640 1 -- start start 2024-04-22T06:31:34.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.825+0000 7feb276e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 0x7feb20072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.825+0000 7feb276e0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb200c9820 con 0x7feb20158a30 2024-04-22T06:31:34.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.825+0000 7feb276e0640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb200c9ae0 con 0x7feb200cd900 2024-04-22T06:31:34.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.825+0000 7feb276e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7feb200c9dc0 con 0x7feb200cdce0 2024-04-22T06:31:34.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.825+0000 7feb24c7b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7feb20158a30 0x7feb20151c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55004/0 (socket says 172.21.15.113:55004) 2024-04-22T06:31:34.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.825+0000 7feb24c7b640 1 -- 172.21.15.113:0/1613299231 learned_addr learned my addr 172.21.15.113:0/1613299231 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:34.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.825+0000 7feb25c7d640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 0x7feb20072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14320332 0 0) 0x7feb200c9820 con 0x7feb20158a30 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb0c003520 con 0x7feb20158a30 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499777929 0 0) 0x7feb200c9ae0 con 0x7feb200cd900 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb200c9820 con 0x7feb200cd900 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2067219370 0 0) 0x7feb0c003520 con 0x7feb20158a30 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 msgr2=0x7feb20072ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 0x7feb20072ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 >> v1:172.21.15.145:6789/0 conn(0x7feb200cd900 legacy=0x7feb200ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb20157f50 con 0x7feb20158a30 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7feb10001670 con 0x7feb20158a30 2024-04-22T06:31:34.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 >> v1:172.21.15.113:6789/0 conn(0x7feb20158a30 legacy=0x7feb20151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb0c003b70 0x7feb0c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 0x7feb0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7feb200c9dc0 con 0x7feb0c004800 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c00ba70 con 0x7feb0c003b70 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7feb0c00bc70 con 0x7feb200cdce0 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb24c7b640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb2547c640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb0c003b70 0x7feb0c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb25c7d640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 0x7feb0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb24c7b640 1 -- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 msgr2=0x7feb0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:34.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb24c7b640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 0x7feb0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb24c7b640 1 -- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb0c003b70 msgr2=0x7feb0c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb24c7b640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb0c003b70 0x7feb0c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb24c7b640 1 -- 172.21.15.113:0/1613299231 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0c003520 con 0x7feb0c004800 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb2547c640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb0c003b70 0x7feb0c003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.826+0000 7feb25c7d640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb200cdce0 0x7feb0c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.827+0000 7feb24c7b640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb0c004c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb10001eb0 tx=0x7feb0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d502c77a00336c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.827+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10007ce0 con 0x7feb0c004800 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.827+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb10030070 con 0x7feb0c004800 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.827+0000 7feb17fff640 1 -- 172.21.15.113:0/1613299231 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10005d10 con 0x7feb0c004800 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.828+0000 7feb276e0640 1 -- 172.21.15.113:0/1613299231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 msgr2=0x7feb0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.828+0000 7feb276e0640 1 --2- 172.21.15.113:0/1613299231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb0c004c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb10001eb0 tx=0x7feb0c005830 comp rx=0 tx=0).stop 2024-04-22T06:31:34.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.828+0000 7feb25c7d640 1 -- 172.21.15.113:0/1613299231 reap_dead start 2024-04-22T06:31:34.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.828+0000 7feb276e0640 1 -- 172.21.15.113:0/1613299231 shutdown_connections 2024-04-22T06:31:34.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.828+0000 7feb276e0640 1 -- 172.21.15.113:0/1613299231 >> 172.21.15.113:0/1613299231 conn(0x7feb2006e990 msgr2=0x7feb2006fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:34.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.828+0000 7feb276e0640 1 -- 172.21.15.113:0/1613299231 shutdown_connections 2024-04-22T06:31:34.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.828+0000 7feb276e0640 1 -- 172.21.15.113:0/1613299231 wait complete. 2024-04-22T06:31:34.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.829+0000 7feb276e0640 1 Processor -- start 2024-04-22T06:31:34.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.829+0000 7feb276e0640 1 -- start start 2024-04-22T06:31:34.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.829+0000 7feb276e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb20155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.829+0000 7feb276e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb201f3400 0x7feb20140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.829+0000 7feb276e0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb20142910 0x7feb201576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.829+0000 7feb276e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7feb20152320 con 0x7feb0c004800 2024-04-22T06:31:34.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.829+0000 7feb276e0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feb20158510 con 0x7feb20142910 2024-04-22T06:31:34.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.829+0000 7feb276e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7feb201524a0 con 0x7feb201f3400 2024-04-22T06:31:34.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb20155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb20155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55882/0 (socket says 172.21.15.113:55882) 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 -- 172.21.15.113:0/2625177675 learned_addr learned my addr 172.21.15.113:0/2625177675 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb25c7d640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb20142910 0x7feb201576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb24c7b640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb201f3400 0x7feb20140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 -- 172.21.15.113:0/2625177675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb201f3400 msgr2=0x7feb20140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb201f3400 0x7feb20140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 -- 172.21.15.113:0/2625177675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb20142910 msgr2=0x7feb201576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb20142910 0x7feb201576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 -- 172.21.15.113:0/2625177675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2014e360 con 0x7feb0c004800 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb2547c640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb20155bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00eb80 tx=0x7feb1c00c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb15ffb640 1 -- 172.21.15.113:0/2625177675 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00ee80 con 0x7feb0c004800 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb15ffb640 1 -- 172.21.15.113:0/2625177675 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c00cbc0 con 0x7feb0c004800 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb20143000 con 0x7feb0c004800 2024-04-22T06:31:34.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb15ffb640 1 -- 172.21.15.113:0/2625177675 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00cd70 con 0x7feb0c004800 2024-04-22T06:31:34.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.830+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2014e640 con 0x7feb0c004800 2024-04-22T06:31:34.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.831+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb20144260 con 0x7feb0c004800 2024-04-22T06:31:34.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.832+0000 7feb15ffb640 1 -- 172.21.15.113:0/2625177675 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb1c01a020 con 0x7feb0c004800 2024-04-22T06:31:34.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.832+0000 7feb15ffb640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7feb0406c8f0 0x7feb0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:34.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.832+0000 7feb15ffb640 1 -- 172.21.15.113:0/2625177675 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7feb1c08b2c0 con 0x7feb0c004800 2024-04-22T06:31:34.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.832+0000 7feb24c7b640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7feb0406c8f0 0x7feb0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:34.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.833+0000 7feb24c7b640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7feb0406c8f0 0x7feb0406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb10001eb0 tx=0x7feb10007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:34.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:34.836+0000 7feb15ffb640 1 -- 172.21.15.113:0/2625177675 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb20144260 con 0x7feb0c004800 2024-04-22T06:31:35.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.011+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7feb20068f50 con 0x7feb0c004800 2024-04-22T06:31:35.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.814+0000 7feb15ffb640 1 -- 172.21.15.113:0/2625177675 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7feb1c059ad0 con 0x7feb0c004800 2024-04-22T06:31:35.813 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2024-04-22T06:31:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.816+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7feb0406c8f0 msgr2=0x7feb0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.816+0000 7feb276e0640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7feb0406c8f0 0x7feb0406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb10001eb0 tx=0x7feb10007000 comp rx=0 tx=0).stop 2024-04-22T06:31:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.816+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 msgr2=0x7feb20155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.816+0000 7feb276e0640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb20155bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00eb80 tx=0x7feb1c00c4b0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.817+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 shutdown_connections 2024-04-22T06:31:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.817+0000 7feb276e0640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb20142910 0x7feb201576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.817+0000 7feb276e0640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb201f3400 0x7feb20140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.817+0000 7feb276e0640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7feb0406c8f0 0x7feb0406edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.817+0000 7feb276e0640 1 --2- 172.21.15.113:0/2625177675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feb0c004800 0x7feb20155bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.817+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 >> 172.21.15.113:0/2625177675 conn(0x7feb2006e990 msgr2=0x7feb200721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.817+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 shutdown_connections 2024-04-22T06:31:35.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.817+0000 7feb276e0640 1 -- 172.21.15.113:0/2625177675 wait complete. 2024-04-22T06:31:35.830 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-22T06:31:35.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.938+0000 7fc5d632b640 1 Processor -- start 2024-04-22T06:31:35.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.938+0000 7fc5d632b640 1 -- start start 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5d632b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc5d015bd00 0x7fc5d00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5d632b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00740b0 0x7fc5d015e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5d632b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5d00ce850 con 0x7fc5d0155260 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5d632b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fc5d015b160 con 0x7fc5d015bd00 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5d632b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d00ceb10 con 0x7fc5d00740b0 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5cf7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc5d015bd00 0x7fc5d00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5cffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc5d0155260 0x7fc5d015b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55018/0 (socket says 172.21.15.113:55018) 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5cffff640 1 -- 172.21.15.113:0/1068328401 learned_addr learned my addr 172.21.15.113:0/1068328401 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5d48c8640 1 --2- 172.21.15.113:0/1068328401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00740b0 0x7fc5d015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:35.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5cf7fe640 1 -- 172.21.15.113:0/1068328401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00740b0 msgr2=0x7fc5d015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:35.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5cf7fe640 1 --2- 172.21.15.113:0/1068328401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00740b0 0x7fc5d015e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5cf7fe640 1 -- 172.21.15.113:0/1068328401 >> v1:172.21.15.113:6789/0 conn(0x7fc5d0155260 legacy=0x7fc5d015b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:35.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5cf7fe640 1 -- 172.21.15.113:0/1068328401 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d00cedf0 con 0x7fc5d015bd00 2024-04-22T06:31:35.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.939+0000 7fc5ceffd640 1 -- 172.21.15.113:0/1068328401 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931609572 0 0) 0x7fc5d00ce850 con 0x7fc5d0155260 2024-04-22T06:31:35.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.940+0000 7fc5cf7fe640 1 --2- 172.21.15.113:0/1068328401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d015bd00 0x7fc5d00cad90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40097a0 tx=0x7fc5c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2514c9b85b3c2085 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:35.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.940+0000 7fc5ceffd640 1 -- 172.21.15.113:0/1068328401 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4035020 con 0x7fc5d015bd00 2024-04-22T06:31:35.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.940+0000 7fc5ceffd640 1 -- 172.21.15.113:0/1068328401 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c4031830 con 0x7fc5d015bd00 2024-04-22T06:31:35.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.940+0000 7fc5ceffd640 1 -- 172.21.15.113:0/1068328401 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4031c00 con 0x7fc5d015bd00 2024-04-22T06:31:35.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.941+0000 7fc5d632b640 1 -- 172.21.15.113:0/1068328401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d015bd00 msgr2=0x7fc5d00cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:35.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.941+0000 7fc5d632b640 1 --2- 172.21.15.113:0/1068328401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d015bd00 0x7fc5d00cad90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40097a0 tx=0x7fc5c402b8d0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.941+0000 7fc5d632b640 1 -- 172.21.15.113:0/1068328401 shutdown_connections 2024-04-22T06:31:35.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.941+0000 7fc5d632b640 1 --2- 172.21.15.113:0/1068328401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d015bd00 0x7fc5d00cad90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.941+0000 7fc5d632b640 1 --2- 172.21.15.113:0/1068328401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d00740b0 0x7fc5d015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.941+0000 7fc5d632b640 1 -- 172.21.15.113:0/1068328401 >> 172.21.15.113:0/1068328401 conn(0x7fc5d0073590 msgr2=0x7fc5d00739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:35.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.941+0000 7fc5d632b640 1 -- 172.21.15.113:0/1068328401 shutdown_connections 2024-04-22T06:31:35.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.941+0000 7fc5d632b640 1 -- 172.21.15.113:0/1068328401 wait complete. 2024-04-22T06:31:35.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.942+0000 7fc5d632b640 1 Processor -- start 2024-04-22T06:31:35.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.942+0000 7fc5d632b640 1 -- start start 2024-04-22T06:31:35.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d632b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d00740b0 0x7fc5d00c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d632b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d0155260 0x7fc5d00cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d632b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d015bd00 0x7fc5d00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d632b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0155640 con 0x7fc5d00740b0 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d632b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d00cf3b0 con 0x7fc5d0155260 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d632b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d01557c0 con 0x7fc5d015bd00 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d00740b0 0x7fc5d00c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d00740b0 0x7fc5d00c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55908/0 (socket says 172.21.15.113:55908) 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 -- 172.21.15.113:0/2763313932 learned_addr learned my addr 172.21.15.113:0/2763313932 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cf7fe640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d0155260 0x7fc5d00cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d48c8640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d015bd00 0x7fc5d00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 -- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d015bd00 msgr2=0x7fc5d00cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:35.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d015bd00 0x7fc5d00cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 -- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d0155260 msgr2=0x7fc5d00cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d0155260 0x7fc5d00cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 -- 172.21.15.113:0/2763313932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d00c6350 con 0x7fc5d00740b0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cf7fe640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d0155260 0x7fc5d00cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5cffff640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d00740b0 0x7fc5d00c5cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000c500 tx=0x7fc5c000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5ccff9640 1 -- 172.21.15.113:0/2763313932 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0018070 con 0x7fc5d00740b0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5ccff9640 1 -- 172.21.15.113:0/2763313932 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c0007580 con 0x7fc5d00740b0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5ccff9640 1 -- 172.21.15.113:0/2763313932 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0004a20 con 0x7fc5d00740b0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d01f0760 con 0x7fc5d00740b0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.943+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d01f0d00 con 0x7fc5d00740b0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.944+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d01f16e0 con 0x7fc5d00740b0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.945+0000 7fc5ccff9640 1 -- 172.21.15.113:0/2763313932 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5c001b070 con 0x7fc5d00740b0 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.945+0000 7fc5ccff9640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc5bc06c8f0 0x7fc5bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:35.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.945+0000 7fc5ccff9640 1 -- 172.21.15.113:0/2763313932 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fc5c008ac00 con 0x7fc5d00740b0 2024-04-22T06:31:35.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.945+0000 7fc5cf7fe640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc5bc06c8f0 0x7fc5bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:35.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.946+0000 7fc5cf7fe640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc5bc06c8f0 0x7fc5bc06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4036000 tx=0x7fc5c4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:35.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:35.950+0000 7fc5ccff9640 1 -- 172.21.15.113:0/2763313932 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5d01f16e0 con 0x7fc5d00740b0 2024-04-22T06:31:36.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.126+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fc5d0068e40 con 0x7fc5d00740b0 2024-04-22T06:31:36.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.816+0000 7fc5ccff9640 1 -- 172.21.15.113:0/2763313932 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fc5c0091080 con 0x7fc5d00740b0 2024-04-22T06:31:36.815 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2024-04-22T06:31:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc5bc06c8f0 msgr2=0x7fc5bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc5bc06c8f0 0x7fc5bc06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4036000 tx=0x7fc5c4008030 comp rx=0 tx=0).stop 2024-04-22T06:31:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d00740b0 msgr2=0x7fc5d00c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d00740b0 0x7fc5d00c5cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000c500 tx=0x7fc5c000c9c0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 shutdown_connections 2024-04-22T06:31:36.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc5d015bd00 0x7fc5d00cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d0155260 0x7fc5d00cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc5bc06c8f0 0x7fc5bc06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 --2- 172.21.15.113:0/2763313932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5d00740b0 0x7fc5d00c5cc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.819+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 >> 172.21.15.113:0/2763313932 conn(0x7fc5d0073590 msgr2=0x7fc5d0073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:36.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.820+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 shutdown_connections 2024-04-22T06:31:36.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.820+0000 7fc5d632b640 1 -- 172.21.15.113:0/2763313932 wait complete. 2024-04-22T06:31:36.842 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-22T06:31:36.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.948+0000 7fca553ca640 1 Processor -- start 2024-04-22T06:31:36.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.948+0000 7fca553ca640 1 -- start start 2024-04-22T06:31:36.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.948+0000 7fca553ca640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fca5015b070 0x7fca500cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:36.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.948+0000 7fca553ca640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca500c5c80 con 0x7fca500cbae0 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.948+0000 7fca553ca640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5015b5d0 con 0x7fca501553c0 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.948+0000 7fca553ca640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fca5015e660 con 0x7fca5015b070 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fca500cbae0 0x7fca500d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55034/0 (socket says 172.21.15.113:55034) 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4f7fe640 1 -- 172.21.15.113:0/3838273073 learned_addr learned my addr 172.21.15.113:0/3838273073 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4e7fc640 1 --2- 172.21.15.113:0/3838273073 >> v2:172.21.15.145:3300/0 conn(0x7fca5015b070 0x7fca500cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230408080 0 0) 0x7fca500c5c80 con 0x7fca500cbae0 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca3c003520 con 0x7fca500cbae0 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1592122008 0 0) 0x7fca3c003520 con 0x7fca500cbae0 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 >> v2:172.21.15.145:3300/0 conn(0x7fca5015b070 msgr2=0x7fca500cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 --2- 172.21.15.113:0/3838273073 >> v2:172.21.15.145:3300/0 conn(0x7fca5015b070 0x7fca500cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 >> v1:172.21.15.145:6789/0 conn(0x7fca501553c0 legacy=0x7fca5015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5015b8b0 con 0x7fca500cbae0 2024-04-22T06:31:36.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fca400019f0 con 0x7fca500cbae0 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4e7fc640 1 --2- 172.21.15.113:0/3838273073 >> v2:172.21.15.145:3300/0 conn(0x7fca5015b070 0x7fca500cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 >> v1:172.21.15.113:6789/0 conn(0x7fca500cbae0 legacy=0x7fca500d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3c004800 0x7fca3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3c0051c0 0x7fca3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fca5015e660 con 0x7fca3c0039b0 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c00c060 con 0x7fca3c0051c0 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c00c260 con 0x7fca3c004800 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4effd640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4f7fe640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3c0051c0 0x7fca3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:36.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4e7fc640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3c004800 0x7fca3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4effd640 1 -- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3c004800 msgr2=0x7fca3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4effd640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3c004800 0x7fca3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4effd640 1 -- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3c0051c0 msgr2=0x7fca3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4effd640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3c0051c0 0x7fca3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4effd640 1 -- 172.21.15.113:0/3838273073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c003520 con 0x7fca3c0039b0 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4f7fe640 1 -- 172.21.15.113:0/3838273073 reap_dead start 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.949+0000 7fca4e7fc640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3c004800 0x7fca3c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.950+0000 7fca4effd640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca3c003dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca48001770 tx=0x7fca3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52726fa06437934 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.950+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480013c0 con 0x7fca3c0039b0 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.950+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca480052d0 con 0x7fca3c0039b0 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.950+0000 7fca4dffb640 1 -- 172.21.15.113:0/3838273073 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48003640 con 0x7fca3c0039b0 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.951+0000 7fca553ca640 1 -- 172.21.15.113:0/3838273073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 msgr2=0x7fca3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.951+0000 7fca553ca640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca3c003dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca48001770 tx=0x7fca3c005830 comp rx=0 tx=0).stop 2024-04-22T06:31:36.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.951+0000 7fca553ca640 1 -- 172.21.15.113:0/3838273073 shutdown_connections 2024-04-22T06:31:36.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.951+0000 7fca553ca640 1 --2- 172.21.15.113:0/3838273073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca3c003dd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.951+0000 7fca553ca640 1 -- 172.21.15.113:0/3838273073 >> 172.21.15.113:0/3838273073 conn(0x7fca50072360 msgr2=0x7fca50074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:36.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.951+0000 7fca553ca640 1 -- 172.21.15.113:0/3838273073 shutdown_connections 2024-04-22T06:31:36.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.951+0000 7fca553ca640 1 -- 172.21.15.113:0/3838273073 wait complete. 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.952+0000 7fca553ca640 1 Processor -- start 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.952+0000 7fca553ca640 1 -- start start 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca553ca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca500730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca553ca640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca501569a0 0x7fca500ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca553ca640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca500ca5d0 0x7fca500c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca553ca640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fca5015be70 con 0x7fca3c0039b0 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca553ca640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fca501557a0 con 0x7fca501569a0 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca553ca640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fca5015e8b0 con 0x7fca500ca5d0 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca500730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:36.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca500730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55918/0 (socket says 172.21.15.113:55918) 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 -- 172.21.15.113:0/4143400972 learned_addr learned my addr 172.21.15.113:0/4143400972 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4f7fe640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca500ca5d0 0x7fca500c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4e7fc640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca501569a0 0x7fca500ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 -- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca500ca5d0 msgr2=0x7fca500c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca500ca5d0 0x7fca500c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 -- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca501569a0 msgr2=0x7fca500ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca501569a0 0x7fca500ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 -- 172.21.15.113:0/4143400972 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca501f1580 con 0x7fca3c0039b0 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4e7fc640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca501569a0 0x7fca500ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca4effd640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca500730b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca48005040 tx=0x7fca48001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca477fe640 1 -- 172.21.15.113:0/4143400972 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48041070 con 0x7fca3c0039b0 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.953+0000 7fca477fe640 1 -- 172.21.15.113:0/4143400972 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca480050d0 con 0x7fca3c0039b0 2024-04-22T06:31:36.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.954+0000 7fca477fe640 1 -- 172.21.15.113:0/4143400972 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48007470 con 0x7fca3c0039b0 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.954+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca501f1820 con 0x7fca3c0039b0 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.954+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca501f1de0 con 0x7fca3c0039b0 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.954+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca50075280 con 0x7fca3c0039b0 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.955+0000 7fca477fe640 1 -- 172.21.15.113:0/4143400972 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca48044070 con 0x7fca3c0039b0 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.955+0000 7fca477fe640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fca3006c920 0x7fca3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.955+0000 7fca477fe640 1 -- 172.21.15.113:0/4143400972 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fca480ad5f0 con 0x7fca3c0039b0 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.955+0000 7fca4e7fc640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fca3006c920 0x7fca3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.956+0000 7fca4e7fc640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fca3006c920 0x7fca3006ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca5015c410 tx=0x7fca38008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:36.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:36.960+0000 7fca477fe640 1 -- 172.21.15.113:0/4143400972 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca50075280 con 0x7fca3c0039b0 2024-04-22T06:31:37.121 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:31:37.124 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:31:37.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.178+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fca50068f50 con 0x7fca3c0039b0 2024-04-22T06:31:37.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.826+0000 7fca477fe640 1 -- 172.21.15.113:0/4143400972 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fca4807b5e0 con 0x7fca3c0039b0 2024-04-22T06:31:37.825 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 2 and data pool 3 2024-04-22T06:31:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fca3006c920 msgr2=0x7fca3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fca3006c920 0x7fca3006ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca5015c410 tx=0x7fca38008040 comp rx=0 tx=0).stop 2024-04-22T06:31:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 msgr2=0x7fca500730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:37.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca500730b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca48005040 tx=0x7fca48001170 comp rx=0 tx=0).stop 2024-04-22T06:31:37.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 shutdown_connections 2024-04-22T06:31:37.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca500ca5d0 0x7fca500c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca501569a0 0x7fca500ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fca3006c920 0x7fca3006ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 --2- 172.21.15.113:0/4143400972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fca3c0039b0 0x7fca500730b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.830+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 >> 172.21.15.113:0/4143400972 conn(0x7fca50072360 msgr2=0x7fca50158c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.831+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 shutdown_connections 2024-04-22T06:31:37.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.831+0000 7fca553ca640 1 -- 172.21.15.113:0/4143400972 wait complete. 2024-04-22T06:31:37.853 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-22T06:31:37.853 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-22T06:31:37.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.958+0000 7f360e831640 1 Processor -- start 2024-04-22T06:31:37.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.958+0000 7f360e831640 1 -- start start 2024-04-22T06:31:37.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f360e831640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f36080cecf0 0x7f36080cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f360e831640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36080c6130 0x7f3608152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f360e831640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36080c5c50 con 0x7f36080ce910 2024-04-22T06:31:37.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f360e831640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f3608073bf0 con 0x7f36080cecf0 2024-04-22T06:31:37.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f360e831640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3608073ed0 con 0x7f36080c6130 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3607fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f36080ce910 0x7f36080c9150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:55038/0 (socket says 172.21.15.113:55038) 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3607fff640 1 -- 172.21.15.113:0/3818986805 learned_addr learned my addr 172.21.15.113:0/3818986805 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031492281 0 0) 0x7f36080c5c50 con 0x7f36080ce910 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35f0003520 con 0x7f36080ce910 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f360cdce640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36080c6130 0x7f3608152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f36077fe640 1 --2- 172.21.15.113:0/3818986805 >> v2:172.21.15.145:3300/0 conn(0x7f36080cecf0 0x7f36080cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4064342593 0 0) 0x7f35f0003520 con 0x7f36080ce910 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36080c6130 msgr2=0x7f3608152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36080c6130 0x7f3608152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 >> v2:172.21.15.145:3300/0 conn(0x7f36080cecf0 msgr2=0x7f36080cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 --2- 172.21.15.113:0/3818986805 >> v2:172.21.15.145:3300/0 conn(0x7f36080cecf0 0x7f36080cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36080741b0 con 0x7f36080ce910 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.959+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f35f8001670 con 0x7f36080ce910 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 >> v1:172.21.15.113:6789/0 conn(0x7f36080ce910 legacy=0x7f36080c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f3606ffd640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36080c6130 0x7f35f00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f3606ffd640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f0003f30 0x7f35f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f3606ffd640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f35f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3608073bf0 con 0x7f35f0004d40 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3608073ed0 con 0x7f35f0003f30 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f35f000baa0 con 0x7f36080c6130 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f360cdce640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f35f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f3607fff640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36080c6130 0x7f35f00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f36077fe640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f0003f30 0x7f35f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f360cdce640 1 -- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36080c6130 msgr2=0x7f35f00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f360cdce640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36080c6130 0x7f35f00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f360cdce640 1 -- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f0003f30 msgr2=0x7f35f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f360cdce640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f0003f30 0x7f35f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.960+0000 7f360cdce640 1 -- 172.21.15.113:0/3818986805 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f0003520 con 0x7f35f0004d40 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.961+0000 7f360cdce640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f35f00051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3600009fc0 tx=0x7f35f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6843a4b840d97861 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.961+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600039070 con 0x7f35f0004d40 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.961+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360002cc20 con 0x7f35f0004d40 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.961+0000 7f3606ffd640 1 -- 172.21.15.113:0/3818986805 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600009c10 con 0x7f35f0004d40 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.962+0000 7f360e831640 1 -- 172.21.15.113:0/3818986805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 msgr2=0x7f35f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.962+0000 7f360e831640 1 --2- 172.21.15.113:0/3818986805 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f35f00051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3600009fc0 tx=0x7f35f0005830 comp rx=0 tx=0).stop 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.962+0000 7f360cdce640 1 -- 172.21.15.113:0/3818986805 reap_dead start 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.962+0000 7f360e831640 1 -- 172.21.15.113:0/3818986805 shutdown_connections 2024-04-22T06:31:37.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.962+0000 7f360e831640 1 -- 172.21.15.113:0/3818986805 >> 172.21.15.113:0/3818986805 conn(0x7f3608068570 msgr2=0x7f3608074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:37.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.962+0000 7f360e831640 1 -- 172.21.15.113:0/3818986805 shutdown_connections 2024-04-22T06:31:37.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.962+0000 7f360e831640 1 -- 172.21.15.113:0/3818986805 wait complete. 2024-04-22T06:31:37.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.963+0000 7f360e831640 1 Processor -- start 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.964+0000 7f360e831640 1 -- start start 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360e831640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f36081f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360e831640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608142df0 0x7f3608151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360e831640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36081efc10 0x7f360813c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360e831640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f36080c9fa0 con 0x7f35f0004d40 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360e831640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36080c9e20 con 0x7f3608142df0 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360e831640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f36080c7d90 con 0x7f36081efc10 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f36081f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f36081f2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55942/0 (socket says 172.21.15.113:55942) 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 -- 172.21.15.113:0/2541206885 learned_addr learned my addr 172.21.15.113:0/2541206885 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f36077fe640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608142df0 0x7f3608151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360cdce640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36081efc10 0x7f360813c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 -- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36081efc10 msgr2=0x7f360813c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36081efc10 0x7f360813c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 -- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608142df0 msgr2=0x7f3608151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608142df0 0x7f3608151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 -- 172.21.15.113:0/2541206885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36081f2c60 con 0x7f35f0004d40 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360cdce640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36081efc10 0x7f360813c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3607fff640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f36081f2720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35f8007310 tx=0x7f35f8007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3604ff9640 1 -- 172.21.15.113:0/2541206885 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f800f960 con 0x7f35f0004d40 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f3604ff9640 1 -- 172.21.15.113:0/2541206885 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f8018070 con 0x7f35f0004d40 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.965+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3608143650 con 0x7f35f0004d40 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.966+0000 7f3604ff9640 1 -- 172.21.15.113:0/2541206885 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f800fd80 con 0x7f35f0004d40 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.966+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3608140ce0 con 0x7f35f0004d40 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.966+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3608068f50 con 0x7f35f0004d40 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.967+0000 7f3604ff9640 1 -- 172.21.15.113:0/2541206885 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35f801d460 con 0x7f35f0004d40 2024-04-22T06:31:37.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.967+0000 7f3604ff9640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f35f406c920 0x7f35f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:37.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.968+0000 7f3604ff9640 1 -- 172.21.15.113:0/2541206885 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f35f808bbc0 con 0x7f35f0004d40 2024-04-22T06:31:37.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.968+0000 7f36077fe640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f35f406c920 0x7f35f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:37.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.968+0000 7f36077fe640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f35f406c920 0x7f35f406ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36081f1c70 tx=0x7f35fc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:37.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:37.972+0000 7f3604ff9640 1 -- 172.21.15.113:0/2541206885 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f35f805a080 con 0x7f35f0004d40 2024-04-22T06:31:38.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.163+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f36080c5390 con 0x7f35f0004d40 2024-04-22T06:31:38.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.836+0000 7f3604ff9640 1 -- 172.21.15.113:0/2541206885 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f35f8059980 con 0x7f35f0004d40 2024-04-22T06:31:38.838 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f35f406c920 msgr2=0x7f35f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:38.838 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f35f406c920 0x7f35f406ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36081f1c70 tx=0x7f35fc009190 comp rx=0 tx=0).stop 2024-04-22T06:31:38.838 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 msgr2=0x7f36081f2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:38.838 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f36081f2720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35f8007310 tx=0x7f35f8007710 comp rx=0 tx=0).stop 2024-04-22T06:31:38.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 shutdown_connections 2024-04-22T06:31:38.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36081efc10 0x7f360813c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3608142df0 0x7f3608151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f35f406c920 0x7f35f406ede0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 --2- 172.21.15.113:0/2541206885 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35f0004d40 0x7f36081f2720 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 >> 172.21.15.113:0/2541206885 conn(0x7f3608068570 msgr2=0x7f3608150d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:38.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 shutdown_connections 2024-04-22T06:31:38.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.839+0000 7f360e831640 1 -- 172.21.15.113:0/2541206885 wait complete. 2024-04-22T06:31:38.850 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-22T06:31:38.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.958+0000 7fdc8ad15640 1 Processor -- start 2024-04-22T06:31:38.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.958+0000 7fdc8ad15640 1 -- start start 2024-04-22T06:31:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc8ad15640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdc84153040 0x7fdc84159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc8ad15640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc84071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc8ad15640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8415ce50 con 0x7fdc840c6e00 2024-04-22T06:31:38.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc8ad15640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fdc84159670 con 0x7fdc84153040 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc8ad15640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8415d3b0 con 0x7fdc840c8140 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc88ab1640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdc84153040 0x7fdc84159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc83fff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fdc840c6e00 0x7fdc840c5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:35016/0 (socket says 172.21.15.113:35016) 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc892b2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc84071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.959+0000 7fdc83fff640 1 -- 172.21.15.113:0/1957637767 learned_addr learned my addr 172.21.15.113:0/1957637767 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.960+0000 7fdc88ab1640 1 -- 172.21.15.113:0/1957637767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 msgr2=0x7fdc84071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.960+0000 7fdc88ab1640 1 --2- 172.21.15.113:0/1957637767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc84071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.960+0000 7fdc88ab1640 1 -- 172.21.15.113:0/1957637767 >> v1:172.21.15.145:6789/0 conn(0x7fdc840c6e00 legacy=0x7fdc840c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.960+0000 7fdc88ab1640 1 -- 172.21.15.113:0/1957637767 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8415d0d0 con 0x7fdc84153040 2024-04-22T06:31:38.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.960+0000 7fdc892b2640 1 --2- 172.21.15.113:0/1957637767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc84071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.960+0000 7fdc88ab1640 1 --2- 172.21.15.113:0/1957637767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 0x7fdc84159b00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc740097a0 tx=0x7fdc7402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7cb02d5e32613c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc837fe640 1 -- 172.21.15.113:0/1957637767 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74035020 con 0x7fdc84153040 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc837fe640 1 -- 172.21.15.113:0/1957637767 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc74031810 con 0x7fdc84153040 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc837fe640 1 -- 172.21.15.113:0/1957637767 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74031be0 con 0x7fdc84153040 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc8ad15640 1 -- 172.21.15.113:0/1957637767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 msgr2=0x7fdc84159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/1957637767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 0x7fdc84159b00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc740097a0 tx=0x7fdc7402b8b0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc8ad15640 1 -- 172.21.15.113:0/1957637767 shutdown_connections 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/1957637767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc84071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/1957637767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 0x7fdc84159b00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc8ad15640 1 -- 172.21.15.113:0/1957637767 >> 172.21.15.113:0/1957637767 conn(0x7fdc840c8f00 msgr2=0x7fdc840c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc8ad15640 1 -- 172.21.15.113:0/1957637767 shutdown_connections 2024-04-22T06:31:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.961+0000 7fdc8ad15640 1 -- 172.21.15.113:0/1957637767 wait complete. 2024-04-22T06:31:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.962+0000 7fdc8ad15640 1 Processor -- start 2024-04-22T06:31:38.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.962+0000 7fdc8ad15640 1 -- start start 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc8ad15640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c6e00 0x7fdc84156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc8ad15640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc841e7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc8ad15640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 0x7fdc841f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc8ad15640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fdc840c7b70 con 0x7fdc840c6e00 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc8ad15640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84159300 con 0x7fdc84153040 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc8ad15640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fdc840c7cf0 con 0x7fdc840c8140 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc88ab1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c6e00 0x7fdc84156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc88ab1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c6e00 0x7fdc84156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46740/0 (socket says 172.21.15.113:46740) 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc88ab1640 1 -- 172.21.15.113:0/255866595 learned_addr learned my addr 172.21.15.113:0/255866595 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc83fff640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc841e7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:38.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.963+0000 7fdc892b2640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 0x7fdc841f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc88ab1640 1 -- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 msgr2=0x7fdc841e7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc88ab1640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc841e7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc88ab1640 1 -- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 msgr2=0x7fdc841f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc88ab1640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 0x7fdc841f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc88ab1640 1 -- 172.21.15.113:0/255866595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc84155d90 con 0x7fdc840c6e00 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc892b2640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 0x7fdc841f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc83fff640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc841e7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc88ab1640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c6e00 0x7fdc84156810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc74034040 tx=0x7fdc740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc817fa640 1 -- 172.21.15.113:0/255866595 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74040070 con 0x7fdc840c6e00 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc841f16c0 con 0x7fdc840c6e00 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc84156030 con 0x7fdc840c6e00 2024-04-22T06:31:38.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc817fa640 1 -- 172.21.15.113:0/255866595 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc74031810 con 0x7fdc840c6e00 2024-04-22T06:31:38.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.964+0000 7fdc817fa640 1 -- 172.21.15.113:0/255866595 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74035040 con 0x7fdc840c6e00 2024-04-22T06:31:38.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.965+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc64005290 con 0x7fdc840c6e00 2024-04-22T06:31:38.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.966+0000 7fdc817fa640 1 -- 172.21.15.113:0/255866595 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc74038020 con 0x7fdc840c6e00 2024-04-22T06:31:38.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.966+0000 7fdc817fa640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c8f0 0x7fdc7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:38.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.966+0000 7fdc83fff640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c8f0 0x7fdc7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:38.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.966+0000 7fdc817fa640 1 -- 172.21.15.113:0/255866595 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fdc740ad920 con 0x7fdc840c6e00 2024-04-22T06:31:38.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.966+0000 7fdc83fff640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c8f0 0x7fdc7006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc840c7b40 tx=0x7fdc78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:38.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:38.970+0000 7fdc817fa640 1 -- 172.21.15.113:0/255866595 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdc7407bb10 con 0x7fdc840c6e00 2024-04-22T06:31:39.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:39.144+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdc64005580 con 0x7fdc840c6e00 2024-04-22T06:31:40.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.847+0000 7fdc817fa640 1 -- 172.21.15.113:0/255866595 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fdc7407b410 con 0x7fdc840c6e00 2024-04-22T06:31:40.846 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data_ec' created 2024-04-22T06:31:40.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c8f0 msgr2=0x7fdc7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:40.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c8f0 0x7fdc7006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc840c7b40 tx=0x7fdc78009040 comp rx=0 tx=0).stop 2024-04-22T06:31:40.850 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c6e00 msgr2=0x7fdc84156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:40.850 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c6e00 0x7fdc84156810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc74034040 tx=0x7fdc740046c0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.850 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 shutdown_connections 2024-04-22T06:31:40.850 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc84153040 0x7fdc841f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc840c8140 0x7fdc841e7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c8f0 0x7fdc7006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 --2- 172.21.15.113:0/255866595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c6e00 0x7fdc84156810 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.851+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 >> 172.21.15.113:0/255866595 conn(0x7fdc840c8f00 msgr2=0x7fdc841511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:40.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.852+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 shutdown_connections 2024-04-22T06:31:40.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.852+0000 7fdc8ad15640 1 -- 172.21.15.113:0/255866595 wait complete. 2024-04-22T06:31:40.867 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-22T06:31:40.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.971+0000 7f9f52e55640 1 Processor -- start 2024-04-22T06:31:40.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.971+0000 7f9f52e55640 1 -- start start 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.971+0000 7f9f52e55640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9f4c151750 0x7f9f4c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.971+0000 7f9f52e55640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0c80b0 0x7f9f4c073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.971+0000 7f9f52e55640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9f4c0741e0 0x7f9f4c0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.971+0000 7f9f52e55640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9f4c0c3f20 con 0x7f9f4c151750 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.971+0000 7f9f52e55640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9f4c1575b0 con 0x7f9f4c0741e0 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.971+0000 7f9f52e55640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c157890 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f50bf1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9f4c151750 0x7f9f4c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f50bf1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9f4c151750 0x7f9f4c0c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46746/0 (socket says 172.21.15.113:46746) 2024-04-22T06:31:40.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f50bf1640 1 -- 172.21.15.113:0/2412465816 learned_addr learned my addr 172.21.15.113:0/2412465816 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f513f2640 1 --2- 172.21.15.113:0/2412465816 >> v2:172.21.15.145:3300/0 conn(0x7f9f4c0741e0 0x7f9f4c0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f4bfff640 1 --2- 172.21.15.113:0/2412465816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0c80b0 0x7f9f4c073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f50bf1640 1 -- 172.21.15.113:0/2412465816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0c80b0 msgr2=0x7f9f4c073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f50bf1640 1 --2- 172.21.15.113:0/2412465816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0c80b0 0x7f9f4c073ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f50bf1640 1 -- 172.21.15.113:0/2412465816 >> v2:172.21.15.145:3300/0 conn(0x7f9f4c0741e0 msgr2=0x7f9f4c0c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f50bf1640 1 --2- 172.21.15.113:0/2412465816 >> v2:172.21.15.145:3300/0 conn(0x7f9f4c0741e0 0x7f9f4c0c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f50bf1640 1 -- 172.21.15.113:0/2412465816 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c157b70 con 0x7f9f4c151750 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.972+0000 7f9f513f2640 1 --2- 172.21.15.113:0/2412465816 >> v2:172.21.15.145:3300/0 conn(0x7f9f4c0741e0 0x7f9f4c0c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f50bf1640 1 --2- 172.21.15.113:0/2412465816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c151750 0x7f9f4c0c39e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c155020 tx=0x7f9f4002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7ad1b414d16123 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f4b7fe640 1 -- 172.21.15.113:0/2412465816 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40034070 con 0x7f9f4c151750 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f4b7fe640 1 -- 172.21.15.113:0/2412465816 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f40030860 con 0x7f9f4c151750 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f4b7fe640 1 -- 172.21.15.113:0/2412465816 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40030c30 con 0x7f9f4c151750 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 -- 172.21.15.113:0/2412465816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c151750 msgr2=0x7f9f4c0c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:40.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 --2- 172.21.15.113:0/2412465816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c151750 0x7f9f4c0c39e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c155020 tx=0x7f9f4002b9a0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 -- 172.21.15.113:0/2412465816 shutdown_connections 2024-04-22T06:31:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 --2- 172.21.15.113:0/2412465816 >> v2:172.21.15.145:3300/0 conn(0x7f9f4c0741e0 0x7f9f4c0c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 --2- 172.21.15.113:0/2412465816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0c80b0 0x7f9f4c073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 --2- 172.21.15.113:0/2412465816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c151750 0x7f9f4c0c39e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 -- 172.21.15.113:0/2412465816 >> 172.21.15.113:0/2412465816 conn(0x7f9f4c074f30 msgr2=0x7f9f4c075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 -- 172.21.15.113:0/2412465816 shutdown_connections 2024-04-22T06:31:40.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.973+0000 7f9f52e55640 1 -- 172.21.15.113:0/2412465816 wait complete. 2024-04-22T06:31:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.974+0000 7f9f52e55640 1 Processor -- start 2024-04-22T06:31:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f52e55640 1 -- start start 2024-04-22T06:31:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f52e55640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0741e0 0x7f9f4c1f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f52e55640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c0c80b0 0x7f9f4c14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f52e55640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f4c151750 0x7f9f4c1f1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f52e55640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c151b30 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f52e55640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c158130 con 0x7f9f4c151750 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f52e55640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c0c8ca0 con 0x7f9f4c0741e0 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f4bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c0c80b0 0x7f9f4c14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f4bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c0c80b0 0x7f9f4c14ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46748/0 (socket says 172.21.15.113:46748) 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.975+0000 7f9f4bfff640 1 -- 172.21.15.113:0/1166755438 learned_addr learned my addr 172.21.15.113:0/1166755438 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f50bf1640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0741e0 0x7f9f4c1f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f4bfff640 1 -- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0741e0 msgr2=0x7f9f4c1f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f513f2640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f4c151750 0x7f9f4c1f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f4bfff640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0741e0 0x7f9f4c1f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f4bfff640 1 -- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f4c151750 msgr2=0x7f9f4c1f1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f4bfff640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f4c151750 0x7f9f4c1f1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f4bfff640 1 -- 172.21.15.113:0/1166755438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c0cca10 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f50bf1640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0741e0 0x7f9f4c1f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f513f2640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f4c151750 0x7f9f4c1f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f4bfff640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c0c80b0 0x7f9f4c14ff90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c5e0 tx=0x7f9f3800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f497fa640 1 -- 172.21.15.113:0/1166755438 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38015070 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f497fa640 1 -- 172.21.15.113:0/1166755438 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f38004260 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c0cc490 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f497fa640 1 -- 172.21.15.113:0/1166755438 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38003610 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.976+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c1f4760 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.977+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f4c0c7e40 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.978+0000 7f9f497fa640 1 -- 172.21.15.113:0/1166755438 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f380037b0 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.978+0000 7f9f497fa640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f3006c920 0x7f9f3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.978+0000 7f9f497fa640 1 -- 172.21.15.113:0/1166755438 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f9f3808bc80 con 0x7f9f4c0c80b0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.978+0000 7f9f50bf1640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f3006c920 0x7f9f3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:40.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.978+0000 7f9f50bf1640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f3006c920 0x7f9f3006ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f40036000 tx=0x7f9f4003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:40.981 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:40.983+0000 7f9f497fa640 1 -- 172.21.15.113:0/1166755438 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f4c0c7e40 con 0x7f9f4c0c80b0 2024-04-22T06:31:41.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.157+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f9f4c0c89a0 con 0x7f9f4c0c80b0 2024-04-22T06:31:41.850 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.852+0000 7f9f497fa640 1 -- 172.21.15.113:0/1166755438 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f9f38059d90 con 0x7f9f4c0c80b0 2024-04-22T06:31:41.851 INFO:teuthology.orchestra.run.smithi113.stderr:set pool 4 allow_ec_overwrites to true 2024-04-22T06:31:41.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.854+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f3006c920 msgr2=0x7f9f3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:41.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.854+0000 7f9f52e55640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f3006c920 0x7f9f3006ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f40036000 tx=0x7f9f4003b040 comp rx=0 tx=0).stop 2024-04-22T06:31:41.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.854+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c0c80b0 msgr2=0x7f9f4c14ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:41.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.854+0000 7f9f52e55640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c0c80b0 0x7f9f4c14ff90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c5e0 tx=0x7f9f3800caa0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.855+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 shutdown_connections 2024-04-22T06:31:41.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.855+0000 7f9f52e55640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f4c151750 0x7f9f4c1f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.855+0000 7f9f52e55640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f3006c920 0x7f9f3006ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.855+0000 7f9f52e55640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f4c0c80b0 0x7f9f4c14ff90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.855+0000 7f9f52e55640 1 --2- 172.21.15.113:0/1166755438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9f4c0741e0 0x7f9f4c1f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.855+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 >> 172.21.15.113:0/1166755438 conn(0x7f9f4c074f30 msgr2=0x7f9f4c0c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:41.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.855+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 shutdown_connections 2024-04-22T06:31:41.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.855+0000 7f9f52e55640 1 -- 172.21.15.113:0/1166755438 wait complete. 2024-04-22T06:31:41.874 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-22T06:31:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.984+0000 7efcdfb40640 1 Processor -- start 2024-04-22T06:31:41.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.984+0000 7efcdfb40640 1 -- start start 2024-04-22T06:31:41.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdfb40640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efcd8155530 0x7efcd815f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:41.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdfb40640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:41.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdfb40640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd80cbe10 con 0x7efcd80d0f00 2024-04-22T06:31:41.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdfb40640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7efcd815bf10 con 0x7efcd8155530 2024-04-22T06:31:41.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdfb40640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7efcd80cc0d0 con 0x7efcd80cccf0 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd8dc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efcd8155530 0x7efcd815f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd8dc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efcd8155530 0x7efcd815f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46764/0 (socket says 172.21.15.113:46764) 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd8dc640 1 -- 172.21.15.113:0/4072486448 learned_addr learned my addr 172.21.15.113:0/4072486448 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd0db640 1 --2- 172.21.15.113:0/4072486448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd8dc640 1 -- 172.21.15.113:0/4072486448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 msgr2=0x7efcd80d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd8dc640 1 --2- 172.21.15.113:0/4072486448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd8dc640 1 -- 172.21.15.113:0/4072486448 >> v1:172.21.15.145:6789/0 conn(0x7efcd80d0f00 legacy=0x7efcd80c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd8dc640 1 -- 172.21.15.113:0/4072486448 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd815b5e0 con 0x7efcd8155530 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.985+0000 7efcdd0db640 1 --2- 172.21.15.113:0/4072486448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.986+0000 7efcdd8dc640 1 --2- 172.21.15.113:0/4072486448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8155530 0x7efcd815f210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009e50 tx=0x7efcd402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65577ff711c81298 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.986+0000 7efcdc8da640 1 -- 172.21.15.113:0/4072486448 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd402cb00 con 0x7efcd8155530 2024-04-22T06:31:41.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.986+0000 7efcdc8da640 1 -- 172.21.15.113:0/4072486448 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd402cca0 con 0x7efcd8155530 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.986+0000 7efcdc8da640 1 -- 172.21.15.113:0/4072486448 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4034610 con 0x7efcd8155530 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.987+0000 7efcdfb40640 1 -- 172.21.15.113:0/4072486448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8155530 msgr2=0x7efcd815f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.987+0000 7efcdfb40640 1 --2- 172.21.15.113:0/4072486448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8155530 0x7efcd815f210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009e50 tx=0x7efcd402bf60 comp rx=0 tx=0).stop 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.987+0000 7efcdfb40640 1 -- 172.21.15.113:0/4072486448 shutdown_connections 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.987+0000 7efcdfb40640 1 --2- 172.21.15.113:0/4072486448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.987+0000 7efcdfb40640 1 --2- 172.21.15.113:0/4072486448 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8155530 0x7efcd815f210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.987+0000 7efcdfb40640 1 -- 172.21.15.113:0/4072486448 >> 172.21.15.113:0/4072486448 conn(0x7efcd806d350 msgr2=0x7efcd8073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.987+0000 7efcdfb40640 1 -- 172.21.15.113:0/4072486448 shutdown_connections 2024-04-22T06:31:41.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.987+0000 7efcdfb40640 1 -- 172.21.15.113:0/4072486448 wait complete. 2024-04-22T06:31:41.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.988+0000 7efcdfb40640 1 Processor -- start 2024-04-22T06:31:41.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.988+0000 7efcdfb40640 1 -- start start 2024-04-22T06:31:41.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdfb40640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:41.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdfb40640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd80d0f00 0x7efcd815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:41.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdfb40640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd8155530 0x7efcd815de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdfb40640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7efcd815b290 con 0x7efcd80d0f00 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdfb40640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efcd815bba0 con 0x7efcd8155530 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdfb40640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7efcd80cba90 con 0x7efcd80cccf0 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd80d0f00 0x7efcd815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd80d0f00 0x7efcd815d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46766/0 (socket says 172.21.15.113:46766) 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 -- 172.21.15.113:0/3550918212 learned_addr learned my addr 172.21.15.113:0/3550918212 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcde0dd640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd8155530 0x7efcd815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd8dc640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 -- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 msgr2=0x7efcd80ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 -- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd8155530 msgr2=0x7efcd815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:41.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd8155530 0x7efcd815de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 -- 172.21.15.113:0/3550918212 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd80b3450 con 0x7efcd80d0f00 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcde0dd640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd8155530 0x7efcd815de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdd0db640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd80d0f00 0x7efcd815d8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e7e0 tx=0x7efcc800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcce7fc640 1 -- 172.21.15.113:0/3550918212 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc800f040 con 0x7efcd80d0f00 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcce7fc640 1 -- 172.21.15.113:0/3550918212 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc8004030 con 0x7efcd80d0f00 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcce7fc640 1 -- 172.21.15.113:0/3550918212 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8004400 con 0x7efcd80d0f00 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd81562f0 con 0x7efcd80d0f00 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.989+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd81f1080 con 0x7efcd80d0f00 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.990+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd8069ef0 con 0x7efcd80d0f00 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.991+0000 7efcce7fc640 1 -- 172.21.15.113:0/3550918212 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efcc800c6d0 con 0x7efcd80d0f00 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.991+0000 7efcce7fc640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efcbc06c920 0x7efcbc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:41.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.991+0000 7efcdd8dc640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efcbc06c920 0x7efcbc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:41.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.991+0000 7efcce7fc640 1 -- 172.21.15.113:0/3550918212 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7efcc808bb80 con 0x7efcd80d0f00 2024-04-22T06:31:41.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.991+0000 7efcdd8dc640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efcbc06c920 0x7efcbc06ede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efcd4035000 tx=0x7efcd4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:41.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:41.995+0000 7efcce7fc640 1 -- 172.21.15.113:0/3550918212 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efcc8017020 con 0x7efcd80d0f00 2024-04-22T06:31:42.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.209+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7efcd81f0b90 con 0x7efcd80d0f00 2024-04-22T06:31:42.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.853+0000 7efcce7fc640 1 -- 172.21.15.113:0/3550918212 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7efcc808b0b0 con 0x7efcd80d0f00 2024-04-22T06:31:42.852 INFO:teuthology.orchestra.run.smithi113.stderr:added data pool 4 to fsmap 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efcbc06c920 msgr2=0x7efcbc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efcbc06c920 0x7efcbc06ede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efcd4035000 tx=0x7efcd4030000 comp rx=0 tx=0).stop 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd80d0f00 msgr2=0x7efcd815d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd80d0f00 0x7efcd815d8c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e7e0 tx=0x7efcc800eca0 comp rx=0 tx=0).stop 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 shutdown_connections 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcd8155530 0x7efcd815de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efcbc06c920 0x7efcbc06ede0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd80d0f00 0x7efcd815d8c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 --2- 172.21.15.113:0/3550918212 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcd80cccf0 0x7efcd80ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:42.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 >> 172.21.15.113:0/3550918212 conn(0x7efcd806d350 msgr2=0x7efcd80c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:42.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 shutdown_connections 2024-04-22T06:31:42.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.856+0000 7efcdfb40640 1 -- 172.21.15.113:0/3550918212 wait complete. 2024-04-22T06:31:42.867 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:31:42.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.967+0000 7f4b99863640 1 Processor -- start 2024-04-22T06:31:42.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.967+0000 7f4b99863640 1 -- start start 2024-04-22T06:31:42.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b99863640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4b940c8070 0x7f4b9415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b99863640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9406c850 con 0x7f4b940c8e10 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b99863640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9406cb30 con 0x7f4b941553a0 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b99863640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9406ce10 con 0x7f4b940c8070 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b937fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4b940c8070 0x7f4b9415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b937fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4b940c8070 0x7f4b9415ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46776/0 (socket says 172.21.15.113:46776) 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b8bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4b940c8e10 0x7f4b9415e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37170/0 (socket says 172.21.15.113:37170) 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b937fe640 1 -- 172.21.15.113:0/1290282937 learned_addr learned my addr 172.21.15.113:0/1290282937 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b937fe640 1 -- 172.21.15.113:0/1290282937 >> v1:172.21.15.145:6789/0 conn(0x7f4b941553a0 legacy=0x7f4b940c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b937fe640 1 -- 172.21.15.113:0/1290282937 >> v1:172.21.15.113:6789/0 conn(0x7f4b940c8e10 legacy=0x7f4b9415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:42.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.968+0000 7f4b937fe640 1 -- 172.21.15.113:0/1290282937 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9406d0f0 con 0x7f4b940c8070 2024-04-22T06:31:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.969+0000 7f4b937fe640 1 --2- 172.21.15.113:0/1290282937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8070 0x7f4b9415ed80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009e50 tx=0x7f4b8c02c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3c56f39df372fb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:42.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.969+0000 7f4b927fc640 1 -- 172.21.15.113:0/1290282937 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c02cc30 con 0x7f4b940c8070 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.969+0000 7f4b927fc640 1 -- 172.21.15.113:0/1290282937 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c02cdd0 con 0x7f4b940c8070 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.969+0000 7f4b927fc640 1 -- 172.21.15.113:0/1290282937 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c034610 con 0x7f4b940c8070 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.970+0000 7f4b99863640 1 -- 172.21.15.113:0/1290282937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8070 msgr2=0x7f4b9415ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.970+0000 7f4b99863640 1 --2- 172.21.15.113:0/1290282937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8070 0x7f4b9415ed80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009e50 tx=0x7f4b8c02c090 comp rx=0 tx=0).stop 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.970+0000 7f4b99863640 1 -- 172.21.15.113:0/1290282937 shutdown_connections 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.970+0000 7f4b99863640 1 --2- 172.21.15.113:0/1290282937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8070 0x7f4b9415ed80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.970+0000 7f4b99863640 1 -- 172.21.15.113:0/1290282937 >> 172.21.15.113:0/1290282937 conn(0x7f4b94073010 msgr2=0x7f4b94073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.970+0000 7f4b99863640 1 -- 172.21.15.113:0/1290282937 shutdown_connections 2024-04-22T06:31:42.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.970+0000 7f4b99863640 1 -- 172.21.15.113:0/1290282937 wait complete. 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.971+0000 7f4b99863640 1 Processor -- start 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.971+0000 7f4b99863640 1 -- start start 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b99863640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b940c8070 0x7f4b94152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b99863640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8e10 0x7f4b941f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b99863640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b941553a0 0x7f4b940d0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b99863640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9415f2c0 con 0x7f4b940c8e10 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b99863640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4b94155780 con 0x7f4b940c8070 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b99863640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9415f440 con 0x7f4b941553a0 2024-04-22T06:31:42.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8e10 0x7f4b941f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8e10 0x7f4b941f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46788/0 (socket says 172.21.15.113:46788) 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 -- 172.21.15.113:0/3819483372 learned_addr learned my addr 172.21.15.113:0/3819483372 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b92ffd640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b940c8070 0x7f4b94152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b937fe640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b941553a0 0x7f4b940d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 -- 172.21.15.113:0/3819483372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b941553a0 msgr2=0x7f4b940d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b941553a0 0x7f4b940d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 -- 172.21.15.113:0/3819483372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b940c8070 msgr2=0x7f4b94152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b940c8070 0x7f4b94152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 -- 172.21.15.113:0/3819483372 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b941f4d50 con 0x7f4b940c8e10 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b8bfff640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8e10 0x7f4b941f4370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c4d0 tx=0x7f4b7c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b90ff9640 1 -- 172.21.15.113:0/3819483372 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c018070 con 0x7f4b940c8e10 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b90ff9640 1 -- 172.21.15.113:0/3819483372 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c007480 con 0x7f4b940c8e10 2024-04-22T06:31:42.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b940cd620 con 0x7f4b940c8e10 2024-04-22T06:31:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b90ff9640 1 -- 172.21.15.113:0/3819483372 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0049e0 con 0x7f4b940c8e10 2024-04-22T06:31:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.972+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b940cf520 con 0x7f4b940c8e10 2024-04-22T06:31:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.973+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b940cd7f0 con 0x7f4b940c8e10 2024-04-22T06:31:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.974+0000 7f4b90ff9640 1 -- 172.21.15.113:0/3819483372 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b7c01b070 con 0x7f4b940c8e10 2024-04-22T06:31:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.974+0000 7f4b90ff9640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4b7406c8f0 0x7f4b7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:42.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.974+0000 7f4b92ffd640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4b7406c8f0 0x7f4b7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:42.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.974+0000 7f4b90ff9640 1 -- 172.21.15.113:0/3819483372 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b7c08b1a0 con 0x7f4b940c8e10 2024-04-22T06:31:42.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.975+0000 7f4b92ffd640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4b7406c8f0 0x7f4b7406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b84001580 tx=0x7f4b84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:42.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:42.979+0000 7f4b90ff9640 1 -- 172.21.15.113:0/3819483372 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b7c007670 con 0x7f4b940c8e10 2024-04-22T06:31:43.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.192+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b94068e40 con 0x7f4b940c8e10 2024-04-22T06:31:43.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.193+0000 7f4b90ff9640 1 -- 172.21.15.113:0/3819483372 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6831 (secure 0 0 0) 0x7f4b7c059320 con 0x7f4b940c8e10 2024-04-22T06:31:43.192 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:43.192 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4308,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:31:42.852730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4311,"qdb_cluster":[4311]},"id":1}]} 2024-04-22T06:31:43.192 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 6 2024-04-22T06:31:43.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4b7406c8f0 msgr2=0x7f4b7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4b7406c8f0 0x7f4b7406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b84001580 tx=0x7f4b84009040 comp rx=0 tx=0).stop 2024-04-22T06:31:43.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8e10 msgr2=0x7f4b941f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8e10 0x7f4b941f4370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c4d0 tx=0x7f4b7c00c990 comp rx=0 tx=0).stop 2024-04-22T06:31:43.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 shutdown_connections 2024-04-22T06:31:43.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b941553a0 0x7f4b940d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4b7406c8f0 0x7f4b7406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b940c8e10 0x7f4b941f4370 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 --2- 172.21.15.113:0/3819483372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b940c8070 0x7f4b94152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 >> 172.21.15.113:0/3819483372 conn(0x7f4b94073010 msgr2=0x7f4b9415cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:43.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 shutdown_connections 2024-04-22T06:31:43.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.195+0000 7f4b99863640 1 -- 172.21.15.113:0/3819483372 wait complete. 2024-04-22T06:31:43.205 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:43.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.303+0000 7f1ac55c3640 1 Processor -- start 2024-04-22T06:31:43.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.303+0000 7f1ac55c3640 1 -- start start 2024-04-22T06:31:43.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.304+0000 7f1ac55c3640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ac00c5b80 0x7f1ac015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.304+0000 7f1ac55c3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac00c9610 0x7f1ac00ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.304+0000 7f1ac55c3640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac0158570 con 0x7f1ac0151f10 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.304+0000 7f1ac55c3640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac015b8a0 con 0x7f1ac00c5b80 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.304+0000 7f1ac55c3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac0158850 con 0x7f1ac00c9610 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abe7fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ac00c5b80 0x7f1ac015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abf7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac00c9610 0x7f1ac00ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abeffd640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f1ac0151f10 0x7f1ac0157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:35054/0 (socket says 172.21.15.113:35054) 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abeffd640 1 -- 172.21.15.113:0/4188076092 learned_addr learned my addr 172.21.15.113:0/4188076092 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abe7fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ac00c5b80 0x7f1ac015bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:45346/0 (socket says 172.21.15.113:45346) 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abe7fc640 1 -- 172.21.15.113:0/4188076092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac00c9610 msgr2=0x7f1ac00ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abe7fc640 1 --2- 172.21.15.113:0/4188076092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac00c9610 0x7f1ac00ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abe7fc640 1 -- 172.21.15.113:0/4188076092 >> v1:172.21.15.145:6789/0 conn(0x7f1ac0151f10 legacy=0x7f1ac0157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abdffb640 1 -- 172.21.15.113:0/4188076092 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044619995 0 0) 0x7f1ac0158570 con 0x7f1ac0151f10 2024-04-22T06:31:43.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.305+0000 7f1abe7fc640 1 -- 172.21.15.113:0/4188076092 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac0158b30 con 0x7f1ac00c5b80 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1abe7fc640 1 --2- 172.21.15.113:0/4188076092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c5b80 0x7f1ac015bd30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ab40097a0 tx=0x7f1ab402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c14c72000209f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1abdffb640 1 -- 172.21.15.113:0/4188076092 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4034070 con 0x7f1ac00c5b80 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1abdffb640 1 -- 172.21.15.113:0/4188076092 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab4030610 con 0x7f1ac00c5b80 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1abdffb640 1 -- 172.21.15.113:0/4188076092 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40309e0 con 0x7f1ac00c5b80 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1ac55c3640 1 -- 172.21.15.113:0/4188076092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c5b80 msgr2=0x7f1ac015bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/4188076092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c5b80 0x7f1ac015bd30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ab40097a0 tx=0x7f1ab402b960 comp rx=0 tx=0).stop 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1ac55c3640 1 -- 172.21.15.113:0/4188076092 shutdown_connections 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/4188076092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac00c9610 0x7f1ac00ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/4188076092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c5b80 0x7f1ac015bd30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1ac55c3640 1 -- 172.21.15.113:0/4188076092 >> 172.21.15.113:0/4188076092 conn(0x7f1ac006bd10 msgr2=0x7f1ac006c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:43.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1ac55c3640 1 -- 172.21.15.113:0/4188076092 shutdown_connections 2024-04-22T06:31:43.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.306+0000 7f1ac55c3640 1 -- 172.21.15.113:0/4188076092 wait complete. 2024-04-22T06:31:43.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1ac55c3640 1 Processor -- start 2024-04-22T06:31:43.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1ac55c3640 1 -- start start 2024-04-22T06:31:43.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1ac55c3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ac00c5b80 0x7f1ac0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1ac55c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c9610 0x7f1ac01f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1ac55c3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac0151f10 0x7f1ac01f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1ac55c3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac00c7f80 con 0x7f1ac00c5b80 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1ac55c3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac015c270 con 0x7f1ac00c9610 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1ac55c3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac00c8100 con 0x7f1ac0151f10 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1abeffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ac00c5b80 0x7f1ac0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1abeffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ac00c5b80 0x7f1ac0156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46790/0 (socket says 172.21.15.113:46790) 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.308+0000 7f1abeffd640 1 -- 172.21.15.113:0/1157269895 learned_addr learned my addr 172.21.15.113:0/1157269895 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abe7fc640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c9610 0x7f1ac01f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abf7fe640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac0151f10 0x7f1ac01f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abeffd640 1 -- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac0151f10 msgr2=0x7f1ac01f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abeffd640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac0151f10 0x7f1ac01f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abeffd640 1 -- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c9610 msgr2=0x7f1ac01f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abeffd640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c9610 0x7f1ac01f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abeffd640 1 -- 172.21.15.113:0/1157269895 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac00cd400 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abf7fe640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac0151f10 0x7f1ac01f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1abeffd640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ac00c5b80 0x7f1ac0156d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c430 tx=0x7f1ab000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1aa77fe640 1 -- 172.21.15.113:0/1157269895 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00074e0 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1aa77fe640 1 -- 172.21.15.113:0/1157269895 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab00047e0 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1aa77fe640 1 -- 172.21.15.113:0/1157269895 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0004bd0 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac015ab10 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.309+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac00cd950 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.310+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac0068e40 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.310+0000 7f1aa77fe640 1 -- 172.21.15.113:0/1157269895 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ab0011070 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.311+0000 7f1aa77fe640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1aac06c8f0 0x7f1aac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.311+0000 7f1aa77fe640 1 -- 172.21.15.113:0/1157269895 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1ab008bb20 con 0x7f1ac00c5b80 2024-04-22T06:31:43.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.311+0000 7f1abe7fc640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1aac06c8f0 0x7f1aac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.311+0000 7f1abe7fc640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1aac06c8f0 0x7f1aac06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4036000 tx=0x7f1ab4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.315+0000 7f1aa77fe640 1 -- 172.21.15.113:0/1157269895 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ab0059b90 con 0x7f1ac00c5b80 2024-04-22T06:31:43.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.489+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ac00c93f0 con 0x7f1ac00c5b80 2024-04-22T06:31:43.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.490+0000 7f1aa77fe640 1 -- 172.21.15.113:0/1157269895 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f1ab0059490 con 0x7f1ac00c5b80 2024-04-22T06:31:43.489 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:43.489 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:43.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1aac06c8f0 msgr2=0x7f1aac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1aac06c8f0 0x7f1aac06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4036000 tx=0x7f1ab4008030 comp rx=0 tx=0).stop 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ac00c5b80 msgr2=0x7f1ac0156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ac00c5b80 0x7f1ac0156d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c430 tx=0x7f1ab000c8f0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 shutdown_connections 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ac0151f10 0x7f1ac01f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ac00c9610 0x7f1ac01f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1aac06c8f0 0x7f1aac06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 --2- 172.21.15.113:0/1157269895 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ac00c5b80 0x7f1ac0156d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 >> 172.21.15.113:0/1157269895 conn(0x7f1ac006bd10 msgr2=0x7f1ac0150790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 shutdown_connections 2024-04-22T06:31:43.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.492+0000 7f1ac55c3640 1 -- 172.21.15.113:0/1157269895 wait complete. 2024-04-22T06:31:43.502 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:43.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.599+0000 7f335b08c640 1 Processor -- start 2024-04-22T06:31:43.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.599+0000 7f335b08c640 1 -- start start 2024-04-22T06:31:43.601 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f335b08c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3354155550 0x7f335415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.601 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f335b08c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f33540cb9e0 0x7f33540c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.601 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f335b08c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33540ccf00 con 0x7f3354155170 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f335b08c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f33540cddf0 con 0x7f33540cb9e0 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f335b08c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f335415f430 con 0x7f3354155550 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f3358e28640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3354155170 0x7f33540d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37184/0 (socket says 172.21.15.113:37184) 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f3358e28640 1 -- 172.21.15.113:0/3795809538 learned_addr learned my addr 172.21.15.113:0/3795809538 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f3359629640 1 --2- 172.21.15.113:0/3795809538 >> v2:172.21.15.145:3300/0 conn(0x7f33540cb9e0 0x7f33540c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f3353fff640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3354155550 0x7f335415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334118634 0 0) 0x7f33540ccf00 con 0x7f3354155170 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f333c003520 con 0x7f3354155170 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.600+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 46635879 0 0) 0x7f333c003520 con 0x7f3354155170 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3354155550 msgr2=0x7f335415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3354155550 0x7f335415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 >> v2:172.21.15.145:3300/0 conn(0x7f33540cb9e0 msgr2=0x7f33540c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 --2- 172.21.15.113:0/3795809538 >> v2:172.21.15.145:3300/0 conn(0x7f33540cb9e0 0x7f33540c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33540cd1e0 con 0x7f3354155170 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f3344001670 con 0x7f3354155170 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3359629640 1 --2- 172.21.15.113:0/3795809538 >> v2:172.21.15.145:3300/0 conn(0x7f33540cb9e0 0x7f33540c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 >> v1:172.21.15.113:6789/0 conn(0x7f3354155170 legacy=0x7f33540d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3354155550 0x7f333c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c003f30 0x7f333c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f333c004d40 0x7f333c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f33540cddf0 con 0x7f333c004d40 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f335415f430 con 0x7f333c003f30 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f333c00ba10 con 0x7f3354155550 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3359629640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f333c004d40 0x7f333c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3358e28640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3354155550 0x7f333c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3353fff640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c003f30 0x7f333c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3359629640 1 -- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3354155550 msgr2=0x7f333c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3359629640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3354155550 0x7f333c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3359629640 1 -- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c003f30 msgr2=0x7f333c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3359629640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c003f30 0x7f333c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.601+0000 7f3359629640 1 -- 172.21.15.113:0/3795809538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c003520 con 0x7f333c004d40 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f3359629640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f333c004d40 0x7f333c0051c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f334c00e380 tx=0x7f333c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c9f60e934cdb57 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c039070 con 0x7f333c004d40 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c02cde0 con 0x7f333c004d40 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f33537fe640 1 -- 172.21.15.113:0/3795809538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c009de0 con 0x7f333c004d40 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f335b08c640 1 -- 172.21.15.113:0/3795809538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f333c004d40 msgr2=0x7f333c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f335b08c640 1 --2- 172.21.15.113:0/3795809538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f333c004d40 0x7f333c0051c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f334c00e380 tx=0x7f333c005830 comp rx=0 tx=0).stop 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f3359629640 1 -- 172.21.15.113:0/3795809538 reap_dead start 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f335b08c640 1 -- 172.21.15.113:0/3795809538 shutdown_connections 2024-04-22T06:31:43.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f335b08c640 1 -- 172.21.15.113:0/3795809538 >> 172.21.15.113:0/3795809538 conn(0x7f3354072570 msgr2=0x7f3354074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:43.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.602+0000 7f335b08c640 1 -- 172.21.15.113:0/3795809538 shutdown_connections 2024-04-22T06:31:43.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.603+0000 7f335b08c640 1 -- 172.21.15.113:0/3795809538 wait complete. 2024-04-22T06:31:43.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.604+0000 7f335b08c640 1 Processor -- start 2024-04-22T06:31:43.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.604+0000 7f335b08c640 1 -- start start 2024-04-22T06:31:43.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.604+0000 7f335b08c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c004d40 0x7f33540d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.604+0000 7f335b08c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33540b5ed0 0x7f33541f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f335b08c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33541f1400 0x7f335414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f335b08c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f33540cda80 con 0x7f33540b5ed0 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f335b08c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f33540cd7a0 con 0x7f333c004d40 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f335b08c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f33540ccae0 con 0x7f33541f1400 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33540b5ed0 0x7f33541f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33540b5ed0 0x7f33541f0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46810/0 (socket says 172.21.15.113:46810) 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 -- 172.21.15.113:0/1946968049 learned_addr learned my addr 172.21.15.113:0/1946968049 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3358e28640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c004d40 0x7f33540d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3359629640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33541f1400 0x7f335414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 -- 172.21.15.113:0/1946968049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33541f1400 msgr2=0x7f335414acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33541f1400 0x7f335414acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 -- 172.21.15.113:0/1946968049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c004d40 msgr2=0x7f33540d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c004d40 0x7f33540d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 -- 172.21.15.113:0/1946968049 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33541f1880 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f3353fff640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33540b5ed0 0x7f33541f0ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33480119c0 tx=0x7f3348011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f33517fa640 1 -- 172.21.15.113:0/1946968049 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334800faf0 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f33517fa640 1 -- 172.21.15.113:0/1946968049 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334800fc90 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335414ee00 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f33517fa640 1 -- 172.21.15.113:0/1946968049 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3348014640 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.605+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33540cf910 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.606+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3354152600 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.607+0000 7f33517fa640 1 -- 172.21.15.113:0/1946968049 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3348012040 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.607+0000 7f33517fa640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f334006c8f0 0x7f334006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.607+0000 7f3358e28640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f334006c8f0 0x7f334006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.607+0000 7f33517fa640 1 -- 172.21.15.113:0/1946968049 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f334808c550 con 0x7f33540b5ed0 2024-04-22T06:31:43.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.607+0000 7f3358e28640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f334006c8f0 0x7f334006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3344001610 tx=0x7f3344009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.611+0000 7f33517fa640 1 -- 172.21.15.113:0/1946968049 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3354152600 con 0x7f33540b5ed0 2024-04-22T06:31:43.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.787+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3354068e40 con 0x7f33540b5ed0 2024-04-22T06:31:43.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.789+0000 7f33517fa640 1 -- 172.21.15.113:0/1946968049 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f33541f1880 con 0x7f33540b5ed0 2024-04-22T06:31:43.787 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:43.787 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f334006c8f0 msgr2=0x7f334006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f334006c8f0 0x7f334006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3344001610 tx=0x7f3344009040 comp rx=0 tx=0).stop 2024-04-22T06:31:43.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33540b5ed0 msgr2=0x7f33541f0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33540b5ed0 0x7f33541f0ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33480119c0 tx=0x7f3348011e80 comp rx=0 tx=0).stop 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 shutdown_connections 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33541f1400 0x7f335414acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f334006c8f0 0x7f334006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33540b5ed0 0x7f33541f0ec0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 --2- 172.21.15.113:0/1946968049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f333c004d40 0x7f33540d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 >> 172.21.15.113:0/1946968049 conn(0x7f3354072570 msgr2=0x7f3354150ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 shutdown_connections 2024-04-22T06:31:43.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.791+0000 7f335b08c640 1 -- 172.21.15.113:0/1946968049 wait complete. 2024-04-22T06:31:43.814 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:31:43.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.912+0000 7f009d6ba640 1 Processor -- start 2024-04-22T06:31:43.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.912+0000 7f009d6ba640 1 -- start start 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.912+0000 7f009d6ba640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f00980c8070 0x7f009815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.912+0000 7f009d6ba640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009806c850 con 0x7f00980c8e10 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.912+0000 7f009d6ba640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009806cb30 con 0x7f00981553a0 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.912+0000 7f009d6ba640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f009806ce10 con 0x7f00980c8070 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f00967fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f00980c8e10 0x7f009815e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37196/0 (socket says 172.21.15.113:37196) 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f00967fc640 1 -- 172.21.15.113:0/1722314944 learned_addr learned my addr 172.21.15.113:0/1722314944 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f00977fe640 1 --2- 172.21.15.113:0/1722314944 >> v2:172.21.15.145:3300/0 conn(0x7f00980c8070 0x7f009815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558249536 0 0) 0x7f009806c850 con 0x7f00980c8e10 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0080003520 con 0x7f00980c8e10 2024-04-22T06:31:43.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1035138624 0 0) 0x7f0080003520 con 0x7f00980c8e10 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 >> v2:172.21.15.145:3300/0 conn(0x7f00980c8070 msgr2=0x7f009815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 --2- 172.21.15.113:0/1722314944 >> v2:172.21.15.145:3300/0 conn(0x7f00980c8070 0x7f009815ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 >> v1:172.21.15.145:6789/0 conn(0x7f00981553a0 legacy=0x7f00980c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009806d0f0 con 0x7f00980c8e10 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f008c001670 con 0x7f00980c8e10 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 >> v1:172.21.15.113:6789/0 conn(0x7f00980c8e10 legacy=0x7f009815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00800039b0 0x7f0080003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00800043b0 0x7f0080004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0080005080 0x7f008000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f009806ce10 con 0x7f00800039b0 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f008000bf30 con 0x7f0080005080 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f008000c130 con 0x7f00800043b0 2024-04-22T06:31:43.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0096ffd640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00800039b0 0x7f0080003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f00967fc640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00800043b0 0x7f0080004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f00977fe640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0080005080 0x7f008000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0096ffd640 1 -- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00800043b0 msgr2=0x7f0080004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0096ffd640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00800043b0 0x7f0080004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0096ffd640 1 -- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0080005080 msgr2=0x7f008000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0096ffd640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0080005080 0x7f008000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f0096ffd640 1 -- 172.21.15.113:0/1722314944 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0080003520 con 0x7f00800039b0 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.913+0000 7f00977fe640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0080005080 0x7f008000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.914+0000 7f00977fe640 1 -- 172.21.15.113:0/1722314944 reap_dead start 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.914+0000 7f0096ffd640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00800039b0 0x7f0080003d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0088001860 tx=0x7f0080005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4e44e147dfbabb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.914+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088038070 con 0x7f00800039b0 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.914+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0088033410 con 0x7f00800039b0 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.914+0000 7f0095ffb640 1 -- 172.21.15.113:0/1722314944 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088001430 con 0x7f00800039b0 2024-04-22T06:31:43.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.915+0000 7f009d6ba640 1 -- 172.21.15.113:0/1722314944 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00800039b0 msgr2=0x7f0080003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.915+0000 7f009d6ba640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00800039b0 0x7f0080003d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0088001860 tx=0x7f0080005830 comp rx=0 tx=0).stop 2024-04-22T06:31:43.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.915+0000 7f009d6ba640 1 -- 172.21.15.113:0/1722314944 shutdown_connections 2024-04-22T06:31:43.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.915+0000 7f009d6ba640 1 --2- 172.21.15.113:0/1722314944 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00800039b0 0x7f0080003d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.915+0000 7f009d6ba640 1 -- 172.21.15.113:0/1722314944 >> 172.21.15.113:0/1722314944 conn(0x7f0098073010 msgr2=0x7f0098073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:43.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.915+0000 7f009d6ba640 1 -- 172.21.15.113:0/1722314944 shutdown_connections 2024-04-22T06:31:43.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.915+0000 7f009d6ba640 1 -- 172.21.15.113:0/1722314944 wait complete. 2024-04-22T06:31:43.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.916+0000 7f009d6ba640 1 Processor -- start 2024-04-22T06:31:43.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.916+0000 7f009d6ba640 1 -- start start 2024-04-22T06:31:43.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f009d6ba640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00800039b0 0x7f0098155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f009d6ba640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00980c63d0 0x7f00981f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f009d6ba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00980cd590 0x7f00981582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f009d6ba640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f009815bb80 con 0x7f00980cd590 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f009d6ba640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0098155780 con 0x7f00800039b0 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f009d6ba640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f009815bd00 con 0x7f00980c63d0 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00980cd590 0x7f00981582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00980cd590 0x7f00981582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46820/0 (socket says 172.21.15.113:46820) 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 -- 172.21.15.113:0/1345156683 learned_addr learned my addr 172.21.15.113:0/1345156683 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f0096ffd640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00800039b0 0x7f0098155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00967fc640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00980c63d0 0x7f00981f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 -- 172.21.15.113:0/1345156683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00980c63d0 msgr2=0x7f00981f1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00980c63d0 0x7f00981f1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 -- 172.21.15.113:0/1345156683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00800039b0 msgr2=0x7f0098155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00800039b0 0x7f0098155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 -- 172.21.15.113:0/1345156683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00980c6e20 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.917+0000 7f00977fe640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00980cd590 0x7f00981582f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f009808e4d0 tx=0x7f0090010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.918+0000 7f007f7fe640 1 -- 172.21.15.113:0/1345156683 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090010da0 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.918+0000 7f007f7fe640 1 -- 172.21.15.113:0/1345156683 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0090003990 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.918+0000 7f007f7fe640 1 -- 172.21.15.113:0/1345156683 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090003d80 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.918+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00980c7100 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.918+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00981f0c30 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.919+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0098068e40 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.919+0000 7f007f7fe640 1 -- 172.21.15.113:0/1345156683 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f009001e020 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.919+0000 7f007f7fe640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f008406c8f0 0x7f008406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.919+0000 7f0096ffd640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f008406c8f0 0x7f008406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.919+0000 7f007f7fe640 1 -- 172.21.15.113:0/1345156683 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f009008c5b0 con 0x7f00980cd590 2024-04-22T06:31:43.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.920+0000 7f0096ffd640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f008406c8f0 0x7f008406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0088035000 tx=0x7f0088009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:43.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:43.924+0000 7f007f7fe640 1 -- 172.21.15.113:0/1345156683 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f009005a610 con 0x7f00980cd590 2024-04-22T06:31:44.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.136+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00980c87a0 con 0x7f00980cd590 2024-04-22T06:31:44.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.137+0000 7f007f7fe640 1 -- 172.21.15.113:0/1345156683 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6831 (secure 0 0 0) 0x7f0090059f10 con 0x7f00980cd590 2024-04-22T06:31:44.136 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:44.136 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4308,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:31:42.852730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4311,"qdb_cluster":[4311]},"id":1}]} 2024-04-22T06:31:44.137 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 6 2024-04-22T06:31:44.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.138+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f008406c8f0 msgr2=0x7f008406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:44.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.138+0000 7f009d6ba640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f008406c8f0 0x7f008406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0088035000 tx=0x7f0088009030 comp rx=0 tx=0).stop 2024-04-22T06:31:44.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.138+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00980cd590 msgr2=0x7f00981582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:44.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.138+0000 7f009d6ba640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00980cd590 0x7f00981582f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f009808e4d0 tx=0x7f0090010590 comp rx=0 tx=0).stop 2024-04-22T06:31:44.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.138+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 shutdown_connections 2024-04-22T06:31:44.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.138+0000 7f009d6ba640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f008406c8f0 0x7f008406edb0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0088035000 tx=0x7f0088009030 comp rx=0 tx=0).stop 2024-04-22T06:31:44.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.138+0000 7f009d6ba640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00980cd590 0x7f00981582f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.138+0000 7f009d6ba640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f00980c63d0 0x7f00981f1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.139+0000 7f009d6ba640 1 --2- 172.21.15.113:0/1345156683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00800039b0 0x7f0098155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.139+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 >> 172.21.15.113:0/1345156683 conn(0x7f0098073010 msgr2=0x7f00980733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:44.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.139+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 shutdown_connections 2024-04-22T06:31:44.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.139+0000 7f009d6ba640 1 -- 172.21.15.113:0/1345156683 wait complete. 2024-04-22T06:31:44.149 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:44.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.245+0000 7f006e4d2640 1 Processor -- start 2024-04-22T06:31:44.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.245+0000 7f006e4d2640 1 -- start start 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006e4d2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0068155170 0x7f006815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006e4d2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00680cb9e0 0x7f00680c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006e4d2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00680ccf00 con 0x7f0068155550 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006e4d2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f00680cddf0 con 0x7f00680cb9e0 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006e4d2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f006815f430 con 0x7f0068155170 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006ca6f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00680cb9e0 0x7f00680c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f00677fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0068155550 0x7f00680d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37210/0 (socket says 172.21.15.113:37210) 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f00677fe640 1 -- 172.21.15.113:0/810130901 learned_addr learned my addr 172.21.15.113:0/810130901 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006ca6f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f00680cb9e0 0x7f00680c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46836/0 (socket says 172.21.15.113:46836) 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f0067fff640 1 --2- 172.21.15.113:0/810130901 >> v2:172.21.15.145:3300/0 conn(0x7f0068155170 0x7f006815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006ca6f640 1 -- 172.21.15.113:0/810130901 >> v2:172.21.15.145:3300/0 conn(0x7f0068155170 msgr2=0x7f006815eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:44.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006ca6f640 1 --2- 172.21.15.113:0/810130901 >> v2:172.21.15.145:3300/0 conn(0x7f0068155170 0x7f006815eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.246+0000 7f006ca6f640 1 -- 172.21.15.113:0/810130901 >> v1:172.21.15.113:6789/0 conn(0x7f0068155550 legacy=0x7f00680d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.247+0000 7f006ca6f640 1 -- 172.21.15.113:0/810130901 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00680cd1e0 con 0x7f00680cb9e0 2024-04-22T06:31:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.247+0000 7f0066ffd640 1 -- 172.21.15.113:0/810130901 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733127104 0 0) 0x7f00680ccf00 con 0x7f0068155550 2024-04-22T06:31:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.247+0000 7f0067fff640 1 --2- 172.21.15.113:0/810130901 >> v2:172.21.15.145:3300/0 conn(0x7f0068155170 0x7f006815eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.247+0000 7f006ca6f640 1 --2- 172.21.15.113:0/810130901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00680cb9e0 0x7f00680c5810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0060009d90 tx=0x7f006002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f48c64768809af8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.247+0000 7f0066ffd640 1 -- 172.21.15.113:0/810130901 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060039070 con 0x7f00680cb9e0 2024-04-22T06:31:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.247+0000 7f0066ffd640 1 -- 172.21.15.113:0/810130901 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006002cc60 con 0x7f00680cb9e0 2024-04-22T06:31:44.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.247+0000 7f0066ffd640 1 -- 172.21.15.113:0/810130901 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060034660 con 0x7f00680cb9e0 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.248+0000 7f006e4d2640 1 -- 172.21.15.113:0/810130901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00680cb9e0 msgr2=0x7f00680c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.248+0000 7f006e4d2640 1 --2- 172.21.15.113:0/810130901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00680cb9e0 0x7f00680c5810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0060009d90 tx=0x7f006002beb0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.248+0000 7f006e4d2640 1 -- 172.21.15.113:0/810130901 shutdown_connections 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.248+0000 7f006e4d2640 1 --2- 172.21.15.113:0/810130901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f00680cb9e0 0x7f00680c5810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.248+0000 7f006e4d2640 1 --2- 172.21.15.113:0/810130901 >> v2:172.21.15.145:3300/0 conn(0x7f0068155170 0x7f006815eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.248+0000 7f006e4d2640 1 -- 172.21.15.113:0/810130901 >> 172.21.15.113:0/810130901 conn(0x7f0068072570 msgr2=0x7f0068074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.248+0000 7f006e4d2640 1 -- 172.21.15.113:0/810130901 shutdown_connections 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.248+0000 7f006e4d2640 1 -- 172.21.15.113:0/810130901 wait complete. 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.249+0000 7f006e4d2640 1 Processor -- start 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.249+0000 7f006e4d2640 1 -- start start 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f006e4d2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00680cb9e0 0x7f006814b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:44.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f006e4d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0068155170 0x7f006815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f006e4d2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0068155550 0x7f006815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f006e4d2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f00680cda80 con 0x7f0068155170 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f006e4d2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f00680cd7a0 con 0x7f00680cb9e0 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f006e4d2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f00680ccae0 con 0x7f0068155550 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0068155170 0x7f006815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0068155170 0x7f006815a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46852/0 (socket says 172.21.15.113:46852) 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 -- 172.21.15.113:0/1871313250 learned_addr learned my addr 172.21.15.113:0/1871313250 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f006ca6f640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0068155550 0x7f006815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f0067fff640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00680cb9e0 0x7f006814b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 -- 172.21.15.113:0/1871313250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0068155550 msgr2=0x7f006815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0068155550 0x7f006815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 -- 172.21.15.113:0/1871313250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00680cb9e0 msgr2=0x7f006814b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:44.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00680cb9e0 0x7f006814b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 -- 172.21.15.113:0/1871313250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00680caf60 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f00677fe640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0068155170 0x7f006815a5b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c410 tx=0x7f005c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f0064ff9640 1 -- 172.21.15.113:0/1871313250 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c0074e0 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.250+0000 7f0064ff9640 1 -- 172.21.15.113:0/1871313250 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005c0047e0 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.251+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00681f1500 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.251+0000 7f0064ff9640 1 -- 172.21.15.113:0/1871313250 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c004bd0 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.251+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0068159840 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.251+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0068068e40 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.252+0000 7f0064ff9640 1 -- 172.21.15.113:0/1871313250 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f005c011070 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.252+0000 7f0064ff9640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f005406c920 0x7f005406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.252+0000 7f0064ff9640 1 -- 172.21.15.113:0/1871313250 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f005c08b9c0 con 0x7f0068155170 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.252+0000 7f0067fff640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f005406c920 0x7f005406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:44.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.253+0000 7f0067fff640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f005406c920 0x7f005406ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f005800a990 tx=0x7f0058008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:44.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.257+0000 7f0064ff9640 1 -- 172.21.15.113:0/1871313250 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f005c08de20 con 0x7f0068155170 2024-04-22T06:31:44.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.432+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00680cc2b0 con 0x7f0068155170 2024-04-22T06:31:44.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.433+0000 7f0064ff9640 1 -- 172.21.15.113:0/1871313250 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f005c059b40 con 0x7f0068155170 2024-04-22T06:31:44.433 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:44.433 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f005406c920 msgr2=0x7f005406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f005406c920 0x7f005406ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f005800a990 tx=0x7f0058008040 comp rx=0 tx=0).stop 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0068155170 msgr2=0x7f006815a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0068155170 0x7f006815a5b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c410 tx=0x7f005c00c8d0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 shutdown_connections 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0068155550 0x7f006815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f005406c920 0x7f005406ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0068155170 0x7f006815a5b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 --2- 172.21.15.113:0/1871313250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00680cb9e0 0x7f006814b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:44.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 >> 172.21.15.113:0/1871313250 conn(0x7f0068072570 msgr2=0x7f0068153a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:44.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 shutdown_connections 2024-04-22T06:31:44.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:44.435+0000 7f006e4d2640 1 -- 172.21.15.113:0/1871313250 wait complete. 2024-04-22T06:31:45.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-22T06:31:37.179004+0000', 'modified': '2024-04-22T06:31:42.852730+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4311}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4311': {'gid': 4311, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.113:6839/4160787448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6837', 'nonce': 4160787448}, {'type': 'v1', 'addr': '172.21.15.113:6839', 'nonce': 4160787448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4311, 'qdb_cluster': [4311]} 2024-04-22T06:31:45.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-22T06:31:45.050 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-22T06:31:45.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.152+0000 7f874ecc1640 1 Processor -- start 2024-04-22T06:31:45.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.152+0000 7f874ecc1640 1 -- start start 2024-04-22T06:31:45.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.153+0000 7f874ecc1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f874806bf70 0x7f874815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.153+0000 7f874ecc1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87480c99f0 0x7f87480c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.153+0000 7f874ecc1640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874815bef0 con 0x7f874806bb90 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.153+0000 7f874ecc1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f874815f510 con 0x7f874806bf70 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.153+0000 7f874ecc1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f874815b650 con 0x7f87480c99f0 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.153+0000 7f8747fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f874806bf70 0x7f874815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.153+0000 7f8747fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f874806bf70 0x7f874815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46860/0 (socket says 172.21.15.113:46860) 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.153+0000 7f8747fff640 1 -- 172.21.15.113:0/3876532401 learned_addr learned my addr 172.21.15.113:0/3876532401 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.154+0000 7f874d25e640 1 --2- 172.21.15.113:0/3876532401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87480c99f0 0x7f87480c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.154+0000 7f8747fff640 1 -- 172.21.15.113:0/3876532401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87480c99f0 msgr2=0x7f87480c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.154+0000 7f8747fff640 1 --2- 172.21.15.113:0/3876532401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87480c99f0 0x7f87480c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.154+0000 7f8747fff640 1 -- 172.21.15.113:0/3876532401 >> v1:172.21.15.145:6789/0 conn(0x7f874806bb90 legacy=0x7f874815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:45.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.154+0000 7f8747fff640 1 -- 172.21.15.113:0/3876532401 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874815b930 con 0x7f874806bf70 2024-04-22T06:31:45.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.154+0000 7f8747fff640 1 --2- 172.21.15.113:0/3876532401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f874815af70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f873c009870 tx=0x7f873c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e48aacb90693ab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f87477fe640 1 -- 172.21.15.113:0/3876532401 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c02f840 con 0x7f874806bf70 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f87477fe640 1 -- 172.21.15.113:0/3876532401 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c02f9e0 con 0x7f874806bf70 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f87477fe640 1 -- 172.21.15.113:0/3876532401 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c02fdb0 con 0x7f874806bf70 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f874ecc1640 1 -- 172.21.15.113:0/3876532401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 msgr2=0x7f874815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f874ecc1640 1 --2- 172.21.15.113:0/3876532401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f874815af70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f873c009870 tx=0x7f873c02ba20 comp rx=0 tx=0).stop 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f874ecc1640 1 -- 172.21.15.113:0/3876532401 shutdown_connections 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f874ecc1640 1 --2- 172.21.15.113:0/3876532401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f87480c99f0 0x7f87480c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f874ecc1640 1 --2- 172.21.15.113:0/3876532401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f874815af70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f874ecc1640 1 -- 172.21.15.113:0/3876532401 >> 172.21.15.113:0/3876532401 conn(0x7f8748074d50 msgr2=0x7f8748075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:45.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f874ecc1640 1 -- 172.21.15.113:0/3876532401 shutdown_connections 2024-04-22T06:31:45.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.155+0000 7f874ecc1640 1 -- 172.21.15.113:0/3876532401 wait complete. 2024-04-22T06:31:45.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.156+0000 7f874ecc1640 1 Processor -- start 2024-04-22T06:31:45.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.156+0000 7f874ecc1640 1 -- start start 2024-04-22T06:31:45.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f874ecc1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874806bb90 0x7f8748156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f874ecc1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f8748156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f874ecc1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87480c99f0 0x7f87481f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f874ecc1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f874815e8e0 con 0x7f874806bf70 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f874ecc1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f874815e600 con 0x7f87480c99f0 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f874ecc1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8748074560 con 0x7f874806bb90 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f8747fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f8748156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f8747fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f8748156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46872/0 (socket says 172.21.15.113:46872) 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f8747fff640 1 -- 172.21.15.113:0/623119688 learned_addr learned my addr 172.21.15.113:0/623119688 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f874d25e640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87480c99f0 0x7f87481f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.157+0000 7f874ca5d640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874806bb90 0x7f8748156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f8747fff640 1 -- 172.21.15.113:0/623119688 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874806bb90 msgr2=0x7f8748156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:45.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f8747fff640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874806bb90 0x7f8748156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f8747fff640 1 -- 172.21.15.113:0/623119688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87480c99f0 msgr2=0x7f87481f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f8747fff640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87480c99f0 0x7f87481f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f8747fff640 1 -- 172.21.15.113:0/623119688 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8748158220 con 0x7f874806bf70 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f8747fff640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f8748156e80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f873c02ba60 tx=0x7f873c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f87457fa640 1 -- 172.21.15.113:0/623119688 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c047070 con 0x7f874806bf70 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f87457fa640 1 -- 172.21.15.113:0/623119688 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c037bc0 con 0x7f874806bf70 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f87457fa640 1 -- 172.21.15.113:0/623119688 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c042480 con 0x7f874806bf70 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f874ecc1640 1 -- 172.21.15.113:0/623119688 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87481584e0 con 0x7f874806bf70 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.158+0000 7f874ecc1640 1 -- 172.21.15.113:0/623119688 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8748155b80 con 0x7f874806bf70 2024-04-22T06:31:45.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.159+0000 7f87457fa640 1 -- 172.21.15.113:0/623119688 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f873c04a070 con 0x7f874806bf70 2024-04-22T06:31:45.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.160+0000 7f87457fa640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f873406c8f0 0x7f873406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.160+0000 7f874ca5d640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f873406c8f0 0x7f873406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.160+0000 7f87457fa640 1 -- 172.21.15.113:0/623119688 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f873c0ae110 con 0x7f874806bf70 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.160+0000 7f874ca5d640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f873406c8f0 0x7f873406edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8740001f10 tx=0x7f8740009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.161+0000 7f8751993740 1 Processor -- start 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.161+0000 7f8751993740 1 -- start start 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.161+0000 7f8751993740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627fae40 0x555c62803f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.161+0000 7f8751993740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 0x555c628044a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.161+0000 7f8751993740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627b7ca0 0x555c627dfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.161+0000 7f8751993740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x555c6271eb10 con 0x555c627b7ca0 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.161+0000 7f8751993740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555c626bc240 con 0x555c627bbec0 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.161+0000 7f8751993740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x555c6271aad0 con 0x555c627fae40 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627b7ca0 0x555c627dfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627b7ca0 0x555c627dfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46880/0 (socket says 172.21.15.113:46880) 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 -- 172.21.15.113:0/2980766640 learned_addr learned my addr 172.21.15.113:0/2980766640 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874ca5d640 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627fae40 0x555c62803f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f8747fff640 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 0x555c628044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 -- 172.21.15.113:0/2980766640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627fae40 msgr2=0x555c62803f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627fae40 0x555c62803f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 -- 172.21.15.113:0/2980766640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 msgr2=0x555c628044a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 0x555c628044a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 -- 172.21.15.113:0/2980766640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c624312d0 con 0x555c627b7ca0 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f874d25e640 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627b7ca0 0x555c627dfee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8738009b60 tx=0x7f8738011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460339aee374465a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f872e7fc640 1 -- 172.21.15.113:0/2980766640 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8738009e60 con 0x555c627b7ca0 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f872e7fc640 1 -- 172.21.15.113:0/2980766640 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8738014440 con 0x555c627b7ca0 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.162+0000 7f872e7fc640 1 -- 172.21.15.113:0/2980766640 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87380147f0 con 0x555c627b7ca0 2024-04-22T06:31:45.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 -- 172.21.15.113:0/2980766640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627b7ca0 msgr2=0x555c627dfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627b7ca0 0x555c627dfee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8738009b60 tx=0x7f8738011690 comp rx=0 tx=0).stop 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 -- 172.21.15.113:0/2980766640 shutdown_connections 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627b7ca0 0x555c627dfee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 0x555c628044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 --2- 172.21.15.113:0/2980766640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627fae40 0x555c62803f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 -- 172.21.15.113:0/2980766640 >> 172.21.15.113:0/2980766640 conn(0x555c627b6990 msgr2=0x555c627b9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 -- 172.21.15.113:0/2980766640 shutdown_connections 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 -- 172.21.15.113:0/2980766640 wait complete. 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 -- start start 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.163+0000 7f8751993740 1 Processor -- start 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8751993740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 0x555c627ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8751993740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627fae40 0x555c6280efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8751993740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8751993740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x555c627ba250 con 0x555c627fae40 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8751993740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555c626a7190 con 0x555c627bbec0 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8751993740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x555c627ba530 con 0x555c627f8790 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8751993740 10 client.0 _ll_register_callbacks cb 0x555c626a28b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8747fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627fae40 0x555c6280efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8747fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627fae40 0x555c6280efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46882/0 (socket says 172.21.15.113:46882) 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f8747fff640 1 -- 172.21.15.113:0/201322460 learned_addr learned my addr 172.21.15.113:0/201322460 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f874ca5d640 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 0x555c627ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.164+0000 7f874d25e640 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8747fff640 1 -- 172.21.15.113:0/201322460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 msgr2=0x555c627f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8747fff640 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8747fff640 1 -- 172.21.15.113:0/201322460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 msgr2=0x555c627ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8747fff640 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 0x555c627ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8747fff640 1 -- 172.21.15.113:0/201322460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c624fb6b0 con 0x555c627fae40 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8747fff640 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627fae40 0x555c6280efa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f873c0780a0 tx=0x7f873c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68f03a4d436f316 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f87277fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f87277fe640 1 -- 172.21.15.113:0/201322460 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c07ff40 con 0x555c627fae40 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f87277fe640 1 -- 172.21.15.113:0/201322460 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f873c0940d0 con 0x555c627fae40 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 1 -- 172.21.15.113:0/201322460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8738014440 con 0x555c627fae40 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f87277fe640 1 -- 172.21.15.113:0/201322460 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f873c084800 con 0x555c627fae40 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 10 client.4467 fetch_fsmap learned FSMap version 6 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 1 -- 172.21.15.113:0/201322460 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x555c62803510 con 0x555c627fae40 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f87277fe640 1 -- 172.21.15.113:0/201322460 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8738014440 con 0x555c627fae40 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f87277fe640 1 -- 172.21.15.113:0/201322460 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f873c0782b0 con 0x555c627fae40 2024-04-22T06:31:45.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 10 client.4467 fetch_fsmap finished waiting for FSMap version 6 2024-04-22T06:31:45.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 10 client.4467 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-22T06:31:45.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 20 client.4467 populate_metadata read hostname 'smithi113' 2024-04-22T06:31:45.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c62818660 0x555c6281aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:45.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 4 client.4467 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:31:45.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f8751993740 1 -- 172.21.15.113:0/201322460 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c6272c530 con 0x555c62818660 2024-04-22T06:31:45.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.165+0000 7f874ca5d640 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c62818660 0x555c6281aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:45.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.166+0000 7f87277fe640 10 client.4467 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:31:45.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:45.166+0000 7f874ca5d640 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c62818660 0x555c6281aa50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2903dd20d5463a43 server_cookie=2c951d70312b8367 in_seq=0 out_seq=0 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f87277fe640 1 -- 172.21.15.113:0/201322460 <== mds.0 v2:172.21.15.113:6837/4160787448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555c6272c530 con 0x555c62818660 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f87277fe640 10 client.4467 handle_command_reply: tid=0 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 client.4467 shutdown 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 -- 172.21.15.113:0/201322460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627fae40 msgr2=0x555c6280efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627fae40 0x555c6280efa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f873c0780a0 tx=0x7f873c03f000 comp rx=0 tx=0).stop 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 -- 172.21.15.113:0/201322460 shutdown_connections 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c62818660 0x555c6281aa50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627fae40 0x555c6280efa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f87277fe640 0 client.4467 ms_handle_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 --2- 172.21.15.113:0/201322460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627bbec0 0x555c627ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.854+0000 7f8751993740 1 -- 172.21.15.113:0/201322460 >> 172.21.15.113:0/201322460 conn(0x555c627b7ca0 msgr2=0x555c62803ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:47.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.855+0000 7f8751993740 1 -- 172.21.15.113:0/201322460 shutdown_connections 2024-04-22T06:31:47.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.855+0000 7f8751993740 1 -- 172.21.15.113:0/201322460 wait complete. 2024-04-22T06:31:47.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.855+0000 7f8751993740 20 client.4467 trim_cache size 0 max 16384 2024-04-22T06:31:47.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.873+0000 7f8751993740 1 Processor -- start 2024-04-22T06:31:47.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.873+0000 7f8751993740 1 -- start start 2024-04-22T06:31:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f8751993740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f8751993740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627dfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f8751993740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 0x555c627e0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f8751993740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f87481fdac0 con 0x555c627bbec0 2024-04-22T06:31:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f8751993740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555c627ba250 con 0x555c627fae40 2024-04-22T06:31:47.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f8751993740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x555c627e08f0 con 0x555c627f8790 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46884/0 (socket says 172.21.15.113:46884) 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 -- 172.21.15.113:0/3693166694 learned_addr learned my addr 172.21.15.113:0/3693166694 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 -- 172.21.15.113:0/3693166694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 msgr2=0x555c627dfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 --2- 172.21.15.113:0/3693166694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627dfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 -- 172.21.15.113:0/3693166694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 msgr2=0x555c627e0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 --2- 172.21.15.113:0/3693166694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 0x555c627e0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 -- 172.21.15.113:0/3693166694 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6280f310 con 0x555c627bbec0 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.874+0000 7f874ca5d640 1 --2- 172.21.15.113:0/3693166694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d7220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f874000fa30 tx=0x7f8740012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806b1168e8ddd0f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f872dffb640 1 -- 172.21.15.113:0/3693166694 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740007430 con 0x555c627bbec0 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f872dffb640 1 -- 172.21.15.113:0/3693166694 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87400075d0 con 0x555c627bbec0 2024-04-22T06:31:47.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f872dffb640 1 -- 172.21.15.113:0/3693166694 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740007980 con 0x555c627bbec0 2024-04-22T06:31:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 -- 172.21.15.113:0/3693166694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 msgr2=0x555c627d7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 --2- 172.21.15.113:0/3693166694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d7220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f874000fa30 tx=0x7f8740012000 comp rx=0 tx=0).stop 2024-04-22T06:31:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 -- 172.21.15.113:0/3693166694 shutdown_connections 2024-04-22T06:31:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 --2- 172.21.15.113:0/3693166694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 0x555c627e0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 --2- 172.21.15.113:0/3693166694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627dfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 --2- 172.21.15.113:0/3693166694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d7220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 -- 172.21.15.113:0/3693166694 >> 172.21.15.113:0/3693166694 conn(0x555c627b7ca0 msgr2=0x555c62802b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 -- 172.21.15.113:0/3693166694 shutdown_connections 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.875+0000 7f8751993740 1 -- 172.21.15.113:0/3693166694 wait complete. 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.876+0000 7f8751993740 1 -- start start 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.876+0000 7f8751993740 1 Processor -- start 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f8751993740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f8751993740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f8751993740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 0x555c627fdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f8751993740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x555c6280f4e0 con 0x555c627bbec0 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f8751993740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555c627db2a0 con 0x555c627fae40 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f8751993740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x555c627b43f0 con 0x555c627f8790 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f8751993740 10 client.0 _ll_register_callbacks cb 0x7f8740001520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46886/0 (socket says 172.21.15.113:46886) 2024-04-22T06:31:47.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 -- 172.21.15.113:0/1540635694 learned_addr learned my addr 172.21.15.113:0/1540635694 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f8747fff640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874d25e640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 0x555c627fdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 -- 172.21.15.113:0/1540635694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 msgr2=0x555c627bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627bad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 -- 172.21.15.113:0/1540635694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 msgr2=0x555c627fdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 0x555c627fdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 -- 172.21.15.113:0/1540635694 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c627d6e60 con 0x555c627bbec0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f874ca5d640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d6090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f874000fe70 tx=0x7f8740001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1521e0b2f1c6e412 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f87277fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.877+0000 7f87277fe640 1 -- 172.21.15.113:0/1540635694 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740038060 con 0x555c627bbec0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f87277fe640 1 -- 172.21.15.113:0/1540635694 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f874002f040 con 0x555c627bbec0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 1 -- 172.21.15.113:0/1540635694 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87400075d0 con 0x555c627bbec0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f87277fe640 1 -- 172.21.15.113:0/1540635694 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f8740013600 con 0x555c627bbec0 2024-04-22T06:31:47.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 10 client.4473 fetch_fsmap learned FSMap version 6 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 1 -- 172.21.15.113:0/1540635694 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x555c627db420 con 0x555c627bbec0 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f87277fe640 1 -- 172.21.15.113:0/1540635694 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87400075d0 con 0x555c627bbec0 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f87277fe640 1 -- 172.21.15.113:0/1540635694 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f8740041080 con 0x555c627bbec0 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 10 client.4473 fetch_fsmap finished waiting for FSMap version 6 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 10 client.4473 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 20 client.4473 populate_metadata read hostname 'smithi113' 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 0x555c6287a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 4 client.4473 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8751993740 1 -- 172.21.15.113:0/1540635694 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "status"}) -- 0x555c627263a0 con 0x555c6287a040 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8747fff640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 0x555c6287a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8747fff640 1 -- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 msgr2=0x555c6287a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-22T06:31:47.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8747fff640 1 -- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 msgr2=0x555c6287a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-22T06:31:47.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8747fff640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 0x555c6287a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T06:31:47.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:47.878+0000 7f8747fff640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 0x555c6287a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:31:48.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8747fff640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 0x555c6287a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8747fff640 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 0x555c6287a420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90fd13f0ea5e76ee server_cookie=7a264302635b6bc3 in_seq=0 out_seq=0 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f87277fe640 10 client.4473 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f87277fe640 1 -- 172.21.15.113:0/1540635694 <== mds.0 v2:172.21.15.113:6837/4160787448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x555c627263a0 con 0x555c6287a040 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f87277fe640 10 client.4473 handle_command_reply: tid=0 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 client.4473 shutdown 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 -- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 msgr2=0x555c627d6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d6090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f874000fe70 tx=0x7f8740001250 comp rx=0 tx=0).stop 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 -- 172.21.15.113:0/1540635694 shutdown_connections 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x555c6287a040 0x555c6287a420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c627fae40 0x555c627fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f87277fe640 0 client.4473 ms_handle_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555c627f8790 0x555c627bad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 --2- 172.21.15.113:0/1540635694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c627bbec0 0x555c627d6090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 -- 172.21.15.113:0/1540635694 >> 172.21.15.113:0/1540635694 conn(0x555c627b7ca0 msgr2=0x555c627ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.079+0000 7f8751993740 1 -- 172.21.15.113:0/1540635694 shutdown_connections 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f8751993740 1 -- 172.21.15.113:0/1540635694 wait complete. 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f8751993740 20 client.4473 trim_cache size 0 max 16384 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4311, 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:31:48.081 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 10.253107930000001, 2024-04-22T06:31:48.082 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 5, 2024-04-22T06:31:48.082 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 24, 2024-04-22T06:31:48.082 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 23, 2024-04-22T06:31:48.082 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 17.472162394000001 2024-04-22T06:31:48.082 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:31:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 -- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f873406c8f0 msgr2=0x7f873406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f873406c8f0 0x7f873406edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8740001f10 tx=0x7f8740009040 comp rx=0 tx=0).stop 2024-04-22T06:31:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 -- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 msgr2=0x7f8748156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f8748156e80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f873c02ba60 tx=0x7f873c004730 comp rx=0 tx=0).stop 2024-04-22T06:31:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 -- 172.21.15.113:0/623119688 shutdown_connections 2024-04-22T06:31:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87480c99f0 0x7f87481f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f873406c8f0 0x7f873406edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f874806bf70 0x7f8748156e80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 --2- 172.21.15.113:0/623119688 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874806bb90 0x7f8748156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 -- 172.21.15.113:0/623119688 >> 172.21.15.113:0/623119688 conn(0x7f8748074d50 msgr2=0x7f87480cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 -- 172.21.15.113:0/623119688 shutdown_connections 2024-04-22T06:31:48.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.080+0000 7f874ecc1640 1 -- 172.21.15.113:0/623119688 wait complete. 2024-04-22T06:31:48.091 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-22T06:31:48.091 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-22T06:31:48.091 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-22T06:31:48.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.188+0000 7ffac444a640 1 Processor -- start 2024-04-22T06:31:48.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.188+0000 7ffac444a640 1 -- start start 2024-04-22T06:31:48.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac444a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b3c00 0x7ffabc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:48.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac444a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ffabc0b5450 0x7ffabc0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:48.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac444a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffabc1558c0 con 0x7ffabc1554e0 2024-04-22T06:31:48.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac444a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7ffabc0b4a80 con 0x7ffabc0b5450 2024-04-22T06:31:48.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac444a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ffabc0cb8c0 con 0x7ffabc0b3c00 2024-04-22T06:31:48.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac19e5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b3c00 0x7ffabc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:48.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac19e5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b3c00 0x7ffabc0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:60364/0 (socket says 172.21.15.113:60364) 2024-04-22T06:31:48.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac19e5640 1 -- 172.21.15.113:0/3863033132 learned_addr learned my addr 172.21.15.113:0/3863033132 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:48.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.189+0000 7ffac29e7640 1 --2- 172.21.15.113:0/3863033132 >> v2:172.21.15.145:3300/0 conn(0x7ffabc0b5450 0x7ffabc0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:48.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.190+0000 7ffac19e5640 1 -- 172.21.15.113:0/3863033132 >> v2:172.21.15.145:3300/0 conn(0x7ffabc0b5450 msgr2=0x7ffabc0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:48.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.190+0000 7ffac19e5640 1 --2- 172.21.15.113:0/3863033132 >> v2:172.21.15.145:3300/0 conn(0x7ffabc0b5450 0x7ffabc0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.190+0000 7ffac19e5640 1 -- 172.21.15.113:0/3863033132 >> v1:172.21.15.145:6789/0 conn(0x7ffabc1554e0 legacy=0x7ffabc15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.190+0000 7ffac19e5640 1 -- 172.21.15.113:0/3863033132 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc0cbba0 con 0x7ffabc0b3c00 2024-04-22T06:31:48.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.190+0000 7ffac19e5640 1 --2- 172.21.15.113:0/3863033132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b3c00 0x7ffabc0b4f10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009870 tx=0x7ffaac02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9302ef13ff32ba1f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:48.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac11e4640 1 -- 172.21.15.113:0/3863033132 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac02f840 con 0x7ffabc0b3c00 2024-04-22T06:31:48.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac11e4640 1 -- 172.21.15.113:0/3863033132 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaac02f9e0 con 0x7ffabc0b3c00 2024-04-22T06:31:48.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac11e4640 1 -- 172.21.15.113:0/3863033132 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac02fdb0 con 0x7ffabc0b3c00 2024-04-22T06:31:48.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac444a640 1 -- 172.21.15.113:0/3863033132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b3c00 msgr2=0x7ffabc0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac444a640 1 --2- 172.21.15.113:0/3863033132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b3c00 0x7ffabc0b4f10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009870 tx=0x7ffaac02ba20 comp rx=0 tx=0).stop 2024-04-22T06:31:48.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac444a640 1 -- 172.21.15.113:0/3863033132 shutdown_connections 2024-04-22T06:31:48.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac444a640 1 --2- 172.21.15.113:0/3863033132 >> v2:172.21.15.145:3300/0 conn(0x7ffabc0b5450 0x7ffabc0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac444a640 1 --2- 172.21.15.113:0/3863033132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b3c00 0x7ffabc0b4f10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac444a640 1 -- 172.21.15.113:0/3863033132 >> 172.21.15.113:0/3863033132 conn(0x7ffabc074d50 msgr2=0x7ffabc075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:48.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac444a640 1 -- 172.21.15.113:0/3863033132 shutdown_connections 2024-04-22T06:31:48.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.191+0000 7ffac444a640 1 -- 172.21.15.113:0/3863033132 wait complete. 2024-04-22T06:31:48.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.192+0000 7ffac444a640 1 Processor -- start 2024-04-22T06:31:48.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.192+0000 7ffac444a640 1 -- start start 2024-04-22T06:31:48.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac444a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0b3c00 0x7ffabc0c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:48.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac444a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b5450 0x7ffabc150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:48.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac444a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffabc1554e0 0x7ffabc1e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:48.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac444a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc0b4710 con 0x7ffabc1554e0 2024-04-22T06:31:48.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac444a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc0b4430 con 0x7ffabc0b3c00 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac444a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ffabc0b3580 con 0x7ffabc0b5450 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac29e7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffabc1554e0 0x7ffabc1e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac29e7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffabc1554e0 0x7ffabc1e62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46902/0 (socket says 172.21.15.113:46902) 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac29e7640 1 -- 172.21.15.113:0/189262802 learned_addr learned my addr 172.21.15.113:0/189262802 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac21e6640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0b3c00 0x7ffabc0c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.193+0000 7ffac19e5640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b5450 0x7ffabc150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffac29e7640 1 -- 172.21.15.113:0/189262802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b5450 msgr2=0x7ffabc150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffac29e7640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b5450 0x7ffabc150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffac29e7640 1 -- 172.21.15.113:0/189262802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0b3c00 msgr2=0x7ffabc0c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffac29e7640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0b3c00 0x7ffabc0c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffac29e7640 1 -- 172.21.15.113:0/189262802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc0c60c0 con 0x7ffabc1554e0 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffac29e7640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffabc1554e0 0x7ffabc1e62c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffab400efc0 tx=0x7ffab400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:48.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffab2ffd640 1 -- 172.21.15.113:0/189262802 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4018020 con 0x7ffabc1554e0 2024-04-22T06:31:48.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffab2ffd640 1 -- 172.21.15.113:0/189262802 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab4014480 con 0x7ffabc1554e0 2024-04-22T06:31:48.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffabc1e5220 con 0x7ffabc1554e0 2024-04-22T06:31:48.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffab2ffd640 1 -- 172.21.15.113:0/189262802 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4014870 con 0x7ffabc1554e0 2024-04-22T06:31:48.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.194+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffabc1e57e0 con 0x7ffabc1554e0 2024-04-22T06:31:48.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.195+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffabc068e40 con 0x7ffabc1554e0 2024-04-22T06:31:48.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.195+0000 7ffab2ffd640 1 -- 172.21.15.113:0/189262802 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffab4005d10 con 0x7ffabc1554e0 2024-04-22T06:31:48.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.196+0000 7ffab2ffd640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ffaa006c8f0 0x7ffaa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:48.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.196+0000 7ffac21e6640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ffaa006c8f0 0x7ffaa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:48.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.196+0000 7ffab2ffd640 1 -- 172.21.15.113:0/189262802 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffab408ce60 con 0x7ffabc1554e0 2024-04-22T06:31:48.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.196+0000 7ffac21e6640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ffaa006c8f0 0x7ffaa006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffab8001640 tx=0x7ffab8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:48.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.200+0000 7ffab2ffd640 1 -- 172.21.15.113:0/189262802 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffab4022030 con 0x7ffabc1554e0 2024-04-22T06:31:48.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.415+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffabc0cca40 con 0x7ffabc1554e0 2024-04-22T06:31:48.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.415+0000 7ffab2ffd640 1 -- 172.21.15.113:0/189262802 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7ffab4010040 con 0x7ffabc1554e0 2024-04-22T06:31:48.415 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ffaa006c8f0 msgr2=0x7ffaa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ffaa006c8f0 0x7ffaa006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffab8001640 tx=0x7ffab8009040 comp rx=0 tx=0).stop 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffabc1554e0 msgr2=0x7ffabc1e62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffabc1554e0 0x7ffabc1e62c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffab400efc0 tx=0x7ffab400c490 comp rx=0 tx=0).stop 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 shutdown_connections 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ffaa006c8f0 0x7ffaa006edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffabc1554e0 0x7ffabc1e62c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffabc0b5450 0x7ffabc150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 --2- 172.21.15.113:0/189262802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffabc0b3c00 0x7ffabc0c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 >> 172.21.15.113:0/189262802 conn(0x7ffabc074d50 msgr2=0x7ffabc153680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:48.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 shutdown_connections 2024-04-22T06:31:48.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48.417+0000 7ffac444a640 1 -- 172.21.15.113:0/189262802 wait complete. 2024-04-22T06:31:48.427 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-22T06:31:48.427 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-22T06:31:48.427 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2024-04-22T06:31:48.427 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-22T06:31:48.427 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-22T06:31:48.427 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-22T06:31:48.428 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-22T06:31:48.428 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-22T06:31:48.428 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-22T06:31:48.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:48.428 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2024-04-22T06:31:48.443 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-22T06:31:48.443 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-22T06:31:48.443 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2024-04-22T06:31:48.443 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-04-22T06:31:48.443 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2024-04-22T06:31:48.443 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-04-22T06:31:48.443 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T06:31:48.443 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42731sec preferred_lft 42731sec 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ddaa:4484:eadd:6c8b/64 scope link noprefixroute 2024-04-22T06:31:48.444 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-04-22T06:31:48.445 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-22T06:31:48.445 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:31:48.445 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:31:48.446 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add name ceph-brx type bridge 2024-04-22T06:31:48.446 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr flush dev ceph-brx 2024-04-22T06:31:48.446 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set ceph-brx up 2024-04-22T06:31:48.446 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-22T06:31:48.446 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:31:48.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:31:48.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:31:48.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:48.621 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-22T06:31:48.644 INFO:teuthology.orchestra.run.smithi113.stdout:1 2024-04-22T06:31:48.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:48.646 DEBUG:teuthology.orchestra.run.smithi113:> route 2024-04-22T06:31:48.714 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2024-04-22T06:31:48.714 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-22T06:31:48.714 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-22T06:31:48.714 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-22T06:31:48.714 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-22T06:31:48.714 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:31:48.715 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:31:48.715 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-22T06:31:48.715 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-22T06:31:48.715 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-22T06:31:48.715 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:31:48.802 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:31:48.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:31:49.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:49.005 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-04-22T06:31:49.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:49.020 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list-id 2024-04-22T06:31:49.073 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:31:49.074 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:31:49.074 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-22T06:31:49.074 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-22T06:31:49.074 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:31:49.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:31:49.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:31:49.190 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-22T06:31:49.190 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:31:49.191 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:31:49.191 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-22T06:31:49.191 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-22T06:31:49.191 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-22T06:31:49.191 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-22T06:31:49.191 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-22T06:31:49.191 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:31:49.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:31:49.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:31:49.306 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:31:49.306 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:31:49.306 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2024-04-22T06:31:49.306 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set dev brx.0 master ceph-brx 2024-04-22T06:31:49.307 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:31:49.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:31:49.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:31:49.380 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-22T06:31:49.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-22T06:31:49.381 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-22T06:31:49.395 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-22T06:31:49.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-22T06:31:49.395 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-22T06:31:49.450 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2024-04-22T06:31:49.515 DEBUG:teuthology.orchestra.run.smithi113:> cat /proc/self/mounts | awk '{print $2}' 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/proc 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/sys 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/dev 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/security 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/shm 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/pts 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/run 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/cgroup 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/pstore 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/bpf 2024-04-22T06:31:49.571 INFO:teuthology.orchestra.run.smithi113.stdout:/ 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/selinux 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/proc/sys/fs/binfmt_misc 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/hugepages 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/mqueue 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/debug 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/tracing 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-sysusers.service 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/config 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/fuse/connections 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-sysctl.service 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/nfs/rpc_pipefs 2024-04-22T06:31:49.572 INFO:teuthology.orchestra.run.smithi113.stdout:/run/user/1000 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-0 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-1 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-2 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-3 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-22T06:31:49.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:49.573 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2024-04-22T06:31:49.625 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-22T06:31:49.626 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-22T06:31:49.668 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2024-04-22T06:31:49.691 DEBUG:teuthology.orchestra.run.smithi113:> cat /proc/self/mounts | awk '{print $2}' 2024-04-22T06:31:49.746 INFO:teuthology.orchestra.run.smithi113.stdout:/proc 2024-04-22T06:31:49.746 INFO:teuthology.orchestra.run.smithi113.stdout:/sys 2024-04-22T06:31:49.746 INFO:teuthology.orchestra.run.smithi113.stdout:/dev 2024-04-22T06:31:49.746 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/security 2024-04-22T06:31:49.746 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/shm 2024-04-22T06:31:49.746 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/pts 2024-04-22T06:31:49.746 INFO:teuthology.orchestra.run.smithi113.stdout:/run 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/cgroup 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/pstore 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/bpf 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/ 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/selinux 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/proc/sys/fs/binfmt_misc 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/hugepages 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/mqueue 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/debug 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/tracing 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-sysusers.service 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/config 2024-04-22T06:31:49.747 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/fuse/connections 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-sysctl.service 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/nfs/rpc_pipefs 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/run/user/1000 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-0 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-1 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-2 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-3 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-22T06:31:49.748 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-22T06:31:49.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:49.749 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2024-04-22T06:31:49.755 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi113.stderr:2024-04-22T06:31:49.756+0000 7f771f23a480 -1 init, newargv = 0x55688acba030 newargc=15 2024-04-22T06:31:49.755 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi113.stderr:ceph-fuse[40855]: starting ceph client 2024-04-22T06:31:49.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi113.stderr:ceph-fuse[40855]: starting fuse 2024-04-22T06:31:49.769 INFO:teuthology.orchestra.run.smithi113.stdout:43 2024-04-22T06:31:49.770 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> sudo stdin-killer -- python3 -c ' 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> import glob 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> import re 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> import os 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> import subprocess 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> def _find_admin_socket(client_name): 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> files = glob.glob(asok_path) 2024-04-22T06:31:49.770 DEBUG:teuthology.orchestra.run.smithi113:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> # Given a non-glob path, it better be there 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> if "*" not in asok_path: 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> assert(len(files) == 1) 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> return files[0] 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> for f in files: 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> contents = proc_f.read() 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> if mountpoint in contents: 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> return f 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> 2024-04-22T06:31:49.771 DEBUG:teuthology.orchestra.run.smithi113:> print(_find_admin_socket("client.admin")) 2024-04-22T06:31:49.772 DEBUG:teuthology.orchestra.run.smithi113:> ' 2024-04-22T06:31:49.889 INFO:teuthology.orchestra.run.smithi113.stdout:/var/run/ceph/ceph-client.admin.40855.asok 2024-04-22T06:31:49.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:31:49.899 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.40855.asok 2024-04-22T06:31:49.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:49.899 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.40855.asok status 2024-04-22T06:31:50.032 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": { 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_sha1": "86f7587a5a09af35f0895e1a2d08527638fae697", 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_version": "ceph version 19.0.0-3156-g86f7587a (86f7587a5a09af35f0895e1a2d08527638fae697) squid (dev)", 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "entity_id": "admin", 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "hostname": "smithi113", 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "pid": "40855", 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "root": "/" 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "dentry_count": 0, 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "dentry_pinned_count": 0, 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4482, 2024-04-22T06:31:50.033 INFO:teuthology.orchestra.run.smithi113.stdout: "inst": { 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: "name": { 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "client", 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: "num": 4482 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": { 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "192.168.0.1:0", 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 3403364194 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-04-22T06:31:50.034 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": { 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "192.168.0.1:0", 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 3403364194 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "inst_str": "client.4482 192.168.0.1:0/3403364194", 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "addr_str": "192.168.0.1:0/3403364194", 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "inode_count": 1, 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "mds_epoch": 5, 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_epoch": 24, 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_epoch_barrier": 0, 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklisted": false, 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs" 2024-04-22T06:31:50.035 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:31:50.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:50.041 DEBUG:teuthology.orchestra.run.smithi113:> stat --file-system '--printf=%T 2024-04-22T06:31:50.041 DEBUG:teuthology.orchestra.run.smithi113:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-22T06:31:50.055 INFO:teuthology.orchestra.run.smithi113.stdout:fuseblk 2024-04-22T06:31:50.056 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-22T06:31:50.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:50.056 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-22T06:31:50.120 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-22T06:31:50.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-22T06:31:50.224 INFO:teuthology.orchestra.run.smithi113.stdout:# file: . 2024-04-22T06:31:50.224 INFO:teuthology.orchestra.run.smithi113.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-22T06:31:50.224 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:31:50.230 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:50.230 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T06:31:50.246 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:50.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.383+0000 7f31a6fe2640 1 Processor -- start 2024-04-22T06:31:50.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.383+0000 7f31a6fe2640 1 -- start start 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.384+0000 7f31a6fe2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f31a0151f10 0x7f31a0157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.384+0000 7f31a6fe2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a01582e0 con 0x7f31a00c5b80 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.384+0000 7f31a6fe2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a0158570 con 0x7f31a00c9610 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.384+0000 7f31a6fe2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f31a015b8a0 con 0x7f31a0151f10 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.384+0000 7f319ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f31a00c5b80 0x7f31a015bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44512/0 (socket says 172.21.15.113:44512) 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.384+0000 7f319ffff640 1 -- 172.21.15.113:0/1261240856 learned_addr learned my addr 172.21.15.113:0/1261240856 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246735434 0 0) 0x7f31a01582e0 con 0x7f31a00c5b80 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3188003520 con 0x7f31a00c5b80 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f31a4d7e640 1 --2- 172.21.15.113:0/1261240856 >> v2:172.21.15.145:3300/0 conn(0x7f31a0151f10 0x7f31a0157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938720861 0 0) 0x7f3188003520 con 0x7f31a00c5b80 2024-04-22T06:31:50.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 >> v2:172.21.15.145:3300/0 conn(0x7f31a0151f10 msgr2=0x7f31a0157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 --2- 172.21.15.113:0/1261240856 >> v2:172.21.15.145:3300/0 conn(0x7f31a0151f10 0x7f31a0157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 >> v1:172.21.15.145:6789/0 conn(0x7f31a00c9610 legacy=0x7f31a00ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a0158850 con 0x7f31a00c5b80 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f3194001670 con 0x7f31a00c5b80 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 >> v1:172.21.15.113:6789/0 conn(0x7f31a00c5b80 legacy=0x7f31a015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3188003a00 0x7f3188003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f3188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31880051c0 0x7f318800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f31a015b8a0 con 0x7f3188004800 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f318800c0d0 con 0x7f31880051c0 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f318800c2d0 con 0x7f3188003a00 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319ffff640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f3188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f31a4d7e640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3188003a00 0x7f3188003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f31a557f640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31880051c0 0x7f318800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319ffff640 1 -- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3188003a00 msgr2=0x7f3188003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319ffff640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3188003a00 0x7f3188003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319ffff640 1 -- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31880051c0 msgr2=0x7f318800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319ffff640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31880051c0 0x7f318800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f319ffff640 1 -- 172.21.15.113:0/1261240856 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3188003520 con 0x7f3188004800 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f31a557f640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31880051c0 0x7f318800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.385+0000 7f31a557f640 1 -- 172.21.15.113:0/1261240856 reap_dead start 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.386+0000 7f319ffff640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f3188004c80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f319400c0e0 tx=0x7f3188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702354a8fe8aaf1f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.386+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194007c20 con 0x7f3188004800 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.386+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3194030070 con 0x7f3188004800 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.386+0000 7f319f7fe640 1 -- 172.21.15.113:0/1261240856 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194005d30 con 0x7f3188004800 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.387+0000 7f31a6fe2640 1 -- 172.21.15.113:0/1261240856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 msgr2=0x7f3188004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.387+0000 7f31a6fe2640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f3188004c80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f319400c0e0 tx=0x7f3188005830 comp rx=0 tx=0).stop 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.387+0000 7f31a6fe2640 1 -- 172.21.15.113:0/1261240856 shutdown_connections 2024-04-22T06:31:50.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.387+0000 7f31a6fe2640 1 --2- 172.21.15.113:0/1261240856 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f3188004c80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.387+0000 7f31a6fe2640 1 -- 172.21.15.113:0/1261240856 >> 172.21.15.113:0/1261240856 conn(0x7f31a006bd10 msgr2=0x7f31a006c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:50.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.387+0000 7f31a6fe2640 1 -- 172.21.15.113:0/1261240856 shutdown_connections 2024-04-22T06:31:50.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.387+0000 7f31a6fe2640 1 -- 172.21.15.113:0/1261240856 wait complete. 2024-04-22T06:31:50.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.388+0000 7f31a6fe2640 1 Processor -- start 2024-04-22T06:31:50.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.388+0000 7f31a6fe2640 1 -- start start 2024-04-22T06:31:50.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a6fe2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f31a00cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a6fe2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31a0073770 0x7f31a0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a6fe2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31a0156880 0x7f31a0153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a6fe2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f31a00c7f80 con 0x7f3188004800 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a6fe2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31a015b530 con 0x7f31a0073770 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a6fe2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f31a00c8100 con 0x7f31a0156880 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f31a00cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f31a00cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46320/0 (socket says 172.21.15.113:46320) 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 -- 172.21.15.113:0/111155833 learned_addr learned my addr 172.21.15.113:0/111155833 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f319ffff640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31a0073770 0x7f31a0153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a557f640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31a0156880 0x7f31a0153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 -- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31a0156880 msgr2=0x7f31a0153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31a0156880 0x7f31a0153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 -- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31a0073770 msgr2=0x7f31a0153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31a0073770 0x7f31a0153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 -- 172.21.15.113:0/111155833 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a0152730 con 0x7f3188004800 2024-04-22T06:31:50.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f319ffff640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31a0073770 0x7f31a0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f31a4d7e640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f31a00cc6a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3190011aa0 tx=0x7f3190011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f319d7fa640 1 -- 172.21.15.113:0/111155833 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319000fb80 con 0x7f3188004800 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f319d7fa640 1 -- 172.21.15.113:0/111155833 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319000fd20 con 0x7f3188004800 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.389+0000 7f319d7fa640 1 -- 172.21.15.113:0/111155833 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3190014660 con 0x7f3188004800 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.390+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a014e2a0 con 0x7f3188004800 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.390+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a0152cb0 con 0x7f3188004800 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.391+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a00c4680 con 0x7f3188004800 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.391+0000 7f319d7fa640 1 -- 172.21.15.113:0/111155833 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3190012040 con 0x7f3188004800 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.391+0000 7f319d7fa640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f318c06c8f0 0x7f318c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.391+0000 7f319d7fa640 1 -- 172.21.15.113:0/111155833 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f319008c690 con 0x7f3188004800 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.391+0000 7f319ffff640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f318c06c8f0 0x7f318c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.392+0000 7f319ffff640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f318c06c8f0 0x7f318c06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3194034000 tx=0x7f3194007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:50.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.396+0000 7f319d7fa640 1 -- 172.21.15.113:0/111155833 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31a00c4680 con 0x7f3188004800 2024-04-22T06:31:50.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.575+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31a0068e40 con 0x7f3188004800 2024-04-22T06:31:50.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.576+0000 7f319d7fa640 1 -- 172.21.15.113:0/111155833 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f3190019030 con 0x7f3188004800 2024-04-22T06:31:50.576 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:50.576 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:50.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.578+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f318c06c8f0 msgr2=0x7f318c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.578+0000 7f31a6fe2640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f318c06c8f0 0x7f318c06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3194034000 tx=0x7f3194007000 comp rx=0 tx=0).stop 2024-04-22T06:31:50.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.578+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 msgr2=0x7f31a00cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.578+0000 7f31a6fe2640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f31a00cc6a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3190011aa0 tx=0x7f3190011f60 comp rx=0 tx=0).stop 2024-04-22T06:31:50.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.578+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 shutdown_connections 2024-04-22T06:31:50.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.578+0000 7f31a6fe2640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31a0156880 0x7f31a0153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.578+0000 7f31a6fe2640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31a0073770 0x7f31a0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.579+0000 7f31a6fe2640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f318c06c8f0 0x7f318c06edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.579+0000 7f31a6fe2640 1 --2- 172.21.15.113:0/111155833 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3188004800 0x7f31a00cc6a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.579+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 >> 172.21.15.113:0/111155833 conn(0x7f31a006bd10 msgr2=0x7f31a0146e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:50.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.579+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 shutdown_connections 2024-04-22T06:31:50.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.579+0000 7f31a6fe2640 1 -- 172.21.15.113:0/111155833 wait complete. 2024-04-22T06:31:50.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:31:50.589 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:31:50.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.688+0000 7fd8444c1640 1 Processor -- start 2024-04-22T06:31:50.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.688+0000 7fd8444c1640 1 -- start start 2024-04-22T06:31:50.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.689+0000 7fd8444c1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd83c152f20 0x7fd83c0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.689+0000 7fd8444c1640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd83c153300 0x7fd83c0cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.689+0000 7fd8444c1640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c0c7b20 con 0x7fd83c0c9ca0 2024-04-22T06:31:50.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.689+0000 7fd8444c1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fd83c0c9810 con 0x7fd83c152f20 2024-04-22T06:31:50.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.689+0000 7fd8444c1640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fd83c0cac60 con 0x7fd83c153300 2024-04-22T06:31:50.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.689+0000 7fd84225d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd83c152f20 0x7fd83c0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.689+0000 7fd84225d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd83c152f20 0x7fd83c0cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46324/0 (socket says 172.21.15.113:46324) 2024-04-22T06:31:50.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.689+0000 7fd84225d640 1 -- 172.21.15.113:0/486521585 learned_addr learned my addr 172.21.15.113:0/486521585 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:50.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.690+0000 7fd841a5c640 1 --2- 172.21.15.113:0/486521585 >> v2:172.21.15.145:3300/0 conn(0x7fd83c153300 0x7fd83c0cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.690+0000 7fd84225d640 1 -- 172.21.15.113:0/486521585 >> v2:172.21.15.145:3300/0 conn(0x7fd83c153300 msgr2=0x7fd83c0cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:50.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.690+0000 7fd84225d640 1 --2- 172.21.15.113:0/486521585 >> v2:172.21.15.145:3300/0 conn(0x7fd83c153300 0x7fd83c0cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.690+0000 7fd84225d640 1 -- 172.21.15.113:0/486521585 >> v1:172.21.15.145:6789/0 conn(0x7fd83c0c9ca0 legacy=0x7fd83c0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.690+0000 7fd84225d640 1 -- 172.21.15.113:0/486521585 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c0c7d90 con 0x7fd83c152f20 2024-04-22T06:31:50.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.690+0000 7fd84225d640 1 --2- 172.21.15.113:0/486521585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c0cb3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd838009870 tx=0x7fd83802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dfcec6f18250fb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:50.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd84125b640 1 -- 172.21.15.113:0/486521585 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83802f840 con 0x7fd83c152f20 2024-04-22T06:31:50.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd84125b640 1 -- 172.21.15.113:0/486521585 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd83802f9e0 con 0x7fd83c152f20 2024-04-22T06:31:50.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd84125b640 1 -- 172.21.15.113:0/486521585 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83802fdb0 con 0x7fd83c152f20 2024-04-22T06:31:50.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd8444c1640 1 -- 172.21.15.113:0/486521585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 msgr2=0x7fd83c0cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd8444c1640 1 --2- 172.21.15.113:0/486521585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c0cb3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd838009870 tx=0x7fd83802ba20 comp rx=0 tx=0).stop 2024-04-22T06:31:50.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd8444c1640 1 -- 172.21.15.113:0/486521585 shutdown_connections 2024-04-22T06:31:50.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd8444c1640 1 --2- 172.21.15.113:0/486521585 >> v2:172.21.15.145:3300/0 conn(0x7fd83c153300 0x7fd83c0cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd8444c1640 1 --2- 172.21.15.113:0/486521585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c0cb3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd8444c1640 1 -- 172.21.15.113:0/486521585 >> 172.21.15.113:0/486521585 conn(0x7fd83c074f30 msgr2=0x7fd83c075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:50.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd8444c1640 1 -- 172.21.15.113:0/486521585 shutdown_connections 2024-04-22T06:31:50.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.691+0000 7fd8444c1640 1 -- 172.21.15.113:0/486521585 wait complete. 2024-04-22T06:31:50.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.692+0000 7fd8444c1640 1 Processor -- start 2024-04-22T06:31:50.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.692+0000 7fd8444c1640 1 -- start start 2024-04-22T06:31:50.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd8444c1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd83c0c9ca0 0x7fd83c1f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd8444c1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd8444c1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd83c153300 0x7fd83c0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd8444c1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0c8630 con 0x7fd83c152f20 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd8444c1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0c8350 con 0x7fd83c153300 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd8444c1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd83c0c8910 con 0x7fd83c0c9ca0 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd841a5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd841a5c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c1541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46326/0 (socket says 172.21.15.113:46326) 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd841a5c640 1 -- 172.21.15.113:0/1502220638 learned_addr learned my addr 172.21.15.113:0/1502220638 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd842a5e640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd83c153300 0x7fd83c0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd84225d640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd83c0c9ca0 0x7fd83c1f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd841a5c640 1 -- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd83c0c9ca0 msgr2=0x7fd83c1f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd841a5c640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd83c0c9ca0 0x7fd83c1f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd841a5c640 1 -- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd83c153300 msgr2=0x7fd83c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd841a5c640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd83c153300 0x7fd83c0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd841a5c640 1 -- 172.21.15.113:0/1502220638 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c153710 con 0x7fd83c152f20 2024-04-22T06:31:50.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd842a5e640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd83c153300 0x7fd83c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.693+0000 7fd84225d640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd83c0c9ca0 0x7fd83c1f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.694+0000 7fd841a5c640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c1541d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00e840 tx=0x7fd82c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.694+0000 7fd832ffd640 1 -- 172.21.15.113:0/1502220638 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c017070 con 0x7fd83c152f20 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.694+0000 7fd832ffd640 1 -- 172.21.15.113:0/1502220638 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82c00c8e0 con 0x7fd83c152f20 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.694+0000 7fd832ffd640 1 -- 172.21.15.113:0/1502220638 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00ccb0 con 0x7fd83c152f20 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.694+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c145e90 con 0x7fd83c152f20 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.694+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c1561d0 con 0x7fd83c152f20 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.695+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd83c0c8c60 con 0x7fd83c152f20 2024-04-22T06:31:50.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.695+0000 7fd832ffd640 1 -- 172.21.15.113:0/1502220638 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd82c01a070 con 0x7fd83c152f20 2024-04-22T06:31:50.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.696+0000 7fd832ffd640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd82006c8f0 0x7fd82006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.696+0000 7fd832ffd640 1 -- 172.21.15.113:0/1502220638 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd82c08bcf0 con 0x7fd83c152f20 2024-04-22T06:31:50.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.696+0000 7fd84225d640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd82006c8f0 0x7fd82006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.696+0000 7fd84225d640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd82006c8f0 0x7fd82006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd838036000 tx=0x7fd838008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:50.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.700+0000 7fd832ffd640 1 -- 172.21.15.113:0/1502220638 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd83c0c8c60 con 0x7fd83c152f20 2024-04-22T06:31:50.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.876+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd83c068f50 con 0x7fd83c152f20 2024-04-22T06:31:50.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.876+0000 7fd832ffd640 1 -- 172.21.15.113:0/1502220638 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fd82c090070 con 0x7fd83c152f20 2024-04-22T06:31:50.876 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:31:50.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd82006c8f0 msgr2=0x7fd82006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd82006c8f0 0x7fd82006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd838036000 tx=0x7fd838008030 comp rx=0 tx=0).stop 2024-04-22T06:31:50.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 msgr2=0x7fd83c1541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c1541d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00e840 tx=0x7fd82c00ed00 comp rx=0 tx=0).stop 2024-04-22T06:31:50.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 shutdown_connections 2024-04-22T06:31:50.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd83c153300 0x7fd83c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd82006c8f0 0x7fd82006edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd83c152f20 0x7fd83c1541d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 --2- 172.21.15.113:0/1502220638 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd83c0c9ca0 0x7fd83c1f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 >> 172.21.15.113:0/1502220638 conn(0x7fd83c074f30 msgr2=0x7fd83c157410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:50.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.878+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 shutdown_connections 2024-04-22T06:31:50.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.879+0000 7fd8444c1640 1 -- 172.21.15.113:0/1502220638 wait complete. 2024-04-22T06:31:50.889 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:31:50.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.990+0000 7fd27a49a640 1 Processor -- start 2024-04-22T06:31:50.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.990+0000 7fd27a49a640 1 -- start start 2024-04-22T06:31:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.990+0000 7fd27a49a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cfe0 0x7fd274154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.990+0000 7fd27a49a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd2740cbc00 0x7fd274155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.990+0000 7fd27a49a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd27415b190 con 0x7fd27406cc00 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.990+0000 7fd27a49a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fd2740cd140 con 0x7fd2740cbc00 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.990+0000 7fd27a49a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd27415b470 con 0x7fd27406cfe0 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.991+0000 7fd278a37640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd2740cbc00 0x7fd274155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.991+0000 7fd278a37640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd2740cbc00 0x7fd274155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46338/0 (socket says 172.21.15.113:46338) 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.991+0000 7fd278a37640 1 -- 172.21.15.113:0/1349461632 learned_addr learned my addr 172.21.15.113:0/1349461632 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.991+0000 7fd2737fe640 1 --2- 172.21.15.113:0/1349461632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cfe0 0x7fd274154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.991+0000 7fd278a37640 1 -- 172.21.15.113:0/1349461632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cfe0 msgr2=0x7fd274154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.991+0000 7fd278a37640 1 --2- 172.21.15.113:0/1349461632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cfe0 0x7fd274154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.991+0000 7fd278a37640 1 -- 172.21.15.113:0/1349461632 >> v1:172.21.15.145:6789/0 conn(0x7fd27406cc00 legacy=0x7fd27415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.991+0000 7fd278a37640 1 -- 172.21.15.113:0/1349461632 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27415b750 con 0x7fd2740cbc00 2024-04-22T06:31:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd278a37640 1 --2- 172.21.15.113:0/1349461632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2740cbc00 0x7fd274155460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009e50 tx=0x7fd26c02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc46d4b16b53c23f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd272ffd640 1 -- 172.21.15.113:0/1349461632 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c02cb90 con 0x7fd2740cbc00 2024-04-22T06:31:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd272ffd640 1 -- 172.21.15.113:0/1349461632 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26c02cd30 con 0x7fd2740cbc00 2024-04-22T06:31:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd272ffd640 1 -- 172.21.15.113:0/1349461632 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c034610 con 0x7fd2740cbc00 2024-04-22T06:31:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd27a49a640 1 -- 172.21.15.113:0/1349461632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2740cbc00 msgr2=0x7fd274155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd27a49a640 1 --2- 172.21.15.113:0/1349461632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2740cbc00 0x7fd274155460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009e50 tx=0x7fd26c02bff0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd27a49a640 1 -- 172.21.15.113:0/1349461632 shutdown_connections 2024-04-22T06:31:50.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd27a49a640 1 --2- 172.21.15.113:0/1349461632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2740cbc00 0x7fd274155460 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd27a49a640 1 --2- 172.21.15.113:0/1349461632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cfe0 0x7fd274154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd27a49a640 1 -- 172.21.15.113:0/1349461632 >> 172.21.15.113:0/1349461632 conn(0x7fd274075570 msgr2=0x7fd274073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:50.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd27a49a640 1 -- 172.21.15.113:0/1349461632 shutdown_connections 2024-04-22T06:31:50.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.992+0000 7fd27a49a640 1 -- 172.21.15.113:0/1349461632 wait complete. 2024-04-22T06:31:50.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.993+0000 7fd27a49a640 1 Processor -- start 2024-04-22T06:31:50.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd27a49a640 1 -- start start 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd27a49a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cc00 0x7fd2740b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd27a49a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd27406cfe0 0x7fd2740c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd27a49a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2740cbc00 0x7fd2740ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd27a49a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd2740ccbe0 con 0x7fd27406cfe0 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd27a49a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd27415bd10 con 0x7fd2740cbc00 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd27a49a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd2740ccd60 con 0x7fd27406cc00 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd2737fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd27406cfe0 0x7fd2740c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd2737fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd27406cfe0 0x7fd2740c66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46346/0 (socket says 172.21.15.113:46346) 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd2737fe640 1 -- 172.21.15.113:0/3706523966 learned_addr learned my addr 172.21.15.113:0/3706523966 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:50.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.994+0000 7fd278a37640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2740cbc00 0x7fd2740ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd273fff640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cc00 0x7fd2740b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd2737fe640 1 -- 172.21.15.113:0/3706523966 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cc00 msgr2=0x7fd2740b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd2737fe640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cc00 0x7fd2740b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd2737fe640 1 -- 172.21.15.113:0/3706523966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2740cbc00 msgr2=0x7fd2740ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd2737fe640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2740cbc00 0x7fd2740ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd2737fe640 1 -- 172.21.15.113:0/3706523966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2741f42d0 con 0x7fd27406cfe0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd2737fe640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd27406cfe0 0x7fd2740c66a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd26800d800 tx=0x7fd26800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd270ff9640 1 -- 172.21.15.113:0/3706523966 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26800b6c0 con 0x7fd27406cfe0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd270ff9640 1 -- 172.21.15.113:0/3706523966 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd268019070 con 0x7fd27406cfe0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd270ff9640 1 -- 172.21.15.113:0/3706523966 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26800ba80 con 0x7fd27406cfe0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2741f4570 con 0x7fd27406cfe0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.995+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2741f4b30 con 0x7fd27406cfe0 2024-04-22T06:31:50.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.996+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd274068f50 con 0x7fd27406cfe0 2024-04-22T06:31:50.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.996+0000 7fd270ff9640 1 -- 172.21.15.113:0/3706523966 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd26800bc20 con 0x7fd27406cfe0 2024-04-22T06:31:50.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.997+0000 7fd270ff9640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd26006c8f0 0x7fd26006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:50.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.997+0000 7fd270ff9640 1 -- 172.21.15.113:0/3706523966 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd26808c140 con 0x7fd27406cfe0 2024-04-22T06:31:50.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.997+0000 7fd273fff640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd26006c8f0 0x7fd26006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:50.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:50.997+0000 7fd273fff640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd26006c8f0 0x7fd26006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd264001780 tx=0x7fd264009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.001+0000 7fd270ff9640 1 -- 172.21.15.113:0/3706523966 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd268059c70 con 0x7fd27406cfe0 2024-04-22T06:31:51.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.175+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd2740cc2b0 con 0x7fd27406cfe0 2024-04-22T06:31:51.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.175+0000 7fd270ff9640 1 -- 172.21.15.113:0/3706523966 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fd26805df70 con 0x7fd27406cfe0 2024-04-22T06:31:51.175 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd26006c8f0 msgr2=0x7fd26006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd26006c8f0 0x7fd26006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd264001780 tx=0x7fd264009040 comp rx=0 tx=0).stop 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd27406cfe0 msgr2=0x7fd2740c66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd27406cfe0 0x7fd2740c66a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd26800d800 tx=0x7fd26800dcc0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 shutdown_connections 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2740cbc00 0x7fd2740ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd26006c8f0 0x7fd26006edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd27406cfe0 0x7fd2740c66a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 --2- 172.21.15.113:0/3706523966 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd27406cc00 0x7fd2740b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 >> 172.21.15.113:0/3706523966 conn(0x7fd274075570 msgr2=0x7fd2740730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:51.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 shutdown_connections 2024-04-22T06:31:51.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.177+0000 7fd27a49a640 1 -- 172.21.15.113:0/3706523966 wait complete. 2024-04-22T06:31:51.187 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:31:51.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.288+0000 7f55039b6640 1 Processor -- start 2024-04-22T06:31:51.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.288+0000 7f55039b6640 1 -- start start 2024-04-22T06:31:51.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.289+0000 7f55039b6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54fc0d0820 0x7f54fc0d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.289+0000 7f55039b6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc0c5c80 con 0x7f54fc1553c0 2024-04-22T06:31:51.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.289+0000 7f55039b6640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc0d1170 con 0x7f54fc15b070 2024-04-22T06:31:51.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.289+0000 7f55039b6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f54fc15e660 con 0x7f54fc0d0820 2024-04-22T06:31:51.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.289+0000 7f5501f53640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54fc0d0820 0x7f54fc0d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.289+0000 7f5501752640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f54fc1553c0 0x7f54fc15edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44526/0 (socket says 172.21.15.113:44526) 2024-04-22T06:31:51.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.289+0000 7f5501752640 1 -- 172.21.15.113:0/3115943959 learned_addr learned my addr 172.21.15.113:0/3115943959 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:51.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.290+0000 7f5501f53640 1 -- 172.21.15.113:0/3115943959 >> v1:172.21.15.145:6789/0 conn(0x7f54fc15b070 legacy=0x7f54fc0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.290+0000 7f5501f53640 1 -- 172.21.15.113:0/3115943959 >> v1:172.21.15.113:6789/0 conn(0x7f54fc1553c0 legacy=0x7f54fc15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.290+0000 7f54f3fff640 1 -- 172.21.15.113:0/3115943959 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582847178 0 0) 0x7f54fc0c5c80 con 0x7f54fc1553c0 2024-04-22T06:31:51.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.290+0000 7f5501f53640 1 -- 172.21.15.113:0/3115943959 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc15b5d0 con 0x7f54fc0d0820 2024-04-22T06:31:51.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.290+0000 7f5501f53640 1 --2- 172.21.15.113:0/3115943959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc0d0820 0x7f54fc0d0c30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097a0 tx=0x7f54f402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3b342208cd2753 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.290+0000 7f54f3fff640 1 -- 172.21.15.113:0/3115943959 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4034070 con 0x7f54fc0d0820 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.290+0000 7f54f3fff640 1 -- 172.21.15.113:0/3115943959 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4030610 con 0x7f54fc0d0820 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.290+0000 7f54f3fff640 1 -- 172.21.15.113:0/3115943959 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f40309e0 con 0x7f54fc0d0820 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.291+0000 7f55039b6640 1 -- 172.21.15.113:0/3115943959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc0d0820 msgr2=0x7f54fc0d0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.291+0000 7f55039b6640 1 --2- 172.21.15.113:0/3115943959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc0d0820 0x7f54fc0d0c30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097a0 tx=0x7f54f402b960 comp rx=0 tx=0).stop 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.291+0000 7f55039b6640 1 -- 172.21.15.113:0/3115943959 shutdown_connections 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.291+0000 7f55039b6640 1 --2- 172.21.15.113:0/3115943959 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc0d0820 0x7f54fc0d0c30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.291+0000 7f55039b6640 1 -- 172.21.15.113:0/3115943959 >> 172.21.15.113:0/3115943959 conn(0x7f54fc072360 msgr2=0x7f54fc074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.291+0000 7f55039b6640 1 -- 172.21.15.113:0/3115943959 shutdown_connections 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.291+0000 7f55039b6640 1 -- 172.21.15.113:0/3115943959 wait complete. 2024-04-22T06:31:51.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.292+0000 7f55039b6640 1 Processor -- start 2024-04-22T06:31:51.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.292+0000 7f55039b6640 1 -- start start 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f55039b6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0d0820 0x7f54fc147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f55039b6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc1553c0 0x7f54fc151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f55039b6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc15b070 0x7f54fc1e5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f55039b6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc15bb90 con 0x7f54fc15b070 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f55039b6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc1557a0 con 0x7f54fc1553c0 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f55039b6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc15be70 con 0x7f54fc0d0820 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501f53640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc15b070 0x7f54fc1e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501f53640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc15b070 0x7f54fc1e5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46372/0 (socket says 172.21.15.113:46372) 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501f53640 1 -- 172.21.15.113:0/2659007421 learned_addr learned my addr 172.21.15.113:0/2659007421 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501752640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0d0820 0x7f54fc147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5500f51640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc1553c0 0x7f54fc151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501f53640 1 -- 172.21.15.113:0/2659007421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0d0820 msgr2=0x7f54fc147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501f53640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0d0820 0x7f54fc147ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501f53640 1 -- 172.21.15.113:0/2659007421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc1553c0 msgr2=0x7f54fc151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501f53640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc1553c0 0x7f54fc151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.293+0000 7f5501f53640 1 -- 172.21.15.113:0/2659007421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc1505d0 con 0x7f54fc15b070 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.294+0000 7f5501f53640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc15b070 0x7f54fc1e5720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f54f402b9a0 tx=0x7f54f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.294+0000 7f54f1ffb640 1 -- 172.21.15.113:0/2659007421 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4047070 con 0x7f54fc15b070 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.294+0000 7f54f1ffb640 1 -- 172.21.15.113:0/2659007421 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4039a10 con 0x7f54fc15b070 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.294+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54fc1f3ec0 con 0x7f54fc15b070 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.294+0000 7f54f1ffb640 1 -- 172.21.15.113:0/2659007421 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4034040 con 0x7f54fc15b070 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.294+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54fc1f4480 con 0x7f54fc15b070 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.295+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54fc068f50 con 0x7f54fc15b070 2024-04-22T06:31:51.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.295+0000 7f54f1ffb640 1 -- 172.21.15.113:0/2659007421 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54f404a070 con 0x7f54fc15b070 2024-04-22T06:31:51.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.296+0000 7f54f1ffb640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f54e006c8f0 0x7f54e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.296+0000 7f54f1ffb640 1 -- 172.21.15.113:0/2659007421 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f54f40ad8e0 con 0x7f54fc15b070 2024-04-22T06:31:51.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.296+0000 7f5501752640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f54e006c8f0 0x7f54e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.296+0000 7f5501752640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f54e006c8f0 0x7f54e006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54f8001d70 tx=0x7f54f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.299 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.300+0000 7f54f1ffb640 1 -- 172.21.15.113:0/2659007421 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f54f407ba60 con 0x7f54fc15b070 2024-04-22T06:31:51.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.476+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f54fc1e5500 con 0x7f54fc15b070 2024-04-22T06:31:51.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.477+0000 7f54f1ffb640 1 -- 172.21.15.113:0/2659007421 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f54f407b360 con 0x7f54fc15b070 2024-04-22T06:31:51.476 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f54e006c8f0 msgr2=0x7f54e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f54e006c8f0 0x7f54e006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54f8001d70 tx=0x7f54f8009040 comp rx=0 tx=0).stop 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc15b070 msgr2=0x7f54fc1e5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc15b070 0x7f54fc1e5720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f54f402b9a0 tx=0x7f54f40046c0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 shutdown_connections 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f54e006c8f0 0x7f54e006edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54fc15b070 0x7f54fc1e5720 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54fc1553c0 0x7f54fc151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 --2- 172.21.15.113:0/2659007421 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54fc0d0820 0x7f54fc147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 >> 172.21.15.113:0/2659007421 conn(0x7f54fc072360 msgr2=0x7f54fc1544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:51.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 shutdown_connections 2024-04-22T06:31:51.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.479+0000 7f55039b6640 1 -- 172.21.15.113:0/2659007421 wait complete. 2024-04-22T06:31:51.489 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:31:51.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.589+0000 7f6c546d2640 1 Processor -- start 2024-04-22T06:31:51.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.589+0000 7f6c546d2640 1 -- start start 2024-04-22T06:31:51.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c546d2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6c4c154f00 0x7f6c4c073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c546d2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0b3600 0x7f6c4c073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c546d2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4c15be60 con 0x7f6c4c0cdda0 2024-04-22T06:31:51.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c546d2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4c15e650 con 0x7f6c4c154f00 2024-04-22T06:31:51.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c546d2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4c15e930 con 0x7f6c4c0b3600 2024-04-22T06:31:51.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c5246e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6c4c154f00 0x7f6c4c073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c52c6f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6c4c0cdda0 0x7f6c4c0cc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44534/0 (socket says 172.21.15.113:44534) 2024-04-22T06:31:51.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c52c6f640 1 -- 172.21.15.113:0/2335509534 learned_addr learned my addr 172.21.15.113:0/2335509534 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:51.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c51c6d640 1 --2- 172.21.15.113:0/2335509534 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0b3600 0x7f6c4c073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c5246e640 1 -- 172.21.15.113:0/2335509534 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0b3600 msgr2=0x7f6c4c073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:51.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c5246e640 1 --2- 172.21.15.113:0/2335509534 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0b3600 0x7f6c4c073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c5246e640 1 -- 172.21.15.113:0/2335509534 >> v1:172.21.15.113:6789/0 conn(0x7f6c4c0cdda0 legacy=0x7f6c4c0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.591+0000 7f6c5246e640 1 -- 172.21.15.113:0/2335509534 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c15ec10 con 0x7f6c4c154f00 2024-04-22T06:31:51.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.590+0000 7f6c5146c640 1 -- 172.21.15.113:0/2335509534 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148097668 0 0) 0x7f6c4c15be60 con 0x7f6c4c0cdda0 2024-04-22T06:31:51.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.591+0000 7f6c51c6d640 1 --2- 172.21.15.113:0/2335509534 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0b3600 0x7f6c4c073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:51.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.591+0000 7f6c5246e640 1 --2- 172.21.15.113:0/2335509534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c154f00 0x7f6c4c073110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0cdd10 tx=0x7f6c4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cad2d61686d90d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.591+0000 7f6c5146c640 1 -- 172.21.15.113:0/2335509534 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48039070 con 0x7f6c4c154f00 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.591+0000 7f6c5146c640 1 -- 172.21.15.113:0/2335509534 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4802cc80 con 0x7f6c4c154f00 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.591+0000 7f6c5146c640 1 -- 172.21.15.113:0/2335509534 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48034660 con 0x7f6c4c154f00 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.592+0000 7f6c546d2640 1 -- 172.21.15.113:0/2335509534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c154f00 msgr2=0x7f6c4c073110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.592+0000 7f6c546d2640 1 --2- 172.21.15.113:0/2335509534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c154f00 0x7f6c4c073110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0cdd10 tx=0x7f6c4802bed0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.592+0000 7f6c546d2640 1 -- 172.21.15.113:0/2335509534 shutdown_connections 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.592+0000 7f6c546d2640 1 --2- 172.21.15.113:0/2335509534 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0b3600 0x7f6c4c073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.592+0000 7f6c546d2640 1 --2- 172.21.15.113:0/2335509534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c154f00 0x7f6c4c073110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.592+0000 7f6c546d2640 1 -- 172.21.15.113:0/2335509534 >> 172.21.15.113:0/2335509534 conn(0x7f6c4c068570 msgr2=0x7f6c4c071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.592+0000 7f6c546d2640 1 -- 172.21.15.113:0/2335509534 shutdown_connections 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.592+0000 7f6c546d2640 1 -- 172.21.15.113:0/2335509534 wait complete. 2024-04-22T06:31:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.593+0000 7f6c546d2640 1 Processor -- start 2024-04-22T06:31:51.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.593+0000 7f6c546d2640 1 -- start start 2024-04-22T06:31:51.596 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c546d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c0b3600 0x7f6c4c1e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c546d2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c0cdda0 0x7f6c4c147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c546d2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c154f00 0x7f6c4c147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c546d2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c1552e0 con 0x7f6c4c0b3600 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c546d2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0cb230 con 0x7f6c4c0cdda0 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c546d2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c1f4f70 con 0x7f6c4c154f00 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c0b3600 0x7f6c4c1e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c0b3600 0x7f6c4c1e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46388/0 (socket says 172.21.15.113:46388) 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 -- 172.21.15.113:0/1676456725 learned_addr learned my addr 172.21.15.113:0/1676456725 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c51c6d640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c0cdda0 0x7f6c4c147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 -- 172.21.15.113:0/1676456725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c154f00 msgr2=0x7f6c4c147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c154f00 0x7f6c4c147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 -- 172.21.15.113:0/1676456725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c0cdda0 msgr2=0x7f6c4c147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c0cdda0 0x7f6c4c147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 -- 172.21.15.113:0/1676456725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c1f4360 con 0x7f6c4c0b3600 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c51c6d640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c0cdda0 0x7f6c4c147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c5246e640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c0b3600 0x7f6c4c1e7cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6c48037040 tx=0x7f6c48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.594+0000 7f6c42ffd640 1 -- 172.21.15.113:0/1676456725 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48039050 con 0x7f6c4c0b3600 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.595+0000 7f6c42ffd640 1 -- 172.21.15.113:0/1676456725 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c48045070 con 0x7f6c4c0b3600 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.595+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c1f4640 con 0x7f6c4c0b3600 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.595+0000 7f6c42ffd640 1 -- 172.21.15.113:0/1676456725 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4803ea50 con 0x7f6c4c0b3600 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.595+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c1f4c00 con 0x7f6c4c0b3600 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.596+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4c068f50 con 0x7f6c4c0b3600 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.596+0000 7f6c42ffd640 1 -- 172.21.15.113:0/1676456725 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c4802cb00 con 0x7f6c4c0b3600 2024-04-22T06:31:51.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.596+0000 7f6c42ffd640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6c3006c920 0x7f6c3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.599 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.596+0000 7f6c42ffd640 1 -- 172.21.15.113:0/1676456725 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6c480aed10 con 0x7f6c4c0b3600 2024-04-22T06:31:51.599 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.597+0000 7f6c51c6d640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6c3006c920 0x7f6c3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.599 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.597+0000 7f6c51c6d640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6c3006c920 0x7f6c3006ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c006fd0 tx=0x7f6c3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.601+0000 7f6c42ffd640 1 -- 172.21.15.113:0/1676456725 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c4807c840 con 0x7f6c4c0b3600 2024-04-22T06:31:51.615 INFO:tasks.ceph.mds.c.smithi113.stderr:2024-04-22T06:31:51.615+0000 7f042e2e7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-22T06:31:51.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.773+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6c4c1588e0 con 0x7f6c4c0b3600 2024-04-22T06:31:51.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.773+0000 7f6c42ffd640 1 -- 172.21.15.113:0/1676456725 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f6c48080b40 con 0x7f6c4c0b3600 2024-04-22T06:31:51.773 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:31:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6c3006c920 msgr2=0x7f6c3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6c3006c920 0x7f6c3006ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c006fd0 tx=0x7f6c3c008040 comp rx=0 tx=0).stop 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c0b3600 msgr2=0x7f6c4c1e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c0b3600 0x7f6c4c1e7cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6c48037040 tx=0x7f6c48004a40 comp rx=0 tx=0).stop 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 shutdown_connections 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c154f00 0x7f6c4c147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c0cdda0 0x7f6c4c147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6c3006c920 0x7f6c3006ede0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 --2- 172.21.15.113:0/1676456725 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c4c0b3600 0x7f6c4c1e7cf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 >> 172.21.15.113:0/1676456725 conn(0x7f6c4c068570 msgr2=0x7f6c4c071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:51.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 shutdown_connections 2024-04-22T06:31:51.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.775+0000 7f6c546d2640 1 -- 172.21.15.113:0/1676456725 wait complete. 2024-04-22T06:31:51.785 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T06:31:51.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.886+0000 7f958cff4640 1 Processor -- start 2024-04-22T06:31:51.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.886+0000 7f958cff4640 1 -- start start 2024-04-22T06:31:51.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.887+0000 7f958cff4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588075460 0x7f9588166930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.887+0000 7f958cff4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9588144650 con 0x7f9588144270 2024-04-22T06:31:51.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.887+0000 7f958cff4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958815b0b0 con 0x7f958815efa0 2024-04-22T06:31:51.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.887+0000 7f958cff4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f95880c9580 con 0x7f9588075460 2024-04-22T06:31:51.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.887+0000 7f958659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9588144270 0x7f95880c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44538/0 (socket says 172.21.15.113:44538) 2024-04-22T06:31:51.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.887+0000 7f958659c640 1 -- 172.21.15.113:0/1775993746 learned_addr learned my addr 172.21.15.113:0/1775993746 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:51.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.887+0000 7f9586d9d640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588075460 0x7f9588166930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.887+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452897395 0 0) 0x7f9588144650 con 0x7f9588144270 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9570003520 con 0x7f9588144270 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250179215 0 0) 0x7f958815b0b0 con 0x7f958815efa0 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9588144650 con 0x7f958815efa0 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3389683551 0 0) 0x7f9570003520 con 0x7f9588144270 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588075460 msgr2=0x7f9588166930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588075460 0x7f9588166930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 >> v1:172.21.15.145:6789/0 conn(0x7f958815efa0 legacy=0x7f9588074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95880ce080 con 0x7f9588144270 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f9578001970 con 0x7f9588144270 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 >> v1:172.21.15.113:6789/0 conn(0x7f9588144270 legacy=0x7f95880c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9570003b70 0x7f9570003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9570004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588075460 0x7f95700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f95880c9580 con 0x7f9570004800 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f957000ba70 con 0x7f9570003b70 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f957000bc70 con 0x7f9588075460 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f9585d9b640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9570004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f958659c640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9570003b70 0x7f9570003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f9586d9d640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588075460 0x7f95700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f9585d9b640 1 -- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588075460 msgr2=0x7f95700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f9585d9b640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588075460 0x7f95700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f9585d9b640 1 -- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9570003b70 msgr2=0x7f9570003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f9585d9b640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9570003b70 0x7f9570003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.888+0000 7f9585d9b640 1 -- 172.21.15.113:0/1775993746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9570003520 con 0x7f9570004800 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.889+0000 7f9585d9b640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9570004c80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f957c0018d0 tx=0x7f9570005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cda23afb7522298 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.889+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c037070 con 0x7f9570004800 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.889+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c0052d0 con 0x7f9570004800 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.889+0000 7f958559a640 1 -- 172.21.15.113:0/1775993746 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0014f0 con 0x7f9570004800 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.890+0000 7f958cff4640 1 -- 172.21.15.113:0/1775993746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 msgr2=0x7f9570004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.890+0000 7f958cff4640 1 --2- 172.21.15.113:0/1775993746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9570004c80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f957c0018d0 tx=0x7f9570005830 comp rx=0 tx=0).stop 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.890+0000 7f9586d9d640 1 -- 172.21.15.113:0/1775993746 reap_dead start 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.890+0000 7f958cff4640 1 -- 172.21.15.113:0/1775993746 shutdown_connections 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.890+0000 7f958cff4640 1 -- 172.21.15.113:0/1775993746 >> 172.21.15.113:0/1775993746 conn(0x7f958806b920 msgr2=0x7f958806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.890+0000 7f958cff4640 1 -- 172.21.15.113:0/1775993746 shutdown_connections 2024-04-22T06:31:51.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.890+0000 7f958cff4640 1 -- 172.21.15.113:0/1775993746 wait complete. 2024-04-22T06:31:51.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.891+0000 7f958cff4640 1 Processor -- start 2024-04-22T06:31:51.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.891+0000 7f958cff4640 1 -- start start 2024-04-22T06:31:51.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958cff4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9588142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958cff4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f958806bd90 0x7f95881e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958cff4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588159bd0 0x7f95881f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958cff4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f958815b8e0 con 0x7f9570004800 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958cff4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f958815b600 con 0x7f958806bd90 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958cff4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f95880ce360 con 0x7f9588159bd0 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9588142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9588142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46406/0 (socket says 172.21.15.113:46406) 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 -- 172.21.15.113:0/256426845 learned_addr learned my addr 172.21.15.113:0/256426845 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f9585d9b640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f958806bd90 0x7f95881e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f9586d9d640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588159bd0 0x7f95881f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 -- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588159bd0 msgr2=0x7f95881f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588159bd0 0x7f95881f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 -- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f958806bd90 msgr2=0x7f95881e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:51.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f958806bd90 0x7f95881e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 -- 172.21.15.113:0/256426845 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95880c4b60 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f9585d9b640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f958806bd90 0x7f95881e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f9586d9d640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588159bd0 0x7f95881f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958659c640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9588142130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9578007850 tx=0x7f957800a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f9576ffd640 1 -- 172.21.15.113:0/256426845 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957800acb0 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f9576ffd640 1 -- 172.21.15.113:0/256426845 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9578018070 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9588142750 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f9576ffd640 1 -- 172.21.15.113:0/256426845 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578013630 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.892+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95880c64c0 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.893+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9588068e40 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.894+0000 7f9576ffd640 1 -- 172.21.15.113:0/256426845 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95780137d0 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.894+0000 7f9576ffd640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f956806c8f0 0x7f956806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.894+0000 7f9576ffd640 1 -- 172.21.15.113:0/256426845 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f957808c570 con 0x7f9570004800 2024-04-22T06:31:51.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.894+0000 7f9585d9b640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f956806c8f0 0x7f956806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:51.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.895+0000 7f9585d9b640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f956806c8f0 0x7f956806edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f957c034000 tx=0x7f957c031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:51.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:51.898+0000 7f9576ffd640 1 -- 172.21.15.113:0/256426845 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f957805a6f0 con 0x7f9570004800 2024-04-22T06:31:52.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.092+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95880c8110 con 0x7f9570004800 2024-04-22T06:31:52.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.092+0000 7f9576ffd640 1 -- 172.21.15.113:0/256426845 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f9578059ff0 con 0x7f9570004800 2024-04-22T06:31:52.092 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-04-22T06:31:52.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.094+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f956806c8f0 msgr2=0x7f956806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.094+0000 7f958cff4640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f956806c8f0 0x7f956806edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f957c034000 tx=0x7f957c031000 comp rx=0 tx=0).stop 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 msgr2=0x7f9588142130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9588142130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9578007850 tx=0x7f957800a600 comp rx=0 tx=0).stop 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 shutdown_connections 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9588159bd0 0x7f95881f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f958806bd90 0x7f95881e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f956806c8f0 0x7f956806edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 --2- 172.21.15.113:0/256426845 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9570004800 0x7f9588142130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 >> 172.21.15.113:0/256426845 conn(0x7f958806b920 msgr2=0x7f95880c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 shutdown_connections 2024-04-22T06:31:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.095+0000 7f958cff4640 1 -- 172.21.15.113:0/256426845 wait complete. 2024-04-22T06:31:52.105 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:31:52.105 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T06:31:52.120 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:31:52.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.258+0000 7f06184c1640 1 Processor -- start 2024-04-22T06:31:52.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.258+0000 7f06184c1640 1 -- start start 2024-04-22T06:31:52.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f06184c1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0610155170 0x7f061015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f06184c1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06100cb9e0 0x7f06100c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f06184c1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06100ccf00 con 0x7f0610155550 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f06184c1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f06100cddf0 con 0x7f06100cb9e0 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f06184c1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f061015f430 con 0x7f0610155170 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f0616a5e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06100cb9e0 0x7f06100c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f0615a5c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0610155550 0x7f06100d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44540/0 (socket says 172.21.15.113:44540) 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f0615a5c640 1 -- 172.21.15.113:0/2555468905 learned_addr learned my addr 172.21.15.113:0/2555468905 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f0616a5e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06100cb9e0 0x7f06100c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46418/0 (socket says 172.21.15.113:46418) 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f061525b640 1 -- 172.21.15.113:0/2555468905 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59405617 0 0) 0x7f06100ccf00 con 0x7f0610155550 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f061525b640 1 -- 172.21.15.113:0/2555468905 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05fc003520 con 0x7f0610155550 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f061625d640 1 --2- 172.21.15.113:0/2555468905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0610155170 0x7f061015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f0616a5e640 1 -- 172.21.15.113:0/2555468905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0610155170 msgr2=0x7f061015eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f0616a5e640 1 --2- 172.21.15.113:0/2555468905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0610155170 0x7f061015eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f0616a5e640 1 -- 172.21.15.113:0/2555468905 >> v1:172.21.15.113:6789/0 conn(0x7f0610155550 legacy=0x7f06100d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.259+0000 7f0616a5e640 1 -- 172.21.15.113:0/2555468905 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06100cd1e0 con 0x7f06100cb9e0 2024-04-22T06:31:52.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.260+0000 7f0616a5e640 1 --2- 172.21.15.113:0/2555468905 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06100cb9e0 0x7f06100c5810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0608009d90 tx=0x7f060802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2814022bd323e01 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.260+0000 7f061525b640 1 -- 172.21.15.113:0/2555468905 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608039070 con 0x7f06100cb9e0 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.260+0000 7f061525b640 1 -- 172.21.15.113:0/2555468905 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060802cbc0 con 0x7f06100cb9e0 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.260+0000 7f061525b640 1 -- 172.21.15.113:0/2555468905 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608034440 con 0x7f06100cb9e0 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.261+0000 7f06184c1640 1 -- 172.21.15.113:0/2555468905 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06100cb9e0 msgr2=0x7f06100c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.261+0000 7f06184c1640 1 --2- 172.21.15.113:0/2555468905 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06100cb9e0 0x7f06100c5810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0608009d90 tx=0x7f060802be10 comp rx=0 tx=0).stop 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.261+0000 7f06184c1640 1 -- 172.21.15.113:0/2555468905 shutdown_connections 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.261+0000 7f06184c1640 1 --2- 172.21.15.113:0/2555468905 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06100cb9e0 0x7f06100c5810 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.261+0000 7f06184c1640 1 --2- 172.21.15.113:0/2555468905 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0610155170 0x7f061015eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.261+0000 7f06184c1640 1 -- 172.21.15.113:0/2555468905 >> 172.21.15.113:0/2555468905 conn(0x7f0610072570 msgr2=0x7f0610074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.261+0000 7f06184c1640 1 -- 172.21.15.113:0/2555468905 shutdown_connections 2024-04-22T06:31:52.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.261+0000 7f06184c1640 1 -- 172.21.15.113:0/2555468905 wait complete. 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.262+0000 7f06184c1640 1 Processor -- start 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.262+0000 7f06184c1640 1 -- start start 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f06184c1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06100cb9e0 0x7f0610150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f06184c1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0610155170 0x7f061015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f06184c1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0610155550 0x7f06101f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f06184c1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f06100cda80 con 0x7f0610155550 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f06184c1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f06100cd7a0 con 0x7f0610155170 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f06184c1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f06100ccae0 con 0x7f06100cb9e0 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0610155550 0x7f06101f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0610155550 0x7f06101f1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46422/0 (socket says 172.21.15.113:46422) 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 -- 172.21.15.113:0/2319669862 learned_addr learned my addr 172.21.15.113:0/2319669862 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:52.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0615a5c640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0610155170 0x7f061015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f061625d640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06100cb9e0 0x7f0610150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 -- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06100cb9e0 msgr2=0x7f0610150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06100cb9e0 0x7f0610150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 -- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0610155170 msgr2=0x7f061015dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0610155170 0x7f061015dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 -- 172.21.15.113:0/2319669862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06101475d0 con 0x7f0610155550 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0615a5c640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0610155170 0x7f061015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f061625d640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06100cb9e0 0x7f0610150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0616a5e640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0610155550 0x7f06101f1170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0608009eb0 tx=0x7f0608004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0606ffd640 1 -- 172.21.15.113:0/2319669862 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608039050 con 0x7f0610155550 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0606ffd640 1 -- 172.21.15.113:0/2319669862 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0608045070 con 0x7f0610155550 2024-04-22T06:31:52.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f0606ffd640 1 -- 172.21.15.113:0/2319669862 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608009450 con 0x7f0610155550 2024-04-22T06:31:52.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06101f4c80 con 0x7f0610155550 2024-04-22T06:31:52.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.263+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0610147b50 con 0x7f0610155550 2024-04-22T06:31:52.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.264+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06100ccf00 con 0x7f0610155550 2024-04-22T06:31:52.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.265+0000 7f0606ffd640 1 -- 172.21.15.113:0/2319669862 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f060803e850 con 0x7f0610155550 2024-04-22T06:31:52.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.265+0000 7f0606ffd640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f05f406c920 0x7f05f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.265+0000 7f0606ffd640 1 -- 172.21.15.113:0/2319669862 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f06080ae520 con 0x7f0610155550 2024-04-22T06:31:52.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.265+0000 7f061625d640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f05f406c920 0x7f05f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.266+0000 7f061625d640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f05f406c920 0x7f05f406ede0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f060c008890 tx=0x7f060c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.269+0000 7f0606ffd640 1 -- 172.21.15.113:0/2319669862 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f06100ccf00 con 0x7f0610155550 2024-04-22T06:31:52.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.446+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0610068e40 con 0x7f0610155550 2024-04-22T06:31:52.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.447+0000 7f0606ffd640 1 -- 172.21.15.113:0/2319669862 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f060804e020 con 0x7f0610155550 2024-04-22T06:31:52.447 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:31:52.447 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f05f406c920 msgr2=0x7f05f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f05f406c920 0x7f05f406ede0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f060c008890 tx=0x7f060c008040 comp rx=0 tx=0).stop 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0610155550 msgr2=0x7f06101f1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0610155550 0x7f06101f1170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0608009eb0 tx=0x7f0608004a40 comp rx=0 tx=0).stop 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 shutdown_connections 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f05f406c920 0x7f05f406ede0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0610155550 0x7f06101f1170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0610155170 0x7f061015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 --2- 172.21.15.113:0/2319669862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06100cb9e0 0x7f0610150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 >> 172.21.15.113:0/2319669862 conn(0x7f0610072570 msgr2=0x7f06101533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 shutdown_connections 2024-04-22T06:31:52.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.449+0000 7f06184c1640 1 -- 172.21.15.113:0/2319669862 wait complete. 2024-04-22T06:31:52.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:31:52.460 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:31:52.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.559+0000 7f2c7686d640 1 Processor -- start 2024-04-22T06:31:52.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.559+0000 7f2c7686d640 1 -- start start 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c7686d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2c700ca260 0x7f2c70159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c7686d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c700ca640 0x7f2c7015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c7686d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c700c4da0 con 0x7f2c7015cf10 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c7686d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f2c700c7a40 con 0x7f2c700ca260 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c7686d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c700c5080 con 0x7f2c700ca640 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c6ffff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2c700ca260 0x7f2c70159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c74e0a640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f2c7015cf10 0x7f2c700cda80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:43970/0 (socket says 172.21.15.113:43970) 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c74e0a640 1 -- 172.21.15.113:0/3863415121 learned_addr learned my addr 172.21.15.113:0/3863415121 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:52.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c6f7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c700ca640 0x7f2c7015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c6ffff640 1 --2- 172.21.15.113:0/3863415121 >> v2:172.21.15.145:3300/0 conn(0x7f2c700ca260 0x7f2c70159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:41986/0 (socket says 172.21.15.113:41986) 2024-04-22T06:31:52.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c6ffff640 1 -- 172.21.15.113:0/3863415121 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c700ca640 msgr2=0x7f2c7015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:52.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c6ffff640 1 --2- 172.21.15.113:0/3863415121 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c700ca640 0x7f2c7015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c6ffff640 1 -- 172.21.15.113:0/3863415121 >> v1:172.21.15.145:6789/0 conn(0x7f2c7015cf10 legacy=0x7f2c700cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.560+0000 7f2c6ffff640 1 -- 172.21.15.113:0/3863415121 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c700c5360 con 0x7f2c700ca260 2024-04-22T06:31:52.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.561+0000 7f2c6ffff640 1 --2- 172.21.15.113:0/3863415121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca260 0x7f2c70159690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c600097a0 tx=0x7f2c6002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea79d9e121bae0b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.561+0000 7f2c6effd640 1 -- 172.21.15.113:0/3863415121 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60034070 con 0x7f2c700ca260 2024-04-22T06:31:52.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.561+0000 7f2c6effd640 1 -- 172.21.15.113:0/3863415121 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60030610 con 0x7f2c700ca260 2024-04-22T06:31:52.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.561+0000 7f2c6effd640 1 -- 172.21.15.113:0/3863415121 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600309e0 con 0x7f2c700ca260 2024-04-22T06:31:52.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.562+0000 7f2c7686d640 1 -- 172.21.15.113:0/3863415121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca260 msgr2=0x7f2c70159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.562+0000 7f2c7686d640 1 --2- 172.21.15.113:0/3863415121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca260 0x7f2c70159690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c600097a0 tx=0x7f2c6002b960 comp rx=0 tx=0).stop 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.562+0000 7f2c7686d640 1 -- 172.21.15.113:0/3863415121 shutdown_connections 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.562+0000 7f2c7686d640 1 --2- 172.21.15.113:0/3863415121 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c700ca640 0x7f2c7015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.562+0000 7f2c7686d640 1 --2- 172.21.15.113:0/3863415121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca260 0x7f2c70159690 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.562+0000 7f2c7686d640 1 -- 172.21.15.113:0/3863415121 >> 172.21.15.113:0/3863415121 conn(0x7f2c7006b920 msgr2=0x7f2c7006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.562+0000 7f2c7686d640 1 -- 172.21.15.113:0/3863415121 shutdown_connections 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.562+0000 7f2c7686d640 1 -- 172.21.15.113:0/3863415121 wait complete. 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.563+0000 7f2c7686d640 1 Processor -- start 2024-04-22T06:31:52.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.563+0000 7f2c7686d640 1 -- start start 2024-04-22T06:31:52.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c7686d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c700ca260 0x7f2c701e2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c7686d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca640 0x7f2c700cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c7686d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c7015cf10 0x7f2c701e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c7686d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7015d360 con 0x7f2c700ca260 2024-04-22T06:31:52.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c7686d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2c70159170 con 0x7f2c700ca640 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c7686d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c70158e60 con 0x7f2c7015cf10 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c700ca260 0x7f2c701e2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c700ca260 0x7f2c701e2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46424/0 (socket says 172.21.15.113:46424) 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6ffff640 1 -- 172.21.15.113:0/2596531968 learned_addr learned my addr 172.21.15.113:0/2596531968 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6f7fe640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca640 0x7f2c700cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c74e0a640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c7015cf10 0x7f2c701e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6ffff640 1 -- 172.21.15.113:0/2596531968 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c7015cf10 msgr2=0x7f2c701e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6ffff640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c7015cf10 0x7f2c701e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6ffff640 1 -- 172.21.15.113:0/2596531968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca640 msgr2=0x7f2c700cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6ffff640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca640 0x7f2c700cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.564+0000 7f2c6ffff640 1 -- 172.21.15.113:0/2596531968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c70159fe0 con 0x7f2c700ca260 2024-04-22T06:31:52.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.565+0000 7f2c6ffff640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c700ca260 0x7f2c701e2280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c600098c0 tx=0x7f2c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.565+0000 7f2c6cff9640 1 -- 172.21.15.113:0/2596531968 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60034040 con 0x7f2c700ca260 2024-04-22T06:31:52.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.565+0000 7f2c6cff9640 1 -- 172.21.15.113:0/2596531968 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60030410 con 0x7f2c700ca260 2024-04-22T06:31:52.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.565+0000 7f2c6cff9640 1 -- 172.21.15.113:0/2596531968 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60039c30 con 0x7f2c700ca260 2024-04-22T06:31:52.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.565+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c701f1790 con 0x7f2c700ca260 2024-04-22T06:31:52.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.565+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c701f1d30 con 0x7f2c700ca260 2024-04-22T06:31:52.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.566+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c70068f50 con 0x7f2c700ca260 2024-04-22T06:31:52.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.566+0000 7f2c6cff9640 1 -- 172.21.15.113:0/2596531968 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c60037070 con 0x7f2c700ca260 2024-04-22T06:31:52.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.567+0000 7f2c6cff9640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c5c06c8f0 0x7f2c5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.567+0000 7f2c6f7fe640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c5c06c8f0 0x7f2c5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.567+0000 7f2c6cff9640 1 -- 172.21.15.113:0/2596531968 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2c600add20 con 0x7f2c700ca260 2024-04-22T06:31:52.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.567+0000 7f2c6f7fe640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c5c06c8f0 0x7f2c5c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c7015c750 tx=0x7f2c64009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.571+0000 7f2c6cff9640 1 -- 172.21.15.113:0/2596531968 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c600305e0 con 0x7f2c700ca260 2024-04-22T06:31:52.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.746+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2c701f23f0 con 0x7f2c700ca260 2024-04-22T06:31:52.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.746+0000 7f2c6cff9640 1 -- 172.21.15.113:0/2596531968 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f2c6007b8e0 con 0x7f2c700ca260 2024-04-22T06:31:52.745 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c5c06c8f0 msgr2=0x7f2c5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c5c06c8f0 0x7f2c5c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c7015c750 tx=0x7f2c64009190 comp rx=0 tx=0).stop 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c700ca260 msgr2=0x7f2c701e2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c700ca260 0x7f2c701e2280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c600098c0 tx=0x7f2c600046c0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 shutdown_connections 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c7015cf10 0x7f2c701e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c700ca640 0x7f2c700cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c5c06c8f0 0x7f2c5c06edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 --2- 172.21.15.113:0/2596531968 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c700ca260 0x7f2c701e2280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 >> 172.21.15.113:0/2596531968 conn(0x7f2c7006b920 msgr2=0x7f2c70156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:52.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 shutdown_connections 2024-04-22T06:31:52.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.748+0000 7f2c7686d640 1 -- 172.21.15.113:0/2596531968 wait complete. 2024-04-22T06:31:52.758 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:31:52.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.859+0000 7ff5622e0640 1 Processor -- start 2024-04-22T06:31:52.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.859+0000 7ff5622e0640 1 -- start start 2024-04-22T06:31:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff5622e0640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff55c144530 0x7ff55c15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff5622e0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55c15bf80 con 0x7ff55c075850 2024-04-22T06:31:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff5622e0640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55c15e750 con 0x7ff55c075430 2024-04-22T06:31:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff5622e0640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7ff55c15f360 con 0x7ff55c144530 2024-04-22T06:31:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff56087d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff55c075850 0x7ff55c15c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44546/0 (socket says 172.21.15.113:44546) 2024-04-22T06:31:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff56087d640 1 -- 172.21.15.113:0/4291359196 learned_addr learned my addr 172.21.15.113:0/4291359196 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff55bfff640 1 --2- 172.21.15.113:0/4291359196 >> v2:172.21.15.145:3300/0 conn(0x7ff55c144530 0x7ff55c15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff55affd640 1 -- 172.21.15.113:0/4291359196 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3100522215 0 0) 0x7ff554001490 con 0x7ff55c075850 2024-04-22T06:31:52.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff55affd640 1 -- 172.21.15.113:0/4291359196 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff544003520 con 0x7ff55c075850 2024-04-22T06:31:52.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff55bfff640 1 -- 172.21.15.113:0/4291359196 >> v1:172.21.15.145:6789/0 conn(0x7ff55c075430 legacy=0x7ff55c0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff55bfff640 1 -- 172.21.15.113:0/4291359196 >> v1:172.21.15.113:6789/0 conn(0x7ff55c075850 legacy=0x7ff55c15c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.860+0000 7ff55bfff640 1 -- 172.21.15.113:0/4291359196 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c15ea30 con 0x7ff55c144530 2024-04-22T06:31:52.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.861+0000 7ff55bfff640 1 --2- 172.21.15.113:0/4291359196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c144530 0x7ff55c15ba40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0097a0 tx=0x7ff54c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd439bf8ce5e504e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.861+0000 7ff55affd640 1 -- 172.21.15.113:0/4291359196 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c034070 con 0x7ff55c144530 2024-04-22T06:31:52.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.861+0000 7ff55affd640 1 -- 172.21.15.113:0/4291359196 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c030610 con 0x7ff55c144530 2024-04-22T06:31:52.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.861+0000 7ff55affd640 1 -- 172.21.15.113:0/4291359196 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0309e0 con 0x7ff55c144530 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.862+0000 7ff5622e0640 1 -- 172.21.15.113:0/4291359196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c144530 msgr2=0x7ff55c15ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.862+0000 7ff5622e0640 1 --2- 172.21.15.113:0/4291359196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c144530 0x7ff55c15ba40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0097a0 tx=0x7ff54c02b960 comp rx=0 tx=0).stop 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.862+0000 7ff5622e0640 1 -- 172.21.15.113:0/4291359196 shutdown_connections 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.862+0000 7ff5622e0640 1 --2- 172.21.15.113:0/4291359196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c144530 0x7ff55c15ba40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.862+0000 7ff5622e0640 1 -- 172.21.15.113:0/4291359196 >> 172.21.15.113:0/4291359196 conn(0x7ff55c06ebf0 msgr2=0x7ff55c06ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.862+0000 7ff5622e0640 1 -- 172.21.15.113:0/4291359196 shutdown_connections 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.862+0000 7ff5622e0640 1 -- 172.21.15.113:0/4291359196 wait complete. 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.863+0000 7ff5622e0640 1 Processor -- start 2024-04-22T06:31:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.863+0000 7ff5622e0640 1 -- start start 2024-04-22T06:31:52.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff5622e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff55c075430 0x7ff55c1f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff5622e0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c075850 0x7ff55c15a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff5622e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff55c144530 0x7ff55c13fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff5622e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c0cdce0 con 0x7ff55c075430 2024-04-22T06:31:52.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff5622e0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c15eff0 con 0x7ff55c075850 2024-04-22T06:31:52.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff5622e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff55c0cde60 con 0x7ff55c144530 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff55c075430 0x7ff55c1f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff55c075430 0x7ff55c1f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46428/0 (socket says 172.21.15.113:46428) 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 -- 172.21.15.113:0/4135575606 learned_addr learned my addr 172.21.15.113:0/4135575606 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55b7fe640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c075850 0x7ff55c15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 -- 172.21.15.113:0/4135575606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff55c144530 msgr2=0x7ff55c13fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff56087d640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff55c144530 0x7ff55c13fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff55c144530 0x7ff55c13fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 -- 172.21.15.113:0/4135575606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c075850 msgr2=0x7ff55c15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c075850 0x7ff55c15a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 -- 172.21.15.113:0/4135575606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c155c70 con 0x7ff55c075430 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.864+0000 7ff55bfff640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff55c075430 0x7ff55c1f15e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff54c02bf70 tx=0x7ff54c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.865+0000 7ff558ff9640 1 -- 172.21.15.113:0/4135575606 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c034040 con 0x7ff55c075430 2024-04-22T06:31:52.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.865+0000 7ff558ff9640 1 -- 172.21.15.113:0/4135575606 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c03aaa0 con 0x7ff55c075430 2024-04-22T06:31:52.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.865+0000 7ff558ff9640 1 -- 172.21.15.113:0/4135575606 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0443f0 con 0x7ff55c075430 2024-04-22T06:31:52.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.865+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55c156210 con 0x7ff55c075430 2024-04-22T06:31:52.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.865+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55c155f30 con 0x7ff55c075430 2024-04-22T06:31:52.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.865+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55c068f50 con 0x7ff55c075430 2024-04-22T06:31:52.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.866+0000 7ff558ff9640 1 -- 172.21.15.113:0/4135575606 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff54c04b060 con 0x7ff55c075430 2024-04-22T06:31:52.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.866+0000 7ff558ff9640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff54806c920 0x7ff54806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:52.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.867+0000 7ff558ff9640 1 -- 172.21.15.113:0/4135575606 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff54c0adca0 con 0x7ff55c075430 2024-04-22T06:31:52.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.867+0000 7ff55b7fe640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff54806c920 0x7ff54806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:52.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.867+0000 7ff55b7fe640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff54806c920 0x7ff54806ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0c7c50 tx=0x7ff550009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:52.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:52.871+0000 7ff558ff9640 1 -- 172.21.15.113:0/4135575606 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff54c03f070 con 0x7ff55c075430 2024-04-22T06:31:53.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.045+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff55c0c8180 con 0x7ff55c075430 2024-04-22T06:31:53.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.045+0000 7ff558ff9640 1 -- 172.21.15.113:0/4135575606 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7ff54c04b350 con 0x7ff55c075430 2024-04-22T06:31:53.045 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff54806c920 msgr2=0x7ff54806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff54806c920 0x7ff54806ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0c7c50 tx=0x7ff550009040 comp rx=0 tx=0).stop 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff55c075430 msgr2=0x7ff55c1f15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff55c075430 0x7ff55c1f15e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff54c02bf70 tx=0x7ff54c0046c0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 shutdown_connections 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff55c144530 0x7ff55c13fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff55c075850 0x7ff55c15a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff54806c920 0x7ff54806ede0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 --2- 172.21.15.113:0/4135575606 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff55c075430 0x7ff55c1f15e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 >> 172.21.15.113:0/4135575606 conn(0x7ff55c06ebf0 msgr2=0x7ff55c15c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:53.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 shutdown_connections 2024-04-22T06:31:53.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.047+0000 7ff5622e0640 1 -- 172.21.15.113:0/4135575606 wait complete. 2024-04-22T06:31:53.057 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:31:53.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.157+0000 7f50c9206640 1 Processor -- start 2024-04-22T06:31:53.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.157+0000 7f50c9206640 1 -- start start 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c9206640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f50c40d0820 0x7f50c40d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c9206640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c40c5c80 con 0x7f50c415b070 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c9206640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c40d1170 con 0x7f50c41553c0 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c9206640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f50c415e660 con 0x7f50c40d0820 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50bbfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f50c415b070 0x7f50c40cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44550/0 (socket says 172.21.15.113:44550) 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50bbfff640 1 -- 172.21.15.113:0/3281898477 learned_addr learned my addr 172.21.15.113:0/3281898477 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c359e640 1 --2- 172.21.15.113:0/3281898477 >> v2:172.21.15.145:3300/0 conn(0x7f50c40d0820 0x7f50c40d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c259c640 1 -- 172.21.15.113:0/3281898477 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902728500 0 0) 0x7f50c40c5c80 con 0x7f50c415b070 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c259c640 1 -- 172.21.15.113:0/3281898477 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50b0003520 con 0x7f50c415b070 2024-04-22T06:31:53.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c359e640 1 -- 172.21.15.113:0/3281898477 >> v1:172.21.15.145:6789/0 conn(0x7f50c41553c0 legacy=0x7f50c415edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c359e640 1 -- 172.21.15.113:0/3281898477 >> v1:172.21.15.113:6789/0 conn(0x7f50c415b070 legacy=0x7f50c40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c259c640 1 -- 172.21.15.113:0/3281898477 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2898121395 0 0) 0x7f50b0003520 con 0x7f50c415b070 2024-04-22T06:31:53.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.158+0000 7f50c359e640 1 -- 172.21.15.113:0/3281898477 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c415b5d0 con 0x7f50c40d0820 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.159+0000 7f50c359e640 1 --2- 172.21.15.113:0/3281898477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 0x7f50c40d0c30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009d90 tx=0x7f50bc02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a917db3c96180fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.159+0000 7f50c259c640 1 -- 172.21.15.113:0/3281898477 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc039070 con 0x7f50c40d0820 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.159+0000 7f50c259c640 1 -- 172.21.15.113:0/3281898477 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc02c940 con 0x7f50c40d0820 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.159+0000 7f50c259c640 1 -- 172.21.15.113:0/3281898477 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0017f0 con 0x7f50c40d0820 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.160+0000 7f50c9206640 1 -- 172.21.15.113:0/3281898477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 msgr2=0x7f50c40d0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.160+0000 7f50c9206640 1 --2- 172.21.15.113:0/3281898477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 0x7f50c40d0c30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009d90 tx=0x7f50bc02be10 comp rx=0 tx=0).stop 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.160+0000 7f50c9206640 1 -- 172.21.15.113:0/3281898477 shutdown_connections 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.160+0000 7f50c9206640 1 --2- 172.21.15.113:0/3281898477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 0x7f50c40d0c30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.160+0000 7f50c9206640 1 -- 172.21.15.113:0/3281898477 >> 172.21.15.113:0/3281898477 conn(0x7f50c4072360 msgr2=0x7f50c4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:53.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.160+0000 7f50c9206640 1 -- 172.21.15.113:0/3281898477 shutdown_connections 2024-04-22T06:31:53.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.160+0000 7f50c9206640 1 -- 172.21.15.113:0/3281898477 wait complete. 2024-04-22T06:31:53.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.161+0000 7f50c9206640 1 Processor -- start 2024-04-22T06:31:53.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.161+0000 7f50c9206640 1 -- start start 2024-04-22T06:31:53.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50c9206640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 0x7f50c4153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50c9206640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50c41553c0 0x7f50c41e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50c9206640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50c415b070 0x7f50c41e5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50c9206640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f50c415bb90 con 0x7f50c41553c0 2024-04-22T06:31:53.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50c9206640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41557a0 con 0x7f50c40d0820 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50c9206640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f50c415be70 con 0x7f50c415b070 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50bbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50c41553c0 0x7f50c41e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50bbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50c41553c0 0x7f50c41e4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46442/0 (socket says 172.21.15.113:46442) 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50bbfff640 1 -- 172.21.15.113:0/1318046444 learned_addr learned my addr 172.21.15.113:0/1318046444 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50c2d9d640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 0x7f50c4153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50c359e640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50c415b070 0x7f50c41e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50bbfff640 1 -- 172.21.15.113:0/1318046444 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50c415b070 msgr2=0x7f50c41e5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50bbfff640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50c415b070 0x7f50c41e5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50bbfff640 1 -- 172.21.15.113:0/1318046444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 msgr2=0x7f50c4153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50bbfff640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 0x7f50c4153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.162+0000 7f50bbfff640 1 -- 172.21.15.113:0/1318046444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c40c6910 con 0x7f50c41553c0 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.163+0000 7f50bbfff640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50c41553c0 0x7f50c41e4f00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00c6a0 tx=0x7f50ac00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.163+0000 7f50bb7fe640 1 -- 172.21.15.113:0/1318046444 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac007270 con 0x7f50c41553c0 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.163+0000 7f50bb7fe640 1 -- 172.21.15.113:0/1318046444 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ac007410 con 0x7f50c41553c0 2024-04-22T06:31:53.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.163+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c41e5c30 con 0x7f50c41553c0 2024-04-22T06:31:53.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.163+0000 7f50bb7fe640 1 -- 172.21.15.113:0/1318046444 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0057a0 con 0x7f50c41553c0 2024-04-22T06:31:53.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.163+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c41e61f0 con 0x7f50c41553c0 2024-04-22T06:31:53.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.164+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c4068f50 con 0x7f50c41553c0 2024-04-22T06:31:53.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.164+0000 7f50bb7fe640 1 -- 172.21.15.113:0/1318046444 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50ac005940 con 0x7f50c41553c0 2024-04-22T06:31:53.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.164+0000 7f50bb7fe640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f50a406c920 0x7f50a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.165+0000 7f50bb7fe640 1 -- 172.21.15.113:0/1318046444 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f50ac08bb90 con 0x7f50c41553c0 2024-04-22T06:31:53.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.165+0000 7f50c2d9d640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f50a406c920 0x7f50a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.165+0000 7f50c2d9d640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f50a406c920 0x7f50a406ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f50b4007fd0 tx=0x7f50b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.169+0000 7f50bb7fe640 1 -- 172.21.15.113:0/1318046444 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50ac059630 con 0x7f50c41553c0 2024-04-22T06:31:53.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.341+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f50c40cc0e0 con 0x7f50c41553c0 2024-04-22T06:31:53.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.342+0000 7f50bb7fe640 1 -- 172.21.15.113:0/1318046444 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f50ac05d930 con 0x7f50c41553c0 2024-04-22T06:31:53.341 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:31:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f50a406c920 msgr2=0x7f50a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f50a406c920 0x7f50a406ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f50b4007fd0 tx=0x7f50b4009040 comp rx=0 tx=0).stop 2024-04-22T06:31:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50c41553c0 msgr2=0x7f50c41e4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50c41553c0 0x7f50c41e4f00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00c6a0 tx=0x7f50ac00cb60 comp rx=0 tx=0).stop 2024-04-22T06:31:53.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 shutdown_connections 2024-04-22T06:31:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50c415b070 0x7f50c41e5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f50a406c920 0x7f50a406ede0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f50c41553c0 0x7f50c41e4f00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 --2- 172.21.15.113:0/1318046444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c40d0820 0x7f50c4153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 >> 172.21.15.113:0/1318046444 conn(0x7f50c4072360 msgr2=0x7f50c414da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 shutdown_connections 2024-04-22T06:31:53.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.344+0000 7f50c9206640 1 -- 172.21.15.113:0/1318046444 wait complete. 2024-04-22T06:31:53.354 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:31:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.455+0000 7f1776421640 1 Processor -- start 2024-04-22T06:31:53.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.455+0000 7f1776421640 1 -- start start 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f1776421640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1770074360 0x7f1770073d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f1776421640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f177015ca80 0x7f177015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f1776421640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f177015d450 con 0x7f1770155250 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f1776421640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f177015e950 con 0x7f177015ca80 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f1776421640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f177015f470 con 0x7f1770074360 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f17749be640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f177015ca80 0x7f177015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f17749be640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f177015ca80 0x7f177015cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46444/0 (socket says 172.21.15.113:46444) 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f17749be640 1 -- 172.21.15.113:0/28724022 learned_addr learned my addr 172.21.15.113:0/28724022 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f176f7fe640 1 --2- 172.21.15.113:0/28724022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1770074360 0x7f1770073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f17749be640 1 -- 172.21.15.113:0/28724022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1770074360 msgr2=0x7f1770073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f17749be640 1 --2- 172.21.15.113:0/28724022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1770074360 0x7f1770073d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f17749be640 1 -- 172.21.15.113:0/28724022 >> v1:172.21.15.145:6789/0 conn(0x7f1770155250 legacy=0x7f17700ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.456+0000 7f17749be640 1 -- 172.21.15.113:0/28724022 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177015ebf0 con 0x7f177015ca80 2024-04-22T06:31:53.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.457+0000 7f17749be640 1 --2- 172.21.15.113:0/28724022 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f177015ca80 0x7f177015cf10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1768009e50 tx=0x7f176802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb9855012db3676 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.457+0000 7f176effd640 1 -- 172.21.15.113:0/28724022 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176802cb00 con 0x7f177015ca80 2024-04-22T06:31:53.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.457+0000 7f176effd640 1 -- 172.21.15.113:0/28724022 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176802cca0 con 0x7f177015ca80 2024-04-22T06:31:53.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.457+0000 7f176effd640 1 -- 172.21.15.113:0/28724022 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768034610 con 0x7f177015ca80 2024-04-22T06:31:53.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.458+0000 7f1776421640 1 -- 172.21.15.113:0/28724022 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f177015ca80 msgr2=0x7f177015cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.458+0000 7f1776421640 1 --2- 172.21.15.113:0/28724022 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f177015ca80 0x7f177015cf10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1768009e50 tx=0x7f176802bf60 comp rx=0 tx=0).stop 2024-04-22T06:31:53.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.458+0000 7f1776421640 1 -- 172.21.15.113:0/28724022 shutdown_connections 2024-04-22T06:31:53.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.458+0000 7f1776421640 1 --2- 172.21.15.113:0/28724022 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f177015ca80 0x7f177015cf10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.458+0000 7f1776421640 1 --2- 172.21.15.113:0/28724022 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1770074360 0x7f1770073d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.458+0000 7f1776421640 1 -- 172.21.15.113:0/28724022 >> 172.21.15.113:0/28724022 conn(0x7f1770068570 msgr2=0x7f1770074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.458+0000 7f1776421640 1 -- 172.21.15.113:0/28724022 shutdown_connections 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.458+0000 7f1776421640 1 -- 172.21.15.113:0/28724022 wait complete. 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.459+0000 7f1776421640 1 Processor -- start 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.459+0000 7f1776421640 1 -- start start 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f1776421640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1770074360 0x7f17700ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f1776421640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1770155250 0x7f17700c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f1776421640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f177015ca80 0x7f17700c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f1776421640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f177015c560 con 0x7f1770074360 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f1776421640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f177015f190 con 0x7f1770155250 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f1776421640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f177006c3e0 con 0x7f177015ca80 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1770074360 0x7f17700ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1770074360 0x7f17700ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46448/0 (socket says 172.21.15.113:46448) 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 -- 172.21.15.113:0/2930059528 learned_addr learned my addr 172.21.15.113:0/2930059528 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176f7fe640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1770155250 0x7f17700c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f17749be640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f177015ca80 0x7f17700c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 -- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f177015ca80 msgr2=0x7f17700c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f177015ca80 0x7f17700c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 -- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1770155250 msgr2=0x7f17700c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1770155250 0x7f17700c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 -- 172.21.15.113:0/2930059528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17701521c0 con 0x7f1770074360 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176f7fe640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1770155250 0x7f17700c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.460+0000 7f176ffff640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1770074360 0x7f17700ccee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f176000c430 tx=0x7f176000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.461+0000 7f176cff9640 1 -- 172.21.15.113:0/2930059528 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17600052d0 con 0x7f1770074360 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.461+0000 7f176cff9640 1 -- 172.21.15.113:0/2930059528 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1760005490 con 0x7f1770074360 2024-04-22T06:31:53.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.461+0000 7f176cff9640 1 -- 172.21.15.113:0/2930059528 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760007260 con 0x7f1770074360 2024-04-22T06:31:53.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.461+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17701f47f0 con 0x7f1770074360 2024-04-22T06:31:53.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.461+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17701f4db0 con 0x7f1770074360 2024-04-22T06:31:53.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.462+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1770074d50 con 0x7f1770074360 2024-04-22T06:31:53.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.462+0000 7f176cff9640 1 -- 172.21.15.113:0/2930059528 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1760007400 con 0x7f1770074360 2024-04-22T06:31:53.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.462+0000 7f176cff9640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f175c06c920 0x7f175c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.463+0000 7f176cff9640 1 -- 172.21.15.113:0/2930059528 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f176008b3f0 con 0x7f1770074360 2024-04-22T06:31:53.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.463+0000 7f176f7fe640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f175c06c920 0x7f175c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.463+0000 7f176f7fe640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f175c06c920 0x7f175c06ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1770152670 tx=0x7f1764008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.467+0000 7f176cff9640 1 -- 172.21.15.113:0/2930059528 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1770074d50 con 0x7f1770074360 2024-04-22T06:31:53.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.640+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f17700cd930 con 0x7f1770074360 2024-04-22T06:31:53.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.641+0000 7f176cff9640 1 -- 172.21.15.113:0/2930059528 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f17700cd930 con 0x7f1770074360 2024-04-22T06:31:53.640 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:31:53.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f175c06c920 msgr2=0x7f175c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f175c06c920 0x7f175c06ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1770152670 tx=0x7f1764008040 comp rx=0 tx=0).stop 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1770074360 msgr2=0x7f17700ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1770074360 0x7f17700ccee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f176000c430 tx=0x7f176000c8f0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 shutdown_connections 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f177015ca80 0x7f17700c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1770155250 0x7f17700c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f175c06c920 0x7f175c06ede0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 --2- 172.21.15.113:0/2930059528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1770074360 0x7f17700ccee0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 >> 172.21.15.113:0/2930059528 conn(0x7f1770068570 msgr2=0x7f1770149f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 shutdown_connections 2024-04-22T06:31:53.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.643+0000 7f1776421640 1 -- 172.21.15.113:0/2930059528 wait complete. 2024-04-22T06:31:53.653 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T06:31:53.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.751+0000 7f77ee359640 1 Processor -- start 2024-04-22T06:31:53.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.751+0000 7f77ee359640 1 -- start start 2024-04-22T06:31:53.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77ee359640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f77e806bb90 0x7f77e815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77ee359640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e815bef0 con 0x7f77e80c99f0 2024-04-22T06:31:53.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77ee359640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e815b650 con 0x7f77e806bf70 2024-04-22T06:31:53.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77ee359640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f77e815f510 con 0x7f77e806bb90 2024-04-22T06:31:53.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77ec8f6640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f77e80c99f0 0x7f77e8154db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44556/0 (socket says 172.21.15.113:44556) 2024-04-22T06:31:53.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77ec8f6640 1 -- 172.21.15.113:0/1174128028 learned_addr learned my addr 172.21.15.113:0/1174128028 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e7fff640 1 --2- 172.21.15.113:0/1174128028 >> v2:172.21.15.145:3300/0 conn(0x7f77e806bb90 0x7f77e815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937863289 0 0) 0x7f77e815bef0 con 0x7f77e80c99f0 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77d0003520 con 0x7f77e80c99f0 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3480319696 0 0) 0x7f77d0003520 con 0x7f77e80c99f0 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 >> v2:172.21.15.145:3300/0 conn(0x7f77e806bb90 msgr2=0x7f77e815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 --2- 172.21.15.113:0/1174128028 >> v2:172.21.15.145:3300/0 conn(0x7f77e806bb90 0x7f77e815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 >> v1:172.21.15.145:6789/0 conn(0x7f77e806bf70 legacy=0x7f77e815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e815b930 con 0x7f77e80c99f0 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f77e00019f0 con 0x7f77e80c99f0 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 >> v1:172.21.15.113:6789/0 conn(0x7f77e80c99f0 legacy=0x7f77e8154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d00039b0 0x7f77d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d0004800 0x7f77d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d00051c0 0x7f77d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f77e815f510 con 0x7f77d0004800 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f77d000c070 con 0x7f77d00051c0 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.752+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f77d000c270 con 0x7f77d00039b0 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77e77fe640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d0004800 0x7f77d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77e7fff640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d00039b0 0x7f77d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77ec8f6640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d00051c0 0x7f77d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77e77fe640 1 -- 172.21.15.113:0/1174128028 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d00039b0 msgr2=0x7f77d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77e77fe640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77d00039b0 0x7f77d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77e77fe640 1 -- 172.21.15.113:0/1174128028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d00051c0 msgr2=0x7f77d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77e77fe640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d00051c0 0x7f77d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77ec8f6640 1 -- 172.21.15.113:0/1174128028 reap_dead start 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.753+0000 7f77e77fe640 1 -- 172.21.15.113:0/1174128028 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d0003520 con 0x7f77d0004800 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77e77fe640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d0004800 0x7f77d0004c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f77dc001720 tx=0x7f77d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b66c365e1e89a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc001370 con 0x7f77d0004800 2024-04-22T06:31:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc0052d0 con 0x7f77d0004800 2024-04-22T06:31:53.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77e6ffd640 1 -- 172.21.15.113:0/1174128028 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc003830 con 0x7f77d0004800 2024-04-22T06:31:53.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77ee359640 1 -- 172.21.15.113:0/1174128028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d0004800 msgr2=0x7f77d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77ee359640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d0004800 0x7f77d0004c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f77dc001720 tx=0x7f77d0005830 comp rx=0 tx=0).stop 2024-04-22T06:31:53.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77ee359640 1 -- 172.21.15.113:0/1174128028 shutdown_connections 2024-04-22T06:31:53.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77ee359640 1 --2- 172.21.15.113:0/1174128028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77d0004800 0x7f77d0004c80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77ee359640 1 -- 172.21.15.113:0/1174128028 >> 172.21.15.113:0/1174128028 conn(0x7f77e8074d50 msgr2=0x7f77e8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:53.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77ee359640 1 -- 172.21.15.113:0/1174128028 shutdown_connections 2024-04-22T06:31:53.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.754+0000 7f77ee359640 1 -- 172.21.15.113:0/1174128028 wait complete. 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.755+0000 7f77ee359640 1 Processor -- start 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77ee359640 1 -- start start 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77ee359640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d0004800 0x7f77e80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77ee359640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e80c81c0 0x7f77e8150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77ee359640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77e81f10a0 0x7f77e81f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77ee359640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f77e815e8e0 con 0x7f77e80c81c0 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77ee359640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f77e815e600 con 0x7f77d0004800 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77ee359640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f77e8074560 con 0x7f77e81f10a0 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77e77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e80c81c0 0x7f77e8150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77e77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e80c81c0 0x7f77e8150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:46452/0 (socket says 172.21.15.113:46452) 2024-04-22T06:31:53.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77e77fe640 1 -- 172.21.15.113:0/824522813 learned_addr learned my addr 172.21.15.113:0/824522813 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77ec8f6640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77e81f10a0 0x7f77e81f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.756+0000 7f77e7fff640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d0004800 0x7f77e80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e77fe640 1 -- 172.21.15.113:0/824522813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77e81f10a0 msgr2=0x7f77e81f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e77fe640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77e81f10a0 0x7f77e81f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e77fe640 1 -- 172.21.15.113:0/824522813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d0004800 msgr2=0x7f77e80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e77fe640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d0004800 0x7f77e80c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e77fe640 1 -- 172.21.15.113:0/824522813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e80c77d0 con 0x7f77e80c81c0 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e77fe640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e80c81c0 0x7f77e8150680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77dc005040 tx=0x7f77dc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e4ff9640 1 -- 172.21.15.113:0/824522813 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc041020 con 0x7f77e80c81c0 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e4ff9640 1 -- 172.21.15.113:0/824522813 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc005480 con 0x7f77e80c81c0 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e814ec80 con 0x7f77e80c81c0 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77e4ff9640 1 -- 172.21.15.113:0/824522813 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc007a30 con 0x7f77e80c81c0 2024-04-22T06:31:53.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.757+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e81e7a00 con 0x7f77e80c81c0 2024-04-22T06:31:53.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.758+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e8153390 con 0x7f77e80c81c0 2024-04-22T06:31:53.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.758+0000 7f77e4ff9640 1 -- 172.21.15.113:0/824522813 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77dc044020 con 0x7f77e80c81c0 2024-04-22T06:31:53.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.759+0000 7f77e4ff9640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f77d406c8f0 0x7f77d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:31:53.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.759+0000 7f77e7fff640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f77d406c8f0 0x7f77d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:31:53.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.759+0000 7f77e4ff9640 1 -- 172.21.15.113:0/824522813 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f77dc0ad8f0 con 0x7f77e80c81c0 2024-04-22T06:31:53.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.759+0000 7f77e7fff640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f77d406c8f0 0x7f77d406edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009c40 tx=0x7f77d8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:31:53.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.763+0000 7f77e4ff9640 1 -- 172.21.15.113:0/824522813 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77e8153390 con 0x7f77e80c81c0 2024-04-22T06:31:53.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.958+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f77e8068e40 con 0x7f77e80c81c0 2024-04-22T06:31:53.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.959+0000 7f77e4ff9640 1 -- 172.21.15.113:0/824522813 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f77dc04b030 con 0x7f77e80c81c0 2024-04-22T06:31:53.958 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-04-22T06:31:53.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f77d406c8f0 msgr2=0x7f77d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f77d406c8f0 0x7f77d406edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009c40 tx=0x7f77d8009190 comp rx=0 tx=0).stop 2024-04-22T06:31:53.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e80c81c0 msgr2=0x7f77e8150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:31:53.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e80c81c0 0x7f77e8150680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77dc005040 tx=0x7f77dc001120 comp rx=0 tx=0).stop 2024-04-22T06:31:53.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 shutdown_connections 2024-04-22T06:31:53.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f77e81f10a0 0x7f77e81f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f77d406c8f0 0x7f77d406edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77e80c81c0 0x7f77e8150680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.960+0000 7f77ee359640 1 --2- 172.21.15.113:0/824522813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77d0004800 0x7f77e80c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:31:53.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.961+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 >> 172.21.15.113:0/824522813 conn(0x7f77e8074d50 msgr2=0x7f77e8154740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:31:53.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.961+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 shutdown_connections 2024-04-22T06:31:53.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:31:53.961+0000 7f77ee359640 1 -- 172.21.15.113:0/824522813 wait complete. 2024-04-22T06:31:53.971 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi113.front.sepia.ceph.com... 2024-04-22T06:31:53.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:31:53.971 DEBUG:teuthology.orchestra.run.smithi113:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-22T06:31:53.992 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi113.stderr:ceph-fuse[40855]: fuse finished with error 0 and tester_r 0 2024-04-22T06:31:53.994 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:32:00.095 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:32:00.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:00.096 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-22T06:32:00.131 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.280+0000 7f4d767f4640 1 Processor -- start 2024-04-22T06:32:00.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.280+0000 7f4d767f4640 1 -- start start 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d767f4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4d700cb440 0x7f4d700caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d767f4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d7015cdd0 0x7f4d700cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d767f4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700c9bb0 con 0x7f4d700c9fa0 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d767f4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700c5a70 con 0x7f4d700cb440 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d767f4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700c5cc0 con 0x7f4d7015cdd0 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d6ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4d700cb440 0x7f4d700caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d6f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4d700c9fa0 0x7f4d7015c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45470/0 (socket says 172.21.15.113:45470) 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d6f7fe640 1 -- 172.21.15.113:0/2467053452 learned_addr learned my addr 172.21.15.113:0/2467053452 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d74d91640 1 --2- 172.21.15.113:0/2467053452 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d7015cdd0 0x7f4d700cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d6effd640 1 -- 172.21.15.113:0/2467053452 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1042100585 0 0) 0x7f4d700c9bb0 con 0x7f4d700c9fa0 2024-04-22T06:32:00.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.281+0000 7f4d6effd640 1 -- 172.21.15.113:0/2467053452 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d58003520 con 0x7f4d700c9fa0 2024-04-22T06:32:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.282+0000 7f4d6ffff640 1 -- 172.21.15.113:0/2467053452 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d7015cdd0 msgr2=0x7f4d700cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.282+0000 7f4d6ffff640 1 --2- 172.21.15.113:0/2467053452 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d7015cdd0 0x7f4d700cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.282+0000 7f4d6ffff640 1 -- 172.21.15.113:0/2467053452 >> v1:172.21.15.113:6789/0 conn(0x7f4d700c9fa0 legacy=0x7f4d7015c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.282+0000 7f4d6ffff640 1 -- 172.21.15.113:0/2467053452 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d700c5fa0 con 0x7f4d700cb440 2024-04-22T06:32:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.282+0000 7f4d6ffff640 1 --2- 172.21.15.113:0/2467053452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700cb440 0x7f4d700caa30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097a0 tx=0x7f4d6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3e6b7e590f2c8b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.282+0000 7f4d6effd640 1 -- 172.21.15.113:0/2467053452 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60035020 con 0x7f4d700cb440 2024-04-22T06:32:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.282+0000 7f4d6effd640 1 -- 172.21.15.113:0/2467053452 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60031830 con 0x7f4d700cb440 2024-04-22T06:32:00.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.282+0000 7f4d6effd640 1 -- 172.21.15.113:0/2467053452 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60031c00 con 0x7f4d700cb440 2024-04-22T06:32:00.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.283+0000 7f4d767f4640 1 -- 172.21.15.113:0/2467053452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700cb440 msgr2=0x7f4d700caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.283+0000 7f4d767f4640 1 --2- 172.21.15.113:0/2467053452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700cb440 0x7f4d700caa30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097a0 tx=0x7f4d6002b8d0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.283+0000 7f4d767f4640 1 -- 172.21.15.113:0/2467053452 shutdown_connections 2024-04-22T06:32:00.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.283+0000 7f4d767f4640 1 --2- 172.21.15.113:0/2467053452 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d7015cdd0 0x7f4d700cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.283+0000 7f4d767f4640 1 --2- 172.21.15.113:0/2467053452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700cb440 0x7f4d700caa30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.283+0000 7f4d767f4640 1 -- 172.21.15.113:0/2467053452 >> 172.21.15.113:0/2467053452 conn(0x7f4d70074f30 msgr2=0x7f4d70075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.283+0000 7f4d767f4640 1 -- 172.21.15.113:0/2467053452 shutdown_connections 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.283+0000 7f4d767f4640 1 -- 172.21.15.113:0/2467053452 wait complete. 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.284+0000 7f4d767f4640 1 Processor -- start 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.284+0000 7f4d767f4640 1 -- start start 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d767f4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700c9fa0 0x7f4d7015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d767f4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d700cb440 0x7f4d70146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d767f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d7015cdd0 0x7f4d700cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d767f4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700c9850 con 0x7f4d700c9fa0 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d767f4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700ca720 con 0x7f4d7015cdd0 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d767f4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4d70153360 con 0x7f4d700cb440 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d6ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700c9fa0 0x7f4d7015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d6ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700c9fa0 0x7f4d7015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33670/0 (socket says 172.21.15.113:33670) 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d6ffff640 1 -- 172.21.15.113:0/389965183 learned_addr learned my addr 172.21.15.113:0/389965183 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d6f7fe640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d700cb440 0x7f4d70146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.285+0000 7f4d74d91640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d7015cdd0 0x7f4d700cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6ffff640 1 -- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d700cb440 msgr2=0x7f4d70146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6ffff640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d700cb440 0x7f4d70146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6ffff640 1 -- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d7015cdd0 msgr2=0x7f4d700cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6ffff640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d7015cdd0 0x7f4d700cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6ffff640 1 -- 172.21.15.113:0/389965183 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d701ee690 con 0x7f4d700c9fa0 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d74d91640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d7015cdd0 0x7f4d700cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6ffff640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700c9fa0 0x7f4d7015b3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d600098c0 tx=0x7f4d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6cff9640 1 -- 172.21.15.113:0/389965183 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60035040 con 0x7f4d700c9fa0 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6cff9640 1 -- 172.21.15.113:0/389965183 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6003b860 con 0x7f4d700c9fa0 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d701ee930 con 0x7f4d700c9fa0 2024-04-22T06:32:00.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d6cff9640 1 -- 172.21.15.113:0/389965183 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6003bc50 con 0x7f4d700c9fa0 2024-04-22T06:32:00.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.286+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d700cc850 con 0x7f4d700c9fa0 2024-04-22T06:32:00.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.287+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d70068e40 con 0x7f4d700c9fa0 2024-04-22T06:32:00.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.287+0000 7f4d6cff9640 1 -- 172.21.15.113:0/389965183 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d60038020 con 0x7f4d700c9fa0 2024-04-22T06:32:00.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.288+0000 7f4d6cff9640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4d5c06c8f0 0x7f4d5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.288+0000 7f4d6cff9640 1 -- 172.21.15.113:0/389965183 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4d600ade90 con 0x7f4d700c9fa0 2024-04-22T06:32:00.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.288+0000 7f4d6f7fe640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4d5c06c8f0 0x7f4d5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.288+0000 7f4d6f7fe640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4d5c06c8f0 0x7f4d5c06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d700cd710 tx=0x7f4d64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.292+0000 7f4d6cff9640 1 -- 172.21.15.113:0/389965183 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d6007bf90 con 0x7f4d700c9fa0 2024-04-22T06:32:00.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.468+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d70069490 con 0x7f4d700c9fa0 2024-04-22T06:32:00.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.469+0000 7f4d6cff9640 1 -- 172.21.15.113:0/389965183 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f4d6007b890 con 0x7f4d700c9fa0 2024-04-22T06:32:00.469 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:00.469 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:00.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4d5c06c8f0 msgr2=0x7f4d5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4d5c06c8f0 0x7f4d5c06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d700cd710 tx=0x7f4d64009040 comp rx=0 tx=0).stop 2024-04-22T06:32:00.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700c9fa0 msgr2=0x7f4d7015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700c9fa0 0x7f4d7015b3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d600098c0 tx=0x7f4d600046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 shutdown_connections 2024-04-22T06:32:00.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d7015cdd0 0x7f4d700cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d700cb440 0x7f4d70146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4d5c06c8f0 0x7f4d5c06edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 --2- 172.21.15.113:0/389965183 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d700c9fa0 0x7f4d7015b3f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 >> 172.21.15.113:0/389965183 conn(0x7f4d70074f30 msgr2=0x7f4d70152560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:00.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 shutdown_connections 2024-04-22T06:32:00.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.472+0000 7f4d767f4640 1 -- 172.21.15.113:0/389965183 wait complete. 2024-04-22T06:32:00.482 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.579+0000 7f82abca5640 1 Processor -- start 2024-04-22T06:32:00.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.579+0000 7f82abca5640 1 -- start start 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82abca5640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f82a4155550 0x7f82a415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82abca5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f82a40cb9e0 0x7f82a40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82abca5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a40ccf00 con 0x7f82a4155170 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82abca5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f82a40cddf0 con 0x7f82a40cb9e0 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82abca5640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f82a415f430 con 0x7f82a4155550 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82aa242640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f82a40cb9e0 0x7f82a40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82aa242640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f82a40cb9e0 0x7f82a40c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33684/0 (socket says 172.21.15.113:33684) 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82a9a41640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f82a4155170 0x7f82a40d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45486/0 (socket says 172.21.15.113:45486) 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82aa242640 1 -- 172.21.15.113:0/949156400 learned_addr learned my addr 172.21.15.113:0/949156400 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.580+0000 7f82a9240640 1 --2- 172.21.15.113:0/949156400 >> v2:172.21.15.145:3300/0 conn(0x7f82a4155550 0x7f82a415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.581+0000 7f82aa242640 1 -- 172.21.15.113:0/949156400 >> v2:172.21.15.145:3300/0 conn(0x7f82a4155550 msgr2=0x7f82a415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.581+0000 7f82aa242640 1 --2- 172.21.15.113:0/949156400 >> v2:172.21.15.145:3300/0 conn(0x7f82a4155550 0x7f82a415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.581+0000 7f82aa242640 1 -- 172.21.15.113:0/949156400 >> v1:172.21.15.113:6789/0 conn(0x7f82a4155170 legacy=0x7f82a40d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.581+0000 7f82a8a3f640 1 -- 172.21.15.113:0/949156400 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141714822 0 0) 0x7f82a40ccf00 con 0x7f82a4155170 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.581+0000 7f82aa242640 1 -- 172.21.15.113:0/949156400 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a40cd1e0 con 0x7f82a40cb9e0 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.581+0000 7f82aa242640 1 --2- 172.21.15.113:0/949156400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a40cb9e0 0x7f82a40c5810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f829c009870 tx=0x7f829c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a780d4416f3b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82a8a3f640 1 -- 172.21.15.113:0/949156400 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c034070 con 0x7f82a40cb9e0 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82a8a3f640 1 -- 172.21.15.113:0/949156400 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c030860 con 0x7f82a40cb9e0 2024-04-22T06:32:00.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82a8a3f640 1 -- 172.21.15.113:0/949156400 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c030c30 con 0x7f82a40cb9e0 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82abca5640 1 -- 172.21.15.113:0/949156400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a40cb9e0 msgr2=0x7f82a40c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82abca5640 1 --2- 172.21.15.113:0/949156400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a40cb9e0 0x7f82a40c5810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f829c009870 tx=0x7f829c02b9a0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82abca5640 1 -- 172.21.15.113:0/949156400 shutdown_connections 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82abca5640 1 --2- 172.21.15.113:0/949156400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a40cb9e0 0x7f82a40c5810 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82abca5640 1 --2- 172.21.15.113:0/949156400 >> v2:172.21.15.145:3300/0 conn(0x7f82a4155550 0x7f82a415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82abca5640 1 -- 172.21.15.113:0/949156400 >> 172.21.15.113:0/949156400 conn(0x7f82a4072570 msgr2=0x7f82a4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82abca5640 1 -- 172.21.15.113:0/949156400 shutdown_connections 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.582+0000 7f82abca5640 1 -- 172.21.15.113:0/949156400 wait complete. 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.583+0000 7f82abca5640 1 Processor -- start 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.583+0000 7f82abca5640 1 -- start start 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82abca5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82a40cb9e0 0x7f82a415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82abca5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a4155170 0x7f82a41e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82abca5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82a4155550 0x7f82a41f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82abca5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f82a40cda80 con 0x7f82a4155170 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82abca5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f82a40cd7a0 con 0x7f82a4155550 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82abca5640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f82a40ccae0 con 0x7f82a40cb9e0 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9240640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a4155170 0x7f82a41e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9240640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a4155170 0x7f82a41e7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33686/0 (socket says 172.21.15.113:33686) 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9240640 1 -- 172.21.15.113:0/3607498767 learned_addr learned my addr 172.21.15.113:0/3607498767 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9a41640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82a40cb9e0 0x7f82a415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82aa242640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82a4155550 0x7f82a41f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9240640 1 -- 172.21.15.113:0/3607498767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82a40cb9e0 msgr2=0x7f82a415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9240640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82a40cb9e0 0x7f82a415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9240640 1 -- 172.21.15.113:0/3607498767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82a4155550 msgr2=0x7f82a41f0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9240640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82a4155550 0x7f82a41f0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.584+0000 7f82a9240640 1 -- 172.21.15.113:0/3607498767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a414eb10 con 0x7f82a4155170 2024-04-22T06:32:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.585+0000 7f82a9240640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a4155170 0x7f82a41e7420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f829400e870 tx=0x7f829400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.585+0000 7f829a7fc640 1 -- 172.21.15.113:0/3607498767 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294017070 con 0x7f82a4155170 2024-04-22T06:32:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.585+0000 7f829a7fc640 1 -- 172.21.15.113:0/3607498767 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829400c940 con 0x7f82a4155170 2024-04-22T06:32:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.585+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a414edb0 con 0x7f82a4155170 2024-04-22T06:32:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.585+0000 7f829a7fc640 1 -- 172.21.15.113:0/3607498767 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829400cd10 con 0x7f82a4155170 2024-04-22T06:32:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.585+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a41f4340 con 0x7f82a4155170 2024-04-22T06:32:00.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.586+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a4068e40 con 0x7f82a4155170 2024-04-22T06:32:00.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.586+0000 7f829a7fc640 1 -- 172.21.15.113:0/3607498767 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f829401a070 con 0x7f82a4155170 2024-04-22T06:32:00.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.586+0000 7f829a7fc640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f828806c8f0 0x7f828806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.587+0000 7f829a7fc640 1 -- 172.21.15.113:0/3607498767 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f829408c000 con 0x7f82a4155170 2024-04-22T06:32:00.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.587+0000 7f82a9a41640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f828806c8f0 0x7f828806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.587+0000 7f82a9a41640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f828806c8f0 0x7f828806edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82a00012e0 tx=0x7f82a0001700 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.591+0000 7f829a7fc640 1 -- 172.21.15.113:0/3607498767 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8294059aa0 con 0x7f82a4155170 2024-04-22T06:32:00.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.767+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82a40cc2b0 con 0x7f82a4155170 2024-04-22T06:32:00.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.769+0000 7f829a7fc640 1 -- 172.21.15.113:0/3607498767 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f829405dda0 con 0x7f82a4155170 2024-04-22T06:32:00.768 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:00.768 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f828806c8f0 msgr2=0x7f828806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f828806c8f0 0x7f828806edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82a00012e0 tx=0x7f82a0001700 comp rx=0 tx=0).stop 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a4155170 msgr2=0x7f82a41e7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a4155170 0x7f82a41e7420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f829400e870 tx=0x7f829400ed30 comp rx=0 tx=0).stop 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 shutdown_connections 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82a4155550 0x7f82a41f0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f828806c8f0 0x7f828806edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82a4155170 0x7f82a41e7420 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 --2- 172.21.15.113:0/3607498767 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f82a40cb9e0 0x7f82a415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 >> 172.21.15.113:0/3607498767 conn(0x7f82a4072570 msgr2=0x7f82a414ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 shutdown_connections 2024-04-22T06:32:00.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.771+0000 7f82abca5640 1 -- 172.21.15.113:0/3607498767 wait complete. 2024-04-22T06:32:00.781 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-22T06:32:00.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.883+0000 7f6f2f70e640 1 Processor -- start 2024-04-22T06:32:00.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.883+0000 7f6f2f70e640 1 -- start start 2024-04-22T06:32:00.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.884+0000 7f6f2f70e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6f280cb5c0 0x7f6f2806f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.884+0000 7f6f2f70e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb9a0 0x7f6f28154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.884+0000 7f6f2f70e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2806fd30 con 0x7f6f280cae40 2024-04-22T06:32:00.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.884+0000 7f6f2f70e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f6f280c9d90 con 0x7f6f280cb5c0 2024-04-22T06:32:00.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.884+0000 7f6f2f70e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6f280ca070 con 0x7f6f280cb9a0 2024-04-22T06:32:00.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.884+0000 7f6f2d4aa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6f280cb5c0 0x7f6f2806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.884+0000 7f6f2d4aa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6f280cb5c0 0x7f6f2806f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33696/0 (socket says 172.21.15.113:33696) 2024-04-22T06:32:00.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.884+0000 7f6f2d4aa640 1 -- 172.21.15.113:0/3628050998 learned_addr learned my addr 172.21.15.113:0/3628050998 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:00.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.885+0000 7f6f2dcab640 1 --2- 172.21.15.113:0/3628050998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb9a0 0x7f6f28154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.885+0000 7f6f2d4aa640 1 -- 172.21.15.113:0/3628050998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb9a0 msgr2=0x7f6f28154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:00.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.885+0000 7f6f2d4aa640 1 --2- 172.21.15.113:0/3628050998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb9a0 0x7f6f28154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.885+0000 7f6f2d4aa640 1 -- 172.21.15.113:0/3628050998 >> v1:172.21.15.145:6789/0 conn(0x7f6f280cae40 legacy=0x7f6f2815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.885+0000 7f6f2d4aa640 1 -- 172.21.15.113:0/3628050998 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280ca350 con 0x7f6f280cb5c0 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.885+0000 7f6f2d4aa640 1 --2- 172.21.15.113:0/3628050998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cb5c0 0x7f6f2806f380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f240098a0 tx=0x7f6f2402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e9f22f38900f60 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f1ffff640 1 -- 172.21.15.113:0/3628050998 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24034070 con 0x7f6f280cb5c0 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f1ffff640 1 -- 172.21.15.113:0/3628050998 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f24030840 con 0x7f6f280cb5c0 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f1ffff640 1 -- 172.21.15.113:0/3628050998 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24030c10 con 0x7f6f280cb5c0 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f2f70e640 1 -- 172.21.15.113:0/3628050998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cb5c0 msgr2=0x7f6f2806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/3628050998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cb5c0 0x7f6f2806f380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f240098a0 tx=0x7f6f2402b980 comp rx=0 tx=0).stop 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f2f70e640 1 -- 172.21.15.113:0/3628050998 shutdown_connections 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/3628050998 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb9a0 0x7f6f28154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/3628050998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cb5c0 0x7f6f2806f380 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f2f70e640 1 -- 172.21.15.113:0/3628050998 >> 172.21.15.113:0/3628050998 conn(0x7f6f28074d50 msgr2=0x7f6f28075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:00.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f2f70e640 1 -- 172.21.15.113:0/3628050998 shutdown_connections 2024-04-22T06:32:00.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.886+0000 7f6f2f70e640 1 -- 172.21.15.113:0/3628050998 wait complete. 2024-04-22T06:32:00.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.887+0000 7f6f2f70e640 1 Processor -- start 2024-04-22T06:32:00.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.887+0000 7f6f2f70e640 1 -- start start 2024-04-22T06:32:00.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2f70e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cae40 0x7f6f280cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2f70e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb5c0 0x7f6f28070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2f70e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f280cb9a0 0x7f6f28157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2f70e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2806c450 con 0x7f6f280cae40 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2f70e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280ca910 con 0x7f6f280cb9a0 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2f70e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2806c5d0 con 0x7f6f280cb5c0 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2d4aa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cae40 0x7f6f280cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2d4aa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cae40 0x7f6f280cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33706/0 (socket says 172.21.15.113:33706) 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2d4aa640 1 -- 172.21.15.113:0/1869701664 learned_addr learned my addr 172.21.15.113:0/1869701664 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2dcab640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f280cb9a0 0x7f6f28157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2cca9640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb5c0 0x7f6f28070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2d4aa640 1 -- 172.21.15.113:0/1869701664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb5c0 msgr2=0x7f6f28070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2d4aa640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb5c0 0x7f6f28070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2d4aa640 1 -- 172.21.15.113:0/1869701664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f280cb9a0 msgr2=0x7f6f28157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2d4aa640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f280cb9a0 0x7f6f28157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:00.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.888+0000 7f6f2d4aa640 1 -- 172.21.15.113:0/1869701664 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280ce020 con 0x7f6f280cae40 2024-04-22T06:32:00.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.889+0000 7f6f2d4aa640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cae40 0x7f6f280cc6c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f24000c00 tx=0x7f6f24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.891+0000 7f6f1dffb640 1 -- 172.21.15.113:0/1869701664 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24048070 con 0x7f6f280cae40 2024-04-22T06:32:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.891+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2815c270 con 0x7f6f280cae40 2024-04-22T06:32:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.891+0000 7f6f1dffb640 1 -- 172.21.15.113:0/1869701664 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f24030640 con 0x7f6f280cae40 2024-04-22T06:32:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.891+0000 7f6f1dffb640 1 -- 172.21.15.113:0/1869701664 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24034040 con 0x7f6f280cae40 2024-04-22T06:32:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.891+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f281561f0 con 0x7f6f280cae40 2024-04-22T06:32:00.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.893+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f28068f50 con 0x7f6f280cae40 2024-04-22T06:32:00.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.893+0000 7f6f1dffb640 1 -- 172.21.15.113:0/1869701664 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f24037070 con 0x7f6f280cae40 2024-04-22T06:32:00.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.893+0000 7f6f1dffb640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6f0c06c8f0 0x7f6f0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:00.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.893+0000 7f6f1dffb640 1 -- 172.21.15.113:0/1869701664 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6f240add40 con 0x7f6f280cae40 2024-04-22T06:32:00.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.893+0000 7f6f2cca9640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6f0c06c8f0 0x7f6f0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:00.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.894+0000 7f6f2cca9640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6f0c06c8f0 0x7f6f0c06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f28159990 tx=0x7f6f18009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:00.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:00.898+0000 7f6f1dffb640 1 -- 172.21.15.113:0/1869701664 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f2407b7f0 con 0x7f6f280cae40 2024-04-22T06:32:01.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.110+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6f280c58d0 con 0x7f6f280cae40 2024-04-22T06:32:01.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.893+0000 7f6f1dffb640 1 -- 172.21.15.113:0/1869701664 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f6f2407faf0 con 0x7f6f280cae40 2024-04-22T06:32:01.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6f0c06c8f0 msgr2=0x7f6f0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6f0c06c8f0 0x7f6f0c06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f28159990 tx=0x7f6f18009040 comp rx=0 tx=0).stop 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cae40 msgr2=0x7f6f280cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cae40 0x7f6f280cc6c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f24000c00 tx=0x7f6f24004730 comp rx=0 tx=0).stop 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 shutdown_connections 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f280cb9a0 0x7f6f28157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6f280cb5c0 0x7f6f28070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6f0c06c8f0 0x7f6f0c06edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 --2- 172.21.15.113:0/1869701664 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6f280cae40 0x7f6f280cc6c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 >> 172.21.15.113:0/1869701664 conn(0x7f6f28074d50 msgr2=0x7f6f2815b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 shutdown_connections 2024-04-22T06:32:01.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:01.896+0000 7f6f2f70e640 1 -- 172.21.15.113:0/1869701664 wait complete. 2024-04-22T06:32:01.907 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-22T06:32:01.907 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-22T06:32:02.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.008+0000 7f179ad3d640 1 Processor -- start 2024-04-22T06:32:02.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.008+0000 7f179ad3d640 1 -- start start 2024-04-22T06:32:02.009 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f179ad3d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f1794073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.009 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f179ad3d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f17940cc710 0x7f1794073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.009 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f179ad3d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f179415be60 con 0x7f17940b3600 2024-04-22T06:32:02.009 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f179ad3d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f179415e650 con 0x7f17940cc710 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f179ad3d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f179415e930 con 0x7f1794154f00 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f178bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f17940b3600 0x7f17940cc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45500/0 (socket says 172.21.15.113:45500) 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f178bfff640 1 -- 172.21.15.113:0/1061957415 learned_addr learned my addr 172.21.15.113:0/1061957415 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f17992da640 1 --2- 172.21.15.113:0/1061957415 >> v2:172.21.15.145:3300/0 conn(0x7f17940cc710 0x7f1794073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f1798ad9640 1 --2- 172.21.15.113:0/1061957415 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f1794073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f178b7fe640 1 -- 172.21.15.113:0/1061957415 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435041165 0 0) 0x7f179415be60 con 0x7f17940b3600 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f178b7fe640 1 -- 172.21.15.113:0/1061957415 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f177c003520 con 0x7f17940b3600 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f17992da640 1 -- 172.21.15.113:0/1061957415 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 msgr2=0x7f1794073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f17992da640 1 --2- 172.21.15.113:0/1061957415 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f1794073110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f17992da640 1 -- 172.21.15.113:0/1061957415 >> v1:172.21.15.113:6789/0 conn(0x7f17940b3600 legacy=0x7f17940cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.009+0000 7f17992da640 1 -- 172.21.15.113:0/1061957415 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179415ec10 con 0x7f17940cc710 2024-04-22T06:32:02.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.010+0000 7f17992da640 1 --2- 172.21.15.113:0/1061957415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940cc710 0x7f1794073650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f178c009d90 tx=0x7f178c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d9181fd61b6750 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:02.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.010+0000 7f178b7fe640 1 -- 172.21.15.113:0/1061957415 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c039070 con 0x7f17940cc710 2024-04-22T06:32:02.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.010+0000 7f178b7fe640 1 -- 172.21.15.113:0/1061957415 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178c02cc50 con 0x7f17940cc710 2024-04-22T06:32:02.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.010+0000 7f178b7fe640 1 -- 172.21.15.113:0/1061957415 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c034440 con 0x7f17940cc710 2024-04-22T06:32:02.013 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.011+0000 7f179ad3d640 1 -- 172.21.15.113:0/1061957415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940cc710 msgr2=0x7f1794073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.013 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.011+0000 7f179ad3d640 1 --2- 172.21.15.113:0/1061957415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940cc710 0x7f1794073650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f178c009d90 tx=0x7f178c02bea0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.011+0000 7f179ad3d640 1 -- 172.21.15.113:0/1061957415 shutdown_connections 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.011+0000 7f179ad3d640 1 --2- 172.21.15.113:0/1061957415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940cc710 0x7f1794073650 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.011+0000 7f179ad3d640 1 --2- 172.21.15.113:0/1061957415 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f1794073110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.011+0000 7f179ad3d640 1 -- 172.21.15.113:0/1061957415 >> 172.21.15.113:0/1061957415 conn(0x7f1794068570 msgr2=0x7f1794071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.011+0000 7f179ad3d640 1 -- 172.21.15.113:0/1061957415 shutdown_connections 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.011+0000 7f179ad3d640 1 -- 172.21.15.113:0/1061957415 wait complete. 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.012+0000 7f179ad3d640 1 Processor -- start 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.012+0000 7f179ad3d640 1 -- start start 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f179ad3d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940b3600 0x7f179414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f179ad3d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17940cc710 0x7f17941f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f179ad3d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f17941f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f179ad3d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f17941552e0 con 0x7f17940cc710 2024-04-22T06:32:02.014 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f179ad3d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f17940cb230 con 0x7f17940b3600 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f179ad3d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f17941f11b0 con 0x7f1794154f00 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17940cc710 0x7f17941f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17940cc710 0x7f17941f1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33710/0 (socket says 172.21.15.113:33710) 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 -- 172.21.15.113:0/2496291666 learned_addr learned my addr 172.21.15.113:0/2496291666 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f1798ad9640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940b3600 0x7f179414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f17992da640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f17941f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 -- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 msgr2=0x7f17941f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f17941f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 -- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940b3600 msgr2=0x7f179414a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940b3600 0x7f179414a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 -- 172.21.15.113:0/2496291666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179415c180 con 0x7f17940cc710 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f1798ad9640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940b3600 0x7f179414a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f17992da640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f17941f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:02.015 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f178bfff640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17940cc710 0x7f17941f1640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f178400c3c0 tx=0x7f178400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:02.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f17897fa640 1 -- 172.21.15.113:0/2496291666 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784017070 con 0x7f17940cc710 2024-04-22T06:32:02.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f17897fa640 1 -- 172.21.15.113:0/2496291666 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1784005ce0 con 0x7f17940cc710 2024-04-22T06:32:02.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17941f0e60 con 0x7f17940cc710 2024-04-22T06:32:02.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f17897fa640 1 -- 172.21.15.113:0/2496291666 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840072f0 con 0x7f17940cc710 2024-04-22T06:32:02.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.013+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179415dc00 con 0x7f17940cc710 2024-04-22T06:32:02.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.014+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1794069310 con 0x7f17940cc710 2024-04-22T06:32:02.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.015+0000 7f17897fa640 1 -- 172.21.15.113:0/2496291666 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f178401a070 con 0x7f17940cc710 2024-04-22T06:32:02.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.015+0000 7f17897fa640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f178006c8f0 0x7f178006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.015+0000 7f17897fa640 1 -- 172.21.15.113:0/2496291666 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f178408b2a0 con 0x7f17940cc710 2024-04-22T06:32:02.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.015+0000 7f1798ad9640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f178006c8f0 0x7f178006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.016+0000 7f1798ad9640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f178006c8f0 0x7f178006edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1790009ac0 tx=0x7f1790008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:02.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.019+0000 7f17897fa640 1 -- 172.21.15.113:0/2496291666 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1794069310 con 0x7f17940cc710 2024-04-22T06:32:02.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.231+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f17941538b0 con 0x7f17940cc710 2024-04-22T06:32:02.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.698+0000 7f17897fa640 1 -- 172.21.15.113:0/2496291666 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f17941538b0 con 0x7f17940cc710 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f178006c8f0 msgr2=0x7f178006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f178006c8f0 0x7f178006edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1790009ac0 tx=0x7f1790008040 comp rx=0 tx=0).stop 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17940cc710 msgr2=0x7f17941f1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17940cc710 0x7f17941f1640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f178400c3c0 tx=0x7f178400c880 comp rx=0 tx=0).stop 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 shutdown_connections 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1794154f00 0x7f17941f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f178006c8f0 0x7f178006edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17940cc710 0x7f17941f1640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 --2- 172.21.15.113:0/2496291666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f17940b3600 0x7f179414a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 >> 172.21.15.113:0/2496291666 conn(0x7f1794068570 msgr2=0x7f1794153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 shutdown_connections 2024-04-22T06:32:02.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.701+0000 7f179ad3d640 1 -- 172.21.15.113:0/2496291666 wait complete. 2024-04-22T06:32:02.713 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-22T06:32:02.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.815+0000 7f6adacfd640 1 Processor -- start 2024-04-22T06:32:02.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.815+0000 7f6adacfd640 1 -- start start 2024-04-22T06:32:02.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6adacfd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6ad40743f0 0x7f6ad40ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6adacfd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad415f270 0x7f6ad40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6adacfd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad4073bd0 con 0x7f6ad4155230 2024-04-22T06:32:02.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6adacfd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad40caee0 con 0x7f6ad40743f0 2024-04-22T06:32:02.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6adacfd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad415ede0 con 0x7f6ad415f270 2024-04-22T06:32:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6ad3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6ad40743f0 0x7f6ad40ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6ad929a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad415f270 0x7f6ad40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6ad8a99640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f6ad4155230 0x7f6ad40c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:40876/0 (socket says 172.21.15.113:40876) 2024-04-22T06:32:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.816+0000 7f6ad8a99640 1 -- 172.21.15.113:0/298059042 learned_addr learned my addr 172.21.15.113:0/298059042 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.817+0000 7f6ad37fe640 1 -- 172.21.15.113:0/298059042 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567040987 0 0) 0x7f6ad4073bd0 con 0x7f6ad4155230 2024-04-22T06:32:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.817+0000 7f6ad37fe640 1 -- 172.21.15.113:0/298059042 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6abc003520 con 0x7f6ad4155230 2024-04-22T06:32:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.817+0000 7f6ad929a640 1 -- 172.21.15.113:0/298059042 >> v2:172.21.15.145:3300/0 conn(0x7f6ad40743f0 msgr2=0x7f6ad40ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.817+0000 7f6ad929a640 1 --2- 172.21.15.113:0/298059042 >> v2:172.21.15.145:3300/0 conn(0x7f6ad40743f0 0x7f6ad40ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.817+0000 7f6ad929a640 1 -- 172.21.15.113:0/298059042 >> v1:172.21.15.145:6789/0 conn(0x7f6ad4155230 legacy=0x7f6ad40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.817+0000 7f6ad929a640 1 -- 172.21.15.113:0/298059042 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad4073eb0 con 0x7f6ad415f270 2024-04-22T06:32:02.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.817+0000 7f6ad3fff640 1 --2- 172.21.15.113:0/298059042 >> v2:172.21.15.145:3300/0 conn(0x7f6ad40743f0 0x7f6ad40ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:02.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.817+0000 7f6ad929a640 1 --2- 172.21.15.113:0/298059042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad415f270 0x7f6ad40ce8b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009d90 tx=0x7f6acc02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b89297645df14a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:02.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6ad37fe640 1 -- 172.21.15.113:0/298059042 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc039070 con 0x7f6ad415f270 2024-04-22T06:32:02.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6ad37fe640 1 -- 172.21.15.113:0/298059042 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc02cce0 con 0x7f6ad415f270 2024-04-22T06:32:02.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6ad37fe640 1 -- 172.21.15.113:0/298059042 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc034660 con 0x7f6ad415f270 2024-04-22T06:32:02.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6adacfd640 1 -- 172.21.15.113:0/298059042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad415f270 msgr2=0x7f6ad40ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6adacfd640 1 --2- 172.21.15.113:0/298059042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad415f270 0x7f6ad40ce8b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009d90 tx=0x7f6acc02bf30 comp rx=0 tx=0).stop 2024-04-22T06:32:02.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6adacfd640 1 -- 172.21.15.113:0/298059042 shutdown_connections 2024-04-22T06:32:02.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6adacfd640 1 --2- 172.21.15.113:0/298059042 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad415f270 0x7f6ad40ce8b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6adacfd640 1 --2- 172.21.15.113:0/298059042 >> v2:172.21.15.145:3300/0 conn(0x7f6ad40743f0 0x7f6ad40ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6adacfd640 1 -- 172.21.15.113:0/298059042 >> 172.21.15.113:0/298059042 conn(0x7f6ad4068570 msgr2=0x7f6ad4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:02.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6adacfd640 1 -- 172.21.15.113:0/298059042 shutdown_connections 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.818+0000 7f6adacfd640 1 -- 172.21.15.113:0/298059042 wait complete. 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.819+0000 7f6adacfd640 1 Processor -- start 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.819+0000 7f6adacfd640 1 -- start start 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6adacfd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ad40743f0 0x7f6ad414c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6adacfd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad4155230 0x7f6ad41592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6adacfd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ad415f270 0x7f6ad415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6adacfd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad4155610 con 0x7f6ad40743f0 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6adacfd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad415ea70 con 0x7f6ad415f270 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6adacfd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad4155790 con 0x7f6ad4155230 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6ad8a99640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ad40743f0 0x7f6ad414c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6ad8a99640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ad40743f0 0x7f6ad414c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33712/0 (socket says 172.21.15.113:33712) 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6ad8a99640 1 -- 172.21.15.113:0/2567218546 learned_addr learned my addr 172.21.15.113:0/2567218546 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.820+0000 7f6ad929a640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ad415f270 0x7f6ad415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad3fff640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad4155230 0x7f6ad41592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad8a99640 1 -- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad4155230 msgr2=0x7f6ad41592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad8a99640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad4155230 0x7f6ad41592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad8a99640 1 -- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ad415f270 msgr2=0x7f6ad415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad8a99640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ad415f270 0x7f6ad415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad8a99640 1 -- 172.21.15.113:0/2567218546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad41f0890 con 0x7f6ad40743f0 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad3fff640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad4155230 0x7f6ad41592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad8a99640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ad40743f0 0x7f6ad414c0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400c430 tx=0x7f6ac400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad17fa640 1 -- 172.21.15.113:0/2567218546 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4017070 con 0x7f6ad40743f0 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad17fa640 1 -- 172.21.15.113:0/2567218546 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4005ce0 con 0x7f6ad40743f0 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6ad17fa640 1 -- 172.21.15.113:0/2567218546 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40072f0 con 0x7f6ad40743f0 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad4157e70 con 0x7f6ad40743f0 2024-04-22T06:32:02.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.821+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad41f0df0 con 0x7f6ad40743f0 2024-04-22T06:32:02.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.822+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad4153570 con 0x7f6ad40743f0 2024-04-22T06:32:02.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.822+0000 7f6ad17fa640 1 -- 172.21.15.113:0/2567218546 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ac401a070 con 0x7f6ad40743f0 2024-04-22T06:32:02.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.823+0000 7f6ad17fa640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6ac006c920 0x7f6ac006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:02.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.823+0000 7f6ad17fa640 1 -- 172.21.15.113:0/2567218546 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6ac408b320 con 0x7f6ad40743f0 2024-04-22T06:32:02.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.823+0000 7f6ad3fff640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6ac006c920 0x7f6ac006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:02.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.823+0000 7f6ad3fff640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6ac006c920 0x7f6ac006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4158090 tx=0x7f6ac8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:02.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:02.827+0000 7f6ad17fa640 1 -- 172.21.15.113:0/2567218546 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ad41f0890 con 0x7f6ad40743f0 2024-04-22T06:32:03.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.041+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6ad4153290 con 0x7f6ad40743f0 2024-04-22T06:32:03.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.901+0000 7f6ad17fa640 1 -- 172.21.15.113:0/2567218546 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f6ac4059410 con 0x7f6ad40743f0 2024-04-22T06:32:03.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6ac006c920 msgr2=0x7f6ac006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:03.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6ac006c920 0x7f6ac006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4158090 tx=0x7f6ac8008040 comp rx=0 tx=0).stop 2024-04-22T06:32:03.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ad40743f0 msgr2=0x7f6ad414c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:03.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ad40743f0 0x7f6ad414c0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400c430 tx=0x7f6ac400c8f0 comp rx=0 tx=0).stop 2024-04-22T06:32:03.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 shutdown_connections 2024-04-22T06:32:03.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6ad415f270 0x7f6ad415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:03.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6ad4155230 0x7f6ad41592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:03.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6ac006c920 0x7f6ac006ede0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:03.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 --2- 172.21.15.113:0/2567218546 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ad40743f0 0x7f6ad414c0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:03.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.903+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 >> 172.21.15.113:0/2567218546 conn(0x7f6ad4068570 msgr2=0x7f6ad4152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:03.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.904+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 shutdown_connections 2024-04-22T06:32:03.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:03.904+0000 7f6adacfd640 1 -- 172.21.15.113:0/2567218546 wait complete. 2024-04-22T06:32:03.915 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-22T06:32:04.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.018+0000 7f315a626640 1 Processor -- start 2024-04-22T06:32:04.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.018+0000 7f315a626640 1 -- start start 2024-04-22T06:32:04.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.019+0000 7f315a626640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f315415f020 0x7f31540cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:04.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.019+0000 7f315a626640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31540ce480 con 0x7f315415b210 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.019+0000 7f315a626640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3154144790 con 0x7f31541443b0 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.019+0000 7f315a626640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f31540ce230 con 0x7f315415f020 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.019+0000 7f31537fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f315415f020 0x7f31540cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.019+0000 7f3158bc3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f315415b210 0x7f315415b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45510/0 (socket says 172.21.15.113:45510) 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.019+0000 7f3158bc3640 1 -- 172.21.15.113:0/2488994265 learned_addr learned my addr 172.21.15.113:0/2488994265 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.020+0000 7f31537fe640 1 -- 172.21.15.113:0/2488994265 >> v1:172.21.15.145:6789/0 conn(0x7f31541443b0 legacy=0x7f31540c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.020+0000 7f31537fe640 1 -- 172.21.15.113:0/2488994265 >> v1:172.21.15.113:6789/0 conn(0x7f315415b210 legacy=0x7f315415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.020+0000 7f31537fe640 1 -- 172.21.15.113:0/2488994265 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31540723d0 con 0x7f315415f020 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.020+0000 7f3152ffd640 1 -- 172.21.15.113:0/2488994265 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013518674 0 0) 0x7f31540ce480 con 0x7f315415b210 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.020+0000 7f31537fe640 1 --2- 172.21.15.113:0/2488994265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415f020 0x7f31540cdcf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31540ce3b0 tx=0x7f314802b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f4d3eb6f398747 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.020+0000 7f3152ffd640 1 -- 172.21.15.113:0/2488994265 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148034070 con 0x7f315415f020 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.020+0000 7f3152ffd640 1 -- 172.21.15.113:0/2488994265 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3148030890 con 0x7f315415f020 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.020+0000 7f3152ffd640 1 -- 172.21.15.113:0/2488994265 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148030c60 con 0x7f315415f020 2024-04-22T06:32:04.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.021+0000 7f315a626640 1 -- 172.21.15.113:0/2488994265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415f020 msgr2=0x7f31540cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:04.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.021+0000 7f315a626640 1 --2- 172.21.15.113:0/2488994265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415f020 0x7f31540cdcf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31540ce3b0 tx=0x7f314802b9d0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.021+0000 7f315a626640 1 -- 172.21.15.113:0/2488994265 shutdown_connections 2024-04-22T06:32:04.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.021+0000 7f315a626640 1 --2- 172.21.15.113:0/2488994265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415f020 0x7f31540cdcf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.021+0000 7f315a626640 1 -- 172.21.15.113:0/2488994265 >> 172.21.15.113:0/2488994265 conn(0x7f315406b920 msgr2=0x7f315406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:04.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.021+0000 7f315a626640 1 -- 172.21.15.113:0/2488994265 shutdown_connections 2024-04-22T06:32:04.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.021+0000 7f315a626640 1 -- 172.21.15.113:0/2488994265 wait complete. 2024-04-22T06:32:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.022+0000 7f315a626640 1 Processor -- start 2024-04-22T06:32:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.022+0000 7f315a626640 1 -- start start 2024-04-22T06:32:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f315a626640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31541443b0 0x7f31541f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f315a626640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415b210 0x7f3154157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f315a626640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315415f020 0x7f31540c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f315a626640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3154072c70 con 0x7f315415b210 2024-04-22T06:32:04.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f315a626640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3154072990 con 0x7f315415f020 2024-04-22T06:32:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f315a626640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f315415f490 con 0x7f31541443b0 2024-04-22T06:32:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f31537fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415b210 0x7f3154157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f31537fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415b210 0x7f3154157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33716/0 (socket says 172.21.15.113:33716) 2024-04-22T06:32:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f31537fe640 1 -- 172.21.15.113:0/457059858 learned_addr learned my addr 172.21.15.113:0/457059858 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f3158bc3640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315415f020 0x7f31540c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f3153fff640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31541443b0 0x7f31541f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:04.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f31537fe640 1 -- 172.21.15.113:0/457059858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31541443b0 msgr2=0x7f31541f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f31537fe640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31541443b0 0x7f31541f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f31537fe640 1 -- 172.21.15.113:0/457059858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315415f020 msgr2=0x7f31540c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f31537fe640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315415f020 0x7f31540c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.023+0000 7f31537fe640 1 -- 172.21.15.113:0/457059858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3154155b20 con 0x7f315415b210 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.024+0000 7f31537fe640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415b210 0x7f3154157130 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f314802bfe0 tx=0x7f31480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.024+0000 7f3150ff9640 1 -- 172.21.15.113:0/457059858 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148047070 con 0x7f315415b210 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.024+0000 7f3150ff9640 1 -- 172.21.15.113:0/457059858 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31480306d0 con 0x7f315415b210 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.024+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3154155dc0 con 0x7f315415b210 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.024+0000 7f3150ff9640 1 -- 172.21.15.113:0/457059858 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148034040 con 0x7f315415b210 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.024+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541f0b20 con 0x7f315415b210 2024-04-22T06:32:04.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.025+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3154068f50 con 0x7f315415b210 2024-04-22T06:32:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.025+0000 7f3150ff9640 1 -- 172.21.15.113:0/457059858 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f314804a070 con 0x7f315415b210 2024-04-22T06:32:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.025+0000 7f3150ff9640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f314006c8f0 0x7f314006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.026+0000 7f3150ff9640 1 -- 172.21.15.113:0/457059858 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f31480addb0 con 0x7f315415b210 2024-04-22T06:32:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.026+0000 7f3153fff640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f314006c8f0 0x7f314006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:04.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.026+0000 7f3153fff640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f314006c8f0 0x7f314006edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3144000f60 tx=0x7f3144009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:04.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.030+0000 7f3150ff9640 1 -- 172.21.15.113:0/457059858 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f314807b8e0 con 0x7f315415b210 2024-04-22T06:32:04.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.242+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f31540cb630 con 0x7f315415b210 2024-04-22T06:32:04.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.902+0000 7f3150ff9640 1 -- 172.21.15.113:0/457059858 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f314807fbe0 con 0x7f315415b210 2024-04-22T06:32:04.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.905+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f314006c8f0 msgr2=0x7f314006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:04.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.905+0000 7f315a626640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f314006c8f0 0x7f314006edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3144000f60 tx=0x7f3144009040 comp rx=0 tx=0).stop 2024-04-22T06:32:04.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.905+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415b210 msgr2=0x7f3154157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:04.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.905+0000 7f315a626640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415b210 0x7f3154157130 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f314802bfe0 tx=0x7f31480046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.906+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 shutdown_connections 2024-04-22T06:32:04.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.906+0000 7f315a626640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f315415f020 0x7f31540c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.906+0000 7f315a626640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f314006c8f0 0x7f314006edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.906+0000 7f315a626640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f315415b210 0x7f3154157130 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.906+0000 7f315a626640 1 --2- 172.21.15.113:0/457059858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f31541443b0 0x7f31541f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:04.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.906+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 >> 172.21.15.113:0/457059858 conn(0x7f315406b920 msgr2=0x7f315415b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:04.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.906+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 shutdown_connections 2024-04-22T06:32:04.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:04.906+0000 7f315a626640 1 -- 172.21.15.113:0/457059858 wait complete. 2024-04-22T06:32:04.918 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-22T06:32:04.921 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:32:05.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.022+0000 7fefbac32640 1 Processor -- start 2024-04-22T06:32:05.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.022+0000 7fefbac32640 1 -- start start 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.022+0000 7fefbac32640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fefb40ca940 0x7fefb40ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.022+0000 7fefbac32640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fefb40ceb40 0x7fefb415c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.022+0000 7fefbac32640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb40c7690 con 0x7fefb4153130 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.022+0000 7fefbac32640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fefb4159c20 con 0x7fefb40ceb40 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.022+0000 7fefbac32640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fefb4158d50 con 0x7fefb40ca940 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb91cf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fefb40ceb40 0x7fefb415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb89ce640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fefb4153130 0x7fefb4073c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45524/0 (socket says 172.21.15.113:45524) 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb91cf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fefb40ceb40 0x7fefb415c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33720/0 (socket says 172.21.15.113:33720) 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb89ce640 1 -- 172.21.15.113:0/134593675 learned_addr learned my addr 172.21.15.113:0/134593675 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb3fff640 1 --2- 172.21.15.113:0/134593675 >> v2:172.21.15.145:3300/0 conn(0x7fefb40ca940 0x7fefb40ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb91cf640 1 -- 172.21.15.113:0/134593675 >> v2:172.21.15.145:3300/0 conn(0x7fefb40ca940 msgr2=0x7fefb40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:05.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb91cf640 1 --2- 172.21.15.113:0/134593675 >> v2:172.21.15.145:3300/0 conn(0x7fefb40ca940 0x7fefb40ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb91cf640 1 -- 172.21.15.113:0/134593675 >> v1:172.21.15.113:6789/0 conn(0x7fefb4153130 legacy=0x7fefb4073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb37fe640 1 -- 172.21.15.113:0/134593675 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41025528 0 0) 0x7fefb40c7690 con 0x7fefb4153130 2024-04-22T06:32:05.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.023+0000 7fefb91cf640 1 -- 172.21.15.113:0/134593675 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb4159010 con 0x7fefb40ceb40 2024-04-22T06:32:05.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefb91cf640 1 --2- 172.21.15.113:0/134593675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415c620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fefb4068960 tx=0x7fefac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1ea1fd4dc0f0de server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefb37fe640 1 -- 172.21.15.113:0/134593675 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac039070 con 0x7fefb40ceb40 2024-04-22T06:32:05.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefb37fe640 1 -- 172.21.15.113:0/134593675 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefac02cc80 con 0x7fefb40ceb40 2024-04-22T06:32:05.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefb37fe640 1 -- 172.21.15.113:0/134593675 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac034660 con 0x7fefb40ceb40 2024-04-22T06:32:05.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefbac32640 1 -- 172.21.15.113:0/134593675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 msgr2=0x7fefb415c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefbac32640 1 --2- 172.21.15.113:0/134593675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415c620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fefb4068960 tx=0x7fefac02bed0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefbac32640 1 -- 172.21.15.113:0/134593675 shutdown_connections 2024-04-22T06:32:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefbac32640 1 --2- 172.21.15.113:0/134593675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415c620 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefbac32640 1 --2- 172.21.15.113:0/134593675 >> v2:172.21.15.145:3300/0 conn(0x7fefb40ca940 0x7fefb40ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefbac32640 1 -- 172.21.15.113:0/134593675 >> 172.21.15.113:0/134593675 conn(0x7fefb4074d50 msgr2=0x7fefb4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefbac32640 1 -- 172.21.15.113:0/134593675 shutdown_connections 2024-04-22T06:32:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.024+0000 7fefbac32640 1 -- 172.21.15.113:0/134593675 wait complete. 2024-04-22T06:32:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.025+0000 7fefbac32640 1 Processor -- start 2024-04-22T06:32:05.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.025+0000 7fefbac32640 1 -- start start 2024-04-22T06:32:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefbac32640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb40ca940 0x7fefb4145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefbac32640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefbac32640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefb4153130 0x7fefb4144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefbac32640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41598b0 con 0x7fefb40ceb40 2024-04-22T06:32:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefbac32640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41595d0 con 0x7fefb40ca940 2024-04-22T06:32:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefbac32640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fefb40cf500 con 0x7fefb4153130 2024-04-22T06:32:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefb3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefb3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33726/0 (socket says 172.21.15.113:33726) 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.026+0000 7fefb3fff640 1 -- 172.21.15.113:0/1829935343 learned_addr learned my addr 172.21.15.113:0/1829935343 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb89ce640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb40ca940 0x7fefb4145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb91cf640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefb4153130 0x7fefb4144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb3fff640 1 -- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefb4153130 msgr2=0x7fefb4144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb3fff640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefb4153130 0x7fefb4144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb3fff640 1 -- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb40ca940 msgr2=0x7fefb4145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb3fff640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb40ca940 0x7fefb4145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb3fff640 1 -- 172.21.15.113:0/1829935343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb41457a0 con 0x7fefb40ceb40 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb91cf640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefb4153130 0x7fefb4144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb89ce640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb40ca940 0x7fefb4145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb3fff640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415b830 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fefa000d830 tx=0x7fefa000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb17fa640 1 -- 172.21.15.113:0/1829935343 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa000b6c0 con 0x7fefb40ceb40 2024-04-22T06:32:05.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb17fa640 1 -- 172.21.15.113:0/1829935343 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa0019070 con 0x7fefb40ceb40 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb41f4c30 con 0x7fefb40ceb40 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefb17fa640 1 -- 172.21.15.113:0/1829935343 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa000ba80 con 0x7fefb40ceb40 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.027+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb41f51f0 con 0x7fefb40ceb40 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.028+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb4068e40 con 0x7fefb40ceb40 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.028+0000 7fefb17fa640 1 -- 172.21.15.113:0/1829935343 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefa001e460 con 0x7fefb40ceb40 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.029+0000 7fefb17fa640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fef9806c8f0 0x7fef9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.029+0000 7fefb17fa640 1 -- 172.21.15.113:0/1829935343 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fefa008c5e0 con 0x7fefb40ceb40 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.029+0000 7fefb89ce640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fef9806c8f0 0x7fef9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.029+0000 7fefb89ce640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fef9806c8f0 0x7fef9806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefa8000f60 tx=0x7fefa8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.033+0000 7fefb17fa640 1 -- 172.21.15.113:0/1829935343 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fefa005a640 con 0x7fefb40ceb40 2024-04-22T06:32:05.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.244+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefb4152950 con 0x7fefb40ceb40 2024-04-22T06:32:05.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.244+0000 7fefb17fa640 1 -- 172.21.15.113:0/1829935343 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6850 (secure 0 0 0) 0x7fefa0059f40 con 0x7fefb40ceb40 2024-04-22T06:32:05.244 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:05.244 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:04.243956+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4311,"mds_1":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:creating","state_seq":1,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4311]},"id":1}]} 2024-04-22T06:32:05.244 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 10 2024-04-22T06:32:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.246+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fef9806c8f0 msgr2=0x7fef9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.246+0000 7fefbac32640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fef9806c8f0 0x7fef9806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefa8000f60 tx=0x7fefa8009040 comp rx=0 tx=0).stop 2024-04-22T06:32:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.246+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 msgr2=0x7fefb415b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.246+0000 7fefbac32640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415b830 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fefa000d830 tx=0x7fefa000dcf0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.247+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 shutdown_connections 2024-04-22T06:32:05.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.247+0000 7fefbac32640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fefb4153130 0x7fefb4144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.247+0000 7fefbac32640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fef9806c8f0 0x7fef9806edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.247+0000 7fefbac32640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fefb40ceb40 0x7fefb415b830 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.247+0000 7fefbac32640 1 --2- 172.21.15.113:0/1829935343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb40ca940 0x7fefb4145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.247+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 >> 172.21.15.113:0/1829935343 conn(0x7fefb4074d50 msgr2=0x7fefb40c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:05.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.247+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 shutdown_connections 2024-04-22T06:32:05.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.247+0000 7fefbac32640 1 -- 172.21.15.113:0/1829935343 wait complete. 2024-04-22T06:32:05.257 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:05.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.354+0000 7f34f8767640 1 Processor -- start 2024-04-22T06:32:05.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.354+0000 7f34f8767640 1 -- start start 2024-04-22T06:32:05.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f8767640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f34f0155230 0x7f34f0071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f8767640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34f006d540 con 0x7f34f015b030 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f8767640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34f015b4c0 con 0x7f34f00cb330 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f8767640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f34f00c9a80 con 0x7f34f0155230 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f6503640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f34f0155230 0x7f34f0071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f5d02640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f34f015b030 0x7f34f015ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45530/0 (socket says 172.21.15.113:45530) 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f6503640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f34f0155230 0x7f34f0071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33740/0 (socket says 172.21.15.113:33740) 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f5d02640 1 -- 172.21.15.113:0/3335345790 learned_addr learned my addr 172.21.15.113:0/3335345790 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f6503640 1 -- 172.21.15.113:0/3335345790 >> v1:172.21.15.145:6789/0 conn(0x7f34f00cb330 legacy=0x7f34f01659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f6503640 1 -- 172.21.15.113:0/3335345790 >> v1:172.21.15.113:6789/0 conn(0x7f34f015b030 legacy=0x7f34f015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f6503640 1 -- 172.21.15.113:0/3335345790 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f015b7a0 con 0x7f34f0155230 2024-04-22T06:32:05.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.355+0000 7f34f5501640 1 -- 172.21.15.113:0/3335345790 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674549152 0 0) 0x7f34f006d540 con 0x7f34f015b030 2024-04-22T06:32:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.356+0000 7f34f6503640 1 --2- 172.21.15.113:0/3335345790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f0155230 0x7f34f0071060 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0097d0 tx=0x7f34ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb804a137900c55e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.356+0000 7f34f5501640 1 -- 172.21.15.113:0/3335345790 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec035020 con 0x7f34f0155230 2024-04-22T06:32:05.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.356+0000 7f34f5501640 1 -- 172.21.15.113:0/3335345790 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec031830 con 0x7f34f0155230 2024-04-22T06:32:05.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.356+0000 7f34f5501640 1 -- 172.21.15.113:0/3335345790 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec031c00 con 0x7f34f0155230 2024-04-22T06:32:05.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.357+0000 7f34f8767640 1 -- 172.21.15.113:0/3335345790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f0155230 msgr2=0x7f34f0071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.357+0000 7f34f8767640 1 --2- 172.21.15.113:0/3335345790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f0155230 0x7f34f0071060 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0097d0 tx=0x7f34ec02b8d0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.357+0000 7f34f8767640 1 -- 172.21.15.113:0/3335345790 shutdown_connections 2024-04-22T06:32:05.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.357+0000 7f34f8767640 1 --2- 172.21.15.113:0/3335345790 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f0155230 0x7f34f0071060 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.357+0000 7f34f8767640 1 -- 172.21.15.113:0/3335345790 >> 172.21.15.113:0/3335345790 conn(0x7f34f0074f30 msgr2=0x7f34f0075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:05.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.357+0000 7f34f8767640 1 -- 172.21.15.113:0/3335345790 shutdown_connections 2024-04-22T06:32:05.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.357+0000 7f34f8767640 1 -- 172.21.15.113:0/3335345790 wait complete. 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f8767640 1 Processor -- start 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f8767640 1 -- start start 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f8767640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f00cb330 0x7f34f015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f8767640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34f0155230 0x7f34f01f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f8767640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34f0153ab0 0x7f34f00ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f8767640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f34f015e7c0 con 0x7f34f00cb330 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f8767640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f34f015bd60 con 0x7f34f0153ab0 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f8767640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f34f015f3f0 con 0x7f34f0155230 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.358+0000 7f34f6503640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f00cb330 0x7f34f015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6503640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f00cb330 0x7f34f015aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33754/0 (socket says 172.21.15.113:33754) 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6503640 1 -- 172.21.15.113:0/3712450364 learned_addr learned my addr 172.21.15.113:0/3712450364 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:05.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f5d02640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34f0155230 0x7f34f01f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6503640 1 -- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34f0155230 msgr2=0x7f34f01f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6503640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34f0155230 0x7f34f01f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6503640 1 -- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34f0153ab0 msgr2=0x7f34f00ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6d04640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34f0153ab0 0x7f34f00ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6503640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34f0153ab0 0x7f34f00ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6503640 1 -- 172.21.15.113:0/3712450364 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f01544e0 con 0x7f34f00cb330 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f5d02640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34f0155230 0x7f34f01f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6d04640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34f0153ab0 0x7f34f00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f6503640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f00cb330 0x7f34f015aac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0098c0 tx=0x7f34ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34e6ffd640 1 -- 172.21.15.113:0/3712450364 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec03bab0 con 0x7f34f00cb330 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34e6ffd640 1 -- 172.21.15.113:0/3712450364 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec03bc50 con 0x7f34f00cb330 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34e6ffd640 1 -- 172.21.15.113:0/3712450364 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0453f0 con 0x7f34f00cb330 2024-04-22T06:32:05.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f01547c0 con 0x7f34f00cb330 2024-04-22T06:32:05.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.359+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f01f1100 con 0x7f34f00cb330 2024-04-22T06:32:05.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.360+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f01f1300 con 0x7f34f00cb330 2024-04-22T06:32:05.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.360+0000 7f34e6ffd640 1 -- 172.21.15.113:0/3712450364 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34ec038020 con 0x7f34f00cb330 2024-04-22T06:32:05.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.361+0000 7f34e6ffd640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f34d406c8f0 0x7f34d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.361+0000 7f34e6ffd640 1 -- 172.21.15.113:0/3712450364 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f34ec0adbb0 con 0x7f34f00cb330 2024-04-22T06:32:05.363 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.361+0000 7f34f5d02640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f34d406c8f0 0x7f34d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.363 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.361+0000 7f34f5d02640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f34d406c8f0 0x7f34d406edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34f015a9e0 tx=0x7f34e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.364 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.365+0000 7f34e6ffd640 1 -- 172.21.15.113:0/3712450364 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34f01f1300 con 0x7f34f00cb330 2024-04-22T06:32:05.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.543+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34f0068e40 con 0x7f34f00cb330 2024-04-22T06:32:05.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.544+0000 7f34e6ffd640 1 -- 172.21.15.113:0/3712450364 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f34ec040070 con 0x7f34f00cb330 2024-04-22T06:32:05.543 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:05.544 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f34d406c8f0 msgr2=0x7f34d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f34d406c8f0 0x7f34d406edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34f015a9e0 tx=0x7f34e0009040 comp rx=0 tx=0).stop 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f00cb330 msgr2=0x7f34f015aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f00cb330 0x7f34f015aac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0098c0 tx=0x7f34ec0046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 shutdown_connections 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34f0153ab0 0x7f34f00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34f0155230 0x7f34f01f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f34d406c8f0 0x7f34d406edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 --2- 172.21.15.113:0/3712450364 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34f00cb330 0x7f34f015aac0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 >> 172.21.15.113:0/3712450364 conn(0x7f34f0074f30 msgr2=0x7f34f0073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 shutdown_connections 2024-04-22T06:32:05.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.546+0000 7f34f8767640 1 -- 172.21.15.113:0/3712450364 wait complete. 2024-04-22T06:32:05.556 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-22T06:32:05.557 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:32:05.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.653+0000 7f52f04f2640 1 Processor -- start 2024-04-22T06:32:05.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.653+0000 7f52f04f2640 1 -- start start 2024-04-22T06:32:05.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.654+0000 7f52f04f2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f52e8155230 0x7f52e8071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.654+0000 7f52f04f2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f52e80cb330 0x7f52e80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.654+0000 7f52f04f2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e806d540 con 0x7f52e815b030 2024-04-22T06:32:05.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.654+0000 7f52f04f2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f52e80c9a80 con 0x7f52e80cb330 2024-04-22T06:32:05.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.654+0000 7f52f04f2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f52e815b4c0 con 0x7f52e8155230 2024-04-22T06:32:05.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.654+0000 7f52eea8f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f52e80cb330 0x7f52e80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.654+0000 7f52eea8f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f52e80cb330 0x7f52e80cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33758/0 (socket says 172.21.15.113:33758) 2024-04-22T06:32:05.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.654+0000 7f52eea8f640 1 -- 172.21.15.113:0/641444911 learned_addr learned my addr 172.21.15.113:0/641444911 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:05.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.655+0000 7f52ee28e640 1 --2- 172.21.15.113:0/641444911 >> v2:172.21.15.145:3300/0 conn(0x7f52e8155230 0x7f52e8071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.655+0000 7f52eea8f640 1 -- 172.21.15.113:0/641444911 >> v2:172.21.15.145:3300/0 conn(0x7f52e8155230 msgr2=0x7f52e8071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:05.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.655+0000 7f52eea8f640 1 --2- 172.21.15.113:0/641444911 >> v2:172.21.15.145:3300/0 conn(0x7f52e8155230 0x7f52e8071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.655+0000 7f52eea8f640 1 -- 172.21.15.113:0/641444911 >> v1:172.21.15.145:6789/0 conn(0x7f52e815b030 legacy=0x7f52e815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:05.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.655+0000 7f52eea8f640 1 -- 172.21.15.113:0/641444911 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e815b7a0 con 0x7f52e80cb330 2024-04-22T06:32:05.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.655+0000 7f52eea8f640 1 --2- 172.21.15.113:0/641444911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e80cb7e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009870 tx=0x7f52e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18431400d6a0a5d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52ed28c640 1 -- 172.21.15.113:0/641444911 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0035020 con 0x7f52e80cb330 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52ed28c640 1 -- 172.21.15.113:0/641444911 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e0031870 con 0x7f52e80cb330 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52ed28c640 1 -- 172.21.15.113:0/641444911 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0031c40 con 0x7f52e80cb330 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52f04f2640 1 -- 172.21.15.113:0/641444911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 msgr2=0x7f52e80cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52f04f2640 1 --2- 172.21.15.113:0/641444911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e80cb7e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009870 tx=0x7f52e002b910 comp rx=0 tx=0).stop 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52f04f2640 1 -- 172.21.15.113:0/641444911 shutdown_connections 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52f04f2640 1 --2- 172.21.15.113:0/641444911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e80cb7e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52f04f2640 1 --2- 172.21.15.113:0/641444911 >> v2:172.21.15.145:3300/0 conn(0x7f52e8155230 0x7f52e8071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52f04f2640 1 -- 172.21.15.113:0/641444911 >> 172.21.15.113:0/641444911 conn(0x7f52e8074f30 msgr2=0x7f52e8075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52f04f2640 1 -- 172.21.15.113:0/641444911 shutdown_connections 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.656+0000 7f52f04f2640 1 -- 172.21.15.113:0/641444911 wait complete. 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.657+0000 7f52f04f2640 1 Processor -- start 2024-04-22T06:32:05.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.657+0000 7f52f04f2640 1 -- start start 2024-04-22T06:32:05.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52f04f2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e814b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52f04f2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52e8155230 0x7f52e814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52f04f2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52e81f4560 0x7f52e8151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52f04f2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f52e815e7c0 con 0x7f52e80cb330 2024-04-22T06:32:05.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52f04f2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f52e815bd60 con 0x7f52e81f4560 2024-04-22T06:32:05.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52f04f2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f52e815f3f0 con 0x7f52e8155230 2024-04-22T06:32:05.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52ee28e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52ee28e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e814b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33764/0 (socket says 172.21.15.113:33764) 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52ee28e640 1 -- 172.21.15.113:0/146125324 learned_addr learned my addr 172.21.15.113:0/146125324 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52eea8f640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52e81f4560 0x7f52e8151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52eda8d640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52e8155230 0x7f52e814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52ee28e640 1 -- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52e8155230 msgr2=0x7f52e814f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52ee28e640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52e8155230 0x7f52e814f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52ee28e640 1 -- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52e81f4560 msgr2=0x7f52e8151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.658+0000 7f52ee28e640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52e81f4560 0x7f52e8151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.659+0000 7f52ee28e640 1 -- 172.21.15.113:0/146125324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e814fbf0 con 0x7f52e80cb330 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.659+0000 7f52eda8d640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52e8155230 0x7f52e814f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.659+0000 7f52ee28e640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e814b470 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f52e400ce10 tx=0x7f52e400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.659+0000 7f52deffd640 1 -- 172.21.15.113:0/146125324 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4003b90 con 0x7f52e80cb330 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.659+0000 7f52deffd640 1 -- 172.21.15.113:0/146125324 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e4003d30 con 0x7f52e80cb330 2024-04-22T06:32:05.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.659+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e8154370 con 0x7f52e80cb330 2024-04-22T06:32:05.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.659+0000 7f52deffd640 1 -- 172.21.15.113:0/146125324 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4004260 con 0x7f52e80cb330 2024-04-22T06:32:05.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.659+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e8154930 con 0x7f52e80cb330 2024-04-22T06:32:05.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.660+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e8068e40 con 0x7f52e80cb330 2024-04-22T06:32:05.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.660+0000 7f52deffd640 1 -- 172.21.15.113:0/146125324 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52e4004400 con 0x7f52e80cb330 2024-04-22T06:32:05.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.661+0000 7f52deffd640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f52cc06c920 0x7f52cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.661+0000 7f52deffd640 1 -- 172.21.15.113:0/146125324 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f52e408c8b0 con 0x7f52e80cb330 2024-04-22T06:32:05.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.661+0000 7f52eda8d640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f52cc06c920 0x7f52cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.661+0000 7f52eda8d640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f52cc06c920 0x7f52cc06ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52d8006fd0 tx=0x7f52d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:05.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.665+0000 7f52deffd640 1 -- 172.21.15.113:0/146125324 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52e814fbf0 con 0x7f52e80cb330 2024-04-22T06:32:05.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.836+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52e80cd7d0 con 0x7f52cc06c920 2024-04-22T06:32:05.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.844+0000 7f52deffd640 1 -- 172.21.15.113:0/146125324 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f52e80cd7d0 con 0x7f52cc06c920 2024-04-22T06:32:05.848 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:05.850 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f52cc06c920 msgr2=0x7f52cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f52cc06c920 0x7f52cc06ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52d8006fd0 tx=0x7f52d8008040 comp rx=0 tx=0).stop 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 msgr2=0x7f52e814b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e814b470 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f52e400ce10 tx=0x7f52e400a660 comp rx=0 tx=0).stop 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 shutdown_connections 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52e81f4560 0x7f52e8151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52e8155230 0x7f52e814f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f52cc06c920 0x7f52cc06ede0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 --2- 172.21.15.113:0/146125324 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52e80cb330 0x7f52e814b470 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:05.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 >> 172.21.15.113:0/146125324 conn(0x7f52e8074f30 msgr2=0x7f52e80731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:05.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 shutdown_connections 2024-04-22T06:32:05.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.848+0000 7f52f04f2640 1 -- 172.21.15.113:0/146125324 wait complete. 2024-04-22T06:32:05.858 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-22T06:32:04.974639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003224"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128312+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:31:45.128312+0000","last_peered":"2024-04-22T06:31:45.128312+0000","last_clean":"2024-04-22T06:31:45.128312+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:31:45.128312+0000","last_undegraded":"2024-04-22T06:31:45.128312+0000","last_fullsized":"2024-04-22T06:31:45.128312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128419+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:31:45.128419+0000","last_peered":"2024-04-22T06:31:45.128419+0000","last_clean":"2024-04-22T06:31:45.128419+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:31:45.128419+0000","last_undegraded":"2024-04-22T06:31:45.128419+0000","last_fullsized":"2024-04-22T06:31:45.128419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128781+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:31:45.128781+0000","last_peered":"2024-04-22T06:31:45.128781+0000","last_clean":"2024-04-22T06:31:45.128781+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:31:45.128781+0000","last_undegraded":"2024-04-22T06:31:45.128781+0000","last_fullsized":"2024-04-22T06:31:45.128781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128602+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:31:45.128602+0000","last_peered":"2024-04-22T06:31:45.128602+0000","last_clean":"2024-04-22T06:31:45.128602+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:31:45.128602+0000","last_undegraded":"2024-04-22T06:31:45.128602+0000","last_fullsized":"2024-04-22T06:31:45.128602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128070+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:31:45.128070+0000","last_peered":"2024-04-22T06:31:45.128070+0000","last_clean":"2024-04-22T06:31:45.128070+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:31:45.128070+0000","last_undegraded":"2024-04-22T06:31:45.128070+0000","last_fullsized":"2024-04-22T06:31:45.128070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158824+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:31:43.158824+0000","last_peered":"2024-04-22T06:31:43.158824+0000","last_clean":"2024-04-22T06:31:43.158824+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:31:43.158824+0000","last_undegraded":"2024-04-22T06:31:43.158824+0000","last_fullsized":"2024-04-22T06:31:43.158824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025053+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:31:45.025053+0000","last_peered":"2024-04-22T06:31:45.025053+0000","last_clean":"2024-04-22T06:31:45.025053+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:31:45.025053+0000","last_undegraded":"2024-04-22T06:31:45.025053+0000","last_fullsized":"2024-04-22T06:31:45.025053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858125+0000","last_change":"2024-04-22T06:31:37.850283+0000","last_active":"2024-04-22T06:31:42.858125+0000","last_peered":"2024-04-22T06:31:42.858125+0000","last_clean":"2024-04-22T06:31:42.858125+0000","last_became_active":"2024-04-22T06:31:37.849975+0000","last_became_peered":"2024-04-22T06:31:37.849975+0000","last_unstale":"2024-04-22T06:31:42.858125+0000","last_undegraded":"2024-04-22T06:31:42.858125+0000","last_fullsized":"2024-04-22T06:31:42.858125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:50.592700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158818+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:31:43.158818+0000","last_peered":"2024-04-22T06:31:43.158818+0000","last_clean":"2024-04-22T06:31:43.158818+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:31:43.158818+0000","last_undegraded":"2024-04-22T06:31:43.158818+0000","last_fullsized":"2024-04-22T06:31:43.158818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025025+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:31:45.025025+0000","last_peered":"2024-04-22T06:31:45.025025+0000","last_clean":"2024-04-22T06:31:45.025025+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:31:45.025025+0000","last_undegraded":"2024-04-22T06:31:45.025025+0000","last_fullsized":"2024-04-22T06:31:45.025025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857546+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:31:42.857546+0000","last_peered":"2024-04-22T06:31:42.857546+0000","last_clean":"2024-04-22T06:31:42.857546+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:31:42.857546+0000","last_undegraded":"2024-04-22T06:31:42.857546+0000","last_fullsized":"2024-04-22T06:31:42.857546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158709+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:31:43.158709+0000","last_peered":"2024-04-22T06:31:43.158709+0000","last_clean":"2024-04-22T06:31:43.158709+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:31:43.158709+0000","last_undegraded":"2024-04-22T06:31:43.158709+0000","last_fullsized":"2024-04-22T06:31:43.158709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857807+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:31:42.857807+0000","last_peered":"2024-04-22T06:31:42.857807+0000","last_clean":"2024-04-22T06:31:42.857807+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:31:42.857807+0000","last_undegraded":"2024-04-22T06:31:42.857807+0000","last_fullsized":"2024-04-22T06:31:42.857807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025023+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:31:45.025023+0000","last_peered":"2024-04-22T06:31:45.025023+0000","last_clean":"2024-04-22T06:31:45.025023+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:31:45.025023+0000","last_undegraded":"2024-04-22T06:31:45.025023+0000","last_fullsized":"2024-04-22T06:31:45.025023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159258+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:31:43.159258+0000","last_peered":"2024-04-22T06:31:43.159258+0000","last_clean":"2024-04-22T06:31:43.159258+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:31:43.159258+0000","last_undegraded":"2024-04-22T06:31:43.159258+0000","last_fullsized":"2024-04-22T06:31:43.159258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128813+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:31:45.128813+0000","last_peered":"2024-04-22T06:31:45.128813+0000","last_clean":"2024-04-22T06:31:45.128813+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:31:45.128813+0000","last_undegraded":"2024-04-22T06:31:45.128813+0000","last_fullsized":"2024-04-22T06:31:45.128813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282227+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:31:44.282227+0000","last_peered":"2024-04-22T06:31:44.282227+0000","last_clean":"2024-04-22T06:31:44.282227+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:31:44.282227+0000","last_undegraded":"2024-04-22T06:31:44.282227+0000","last_fullsized":"2024-04-22T06:31:44.282227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159037+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:31:43.159037+0000","last_peered":"2024-04-22T06:31:43.159037+0000","last_clean":"2024-04-22T06:31:43.159037+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:31:43.159037+0000","last_undegraded":"2024-04-22T06:31:43.159037+0000","last_fullsized":"2024-04-22T06:31:43.159037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129077+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:31:45.129077+0000","last_peered":"2024-04-22T06:31:45.129077+0000","last_clean":"2024-04-22T06:31:45.129077+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:31:45.129077+0000","last_undegraded":"2024-04-22T06:31:45.129077+0000","last_fullsized":"2024-04-22T06:31:45.129077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281957+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:31:44.281957+0000","last_peered":"2024-04-22T06:31:44.281957+0000","last_clean":"2024-04-22T06:31:44.281957+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:31:44.281957+0000","last_undegraded":"2024-04-22T06:31:44.281957+0000","last_fullsized":"2024-04-22T06:31:44.281957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282535+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:31:44.282535+0000","last_peered":"2024-04-22T06:31:44.282535+0000","last_clean":"2024-04-22T06:31:44.282535+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:31:44.282535+0000","last_undegraded":"2024-04-22T06:31:44.282535+0000","last_fullsized":"2024-04-22T06:31:44.282535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158989+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:31:43.158989+0000","last_peered":"2024-04-22T06:31:43.158989+0000","last_clean":"2024-04-22T06:31:43.158989+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:31:43.158989+0000","last_undegraded":"2024-04-22T06:31:43.158989+0000","last_fullsized":"2024-04-22T06:31:43.158989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025280+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:31:45.025280+0000","last_peered":"2024-04-22T06:31:45.025280+0000","last_clean":"2024-04-22T06:31:45.025280+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:31:45.025280+0000","last_undegraded":"2024-04-22T06:31:45.025280+0000","last_fullsized":"2024-04-22T06:31:45.025280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159260+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:31:43.159260+0000","last_peered":"2024-04-22T06:31:43.159260+0000","last_clean":"2024-04-22T06:31:43.159260+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:31:43.159260+0000","last_undegraded":"2024-04-22T06:31:43.159260+0000","last_fullsized":"2024-04-22T06:31:43.159260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127898+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:31:45.127898+0000","last_peered":"2024-04-22T06:31:45.127898+0000","last_clean":"2024-04-22T06:31:45.127898+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:31:45.127898+0000","last_undegraded":"2024-04-22T06:31:45.127898+0000","last_fullsized":"2024-04-22T06:31:45.127898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857376+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:31:42.857376+0000","last_peered":"2024-04-22T06:31:42.857376+0000","last_clean":"2024-04-22T06:31:42.857376+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:31:42.857376+0000","last_undegraded":"2024-04-22T06:31:42.857376+0000","last_fullsized":"2024-04-22T06:31:42.857376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159079+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:31:43.159079+0000","last_peered":"2024-04-22T06:31:43.159079+0000","last_clean":"2024-04-22T06:31:43.159079+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:31:43.159079+0000","last_undegraded":"2024-04-22T06:31:43.159079+0000","last_fullsized":"2024-04-22T06:31:43.159079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128503+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:31:45.128503+0000","last_peered":"2024-04-22T06:31:45.128503+0000","last_clean":"2024-04-22T06:31:45.128503+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:31:45.128503+0000","last_undegraded":"2024-04-22T06:31:45.128503+0000","last_fullsized":"2024-04-22T06:31:45.128503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282339+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:31:44.282339+0000","last_peered":"2024-04-22T06:31:44.282339+0000","last_clean":"2024-04-22T06:31:44.282339+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:31:44.282339+0000","last_undegraded":"2024-04-22T06:31:44.282339+0000","last_fullsized":"2024-04-22T06:31:44.282339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129012+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:31:45.129012+0000","last_peered":"2024-04-22T06:31:45.129012+0000","last_clean":"2024-04-22T06:31:45.129012+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:31:45.129012+0000","last_undegraded":"2024-04-22T06:31:45.129012+0000","last_fullsized":"2024-04-22T06:31:45.129012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282322+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:31:44.282322+0000","last_peered":"2024-04-22T06:31:44.282322+0000","last_clean":"2024-04-22T06:31:44.282322+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:31:44.282322+0000","last_undegraded":"2024-04-22T06:31:44.282322+0000","last_fullsized":"2024-04-22T06:31:44.282322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025900+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:31:45.025900+0000","last_peered":"2024-04-22T06:31:45.025900+0000","last_clean":"2024-04-22T06:31:45.025900+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:31:45.025900+0000","last_undegraded":"2024-04-22T06:31:45.025900+0000","last_fullsized":"2024-04-22T06:31:45.025900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127630+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:31:45.127630+0000","last_peered":"2024-04-22T06:31:45.127630+0000","last_clean":"2024-04-22T06:31:45.127630+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:31:45.127630+0000","last_undegraded":"2024-04-22T06:31:45.127630+0000","last_fullsized":"2024-04-22T06:31:45.127630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857639+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:31:42.857639+0000","last_peered":"2024-04-22T06:31:42.857639+0000","last_clean":"2024-04-22T06:31:42.857639+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:31:42.857639+0000","last_undegraded":"2024-04-22T06:31:42.857639+0000","last_fullsized":"2024-04-22T06:31:42.857639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282396+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:31:44.282396+0000","last_peered":"2024-04-22T06:31:44.282396+0000","last_clean":"2024-04-22T06:31:44.282396+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:31:44.282396+0000","last_undegraded":"2024-04-22T06:31:44.282396+0000","last_fullsized":"2024-04-22T06:31:44.282396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282029+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:31:44.282029+0000","last_peered":"2024-04-22T06:31:44.282029+0000","last_clean":"2024-04-22T06:31:44.282029+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:31:44.282029+0000","last_undegraded":"2024-04-22T06:31:44.282029+0000","last_fullsized":"2024-04-22T06:31:44.282029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159184+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:31:43.159184+0000","last_peered":"2024-04-22T06:31:43.159184+0000","last_clean":"2024-04-22T06:31:43.159184+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:31:43.159184+0000","last_undegraded":"2024-04-22T06:31:43.159184+0000","last_fullsized":"2024-04-22T06:31:43.159184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857873+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:31:42.857873+0000","last_peered":"2024-04-22T06:31:42.857873+0000","last_clean":"2024-04-22T06:31:42.857873+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:31:42.857873+0000","last_undegraded":"2024-04-22T06:31:42.857873+0000","last_fullsized":"2024-04-22T06:31:42.857873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282276+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:31:44.282276+0000","last_peered":"2024-04-22T06:31:44.282276+0000","last_clean":"2024-04-22T06:31:44.282276+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:31:44.282276+0000","last_undegraded":"2024-04-22T06:31:44.282276+0000","last_fullsized":"2024-04-22T06:31:44.282276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281878+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:31:44.281878+0000","last_peered":"2024-04-22T06:31:44.281878+0000","last_clean":"2024-04-22T06:31:44.281878+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:31:44.281878+0000","last_undegraded":"2024-04-22T06:31:44.281878+0000","last_fullsized":"2024-04-22T06:31:44.281878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855934+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:31:42.855934+0000","last_peered":"2024-04-22T06:31:42.855934+0000","last_clean":"2024-04-22T06:31:42.855934+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:31:42.855934+0000","last_undegraded":"2024-04-22T06:31:42.855934+0000","last_fullsized":"2024-04-22T06:31:42.855934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282665+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:31:44.282665+0000","last_peered":"2024-04-22T06:31:44.282665+0000","last_clean":"2024-04-22T06:31:44.282665+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:31:44.282665+0000","last_undegraded":"2024-04-22T06:31:44.282665+0000","last_fullsized":"2024-04-22T06:31:44.282665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127311+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:31:45.127311+0000","last_peered":"2024-04-22T06:31:45.127311+0000","last_clean":"2024-04-22T06:31:45.127311+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:31:45.127311+0000","last_undegraded":"2024-04-22T06:31:45.127311+0000","last_fullsized":"2024-04-22T06:31:45.127311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025001+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:31:45.025001+0000","last_peered":"2024-04-22T06:31:45.025001+0000","last_clean":"2024-04-22T06:31:45.025001+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:31:45.025001+0000","last_undegraded":"2024-04-22T06:31:45.025001+0000","last_fullsized":"2024-04-22T06:31:45.025001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127835+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:31:45.127835+0000","last_peered":"2024-04-22T06:31:45.127835+0000","last_clean":"2024-04-22T06:31:45.127835+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:31:45.127835+0000","last_undegraded":"2024-04-22T06:31:45.127835+0000","last_fullsized":"2024-04-22T06:31:45.127835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128116+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:31:45.128116+0000","last_peered":"2024-04-22T06:31:45.128116+0000","last_clean":"2024-04-22T06:31:45.128116+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:31:45.128116+0000","last_undegraded":"2024-04-22T06:31:45.128116+0000","last_fullsized":"2024-04-22T06:31:45.128116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857169+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:31:42.857169+0000","last_peered":"2024-04-22T06:31:42.857169+0000","last_clean":"2024-04-22T06:31:42.857169+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:31:42.857169+0000","last_undegraded":"2024-04-22T06:31:42.857169+0000","last_fullsized":"2024-04-22T06:31:42.857169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025414+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:31:45.025414+0000","last_peered":"2024-04-22T06:31:45.025414+0000","last_clean":"2024-04-22T06:31:45.025414+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:31:45.025414+0000","last_undegraded":"2024-04-22T06:31:45.025414+0000","last_fullsized":"2024-04-22T06:31:45.025414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858050+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:31:42.858050+0000","last_peered":"2024-04-22T06:31:42.858050+0000","last_clean":"2024-04-22T06:31:42.858050+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:31:42.858050+0000","last_undegraded":"2024-04-22T06:31:42.858050+0000","last_fullsized":"2024-04-22T06:31:42.858050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025766+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:31:45.025766+0000","last_peered":"2024-04-22T06:31:45.025766+0000","last_clean":"2024-04-22T06:31:45.025766+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:31:45.025766+0000","last_undegraded":"2024-04-22T06:31:45.025766+0000","last_fullsized":"2024-04-22T06:31:45.025766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856286+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:31:42.856286+0000","last_peered":"2024-04-22T06:31:42.856286+0000","last_clean":"2024-04-22T06:31:42.856286+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:31:42.856286+0000","last_undegraded":"2024-04-22T06:31:42.856286+0000","last_fullsized":"2024-04-22T06:31:42.856286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857752+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:31:42.857752+0000","last_peered":"2024-04-22T06:31:42.857752+0000","last_clean":"2024-04-22T06:31:42.857752+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:31:42.857752+0000","last_undegraded":"2024-04-22T06:31:42.857752+0000","last_fullsized":"2024-04-22T06:31:42.857752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858226+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:31:42.858226+0000","last_peered":"2024-04-22T06:31:42.858226+0000","last_clean":"2024-04-22T06:31:42.858226+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:31:42.858226+0000","last_undegraded":"2024-04-22T06:31:42.858226+0000","last_fullsized":"2024-04-22T06:31:42.858226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282329+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:31:44.282329+0000","last_peered":"2024-04-22T06:31:44.282329+0000","last_clean":"2024-04-22T06:31:44.282329+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:31:44.282329+0000","last_undegraded":"2024-04-22T06:31:44.282329+0000","last_fullsized":"2024-04-22T06:31:44.282329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127795+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:31:45.127795+0000","last_peered":"2024-04-22T06:31:45.127795+0000","last_clean":"2024-04-22T06:31:45.127795+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:31:45.127795+0000","last_undegraded":"2024-04-22T06:31:45.127795+0000","last_fullsized":"2024-04-22T06:31:45.127795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.026029+0000","last_change":"2024-04-22T06:31:37.854957+0000","last_active":"2024-04-22T06:31:45.026029+0000","last_peered":"2024-04-22T06:31:45.026029+0000","last_clean":"2024-04-22T06:31:45.026029+0000","last_became_active":"2024-04-22T06:31:37.852899+0000","last_became_peered":"2024-04-22T06:31:37.852899+0000","last_unstale":"2024-04-22T06:31:45.026029+0000","last_undegraded":"2024-04-22T06:31:45.026029+0000","last_fullsized":"2024-04-22T06:31:45.026029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:30:53.163996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856291+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:31:42.856291+0000","last_peered":"2024-04-22T06:31:42.856291+0000","last_clean":"2024-04-22T06:31:42.856291+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:31:42.856291+0000","last_undegraded":"2024-04-22T06:31:42.856291+0000","last_fullsized":"2024-04-22T06:31:42.856291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856491+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:31:42.856491+0000","last_peered":"2024-04-22T06:31:42.856491+0000","last_clean":"2024-04-22T06:31:42.856491+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:31:42.856491+0000","last_undegraded":"2024-04-22T06:31:42.856491+0000","last_fullsized":"2024-04-22T06:31:42.856491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025748+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:31:45.025748+0000","last_peered":"2024-04-22T06:31:45.025748+0000","last_clean":"2024-04-22T06:31:45.025748+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:31:45.025748+0000","last_undegraded":"2024-04-22T06:31:45.025748+0000","last_fullsized":"2024-04-22T06:31:45.025748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159360+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:31:43.159360+0000","last_peered":"2024-04-22T06:31:43.159360+0000","last_clean":"2024-04-22T06:31:43.159360+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:31:43.159360+0000","last_undegraded":"2024-04-22T06:31:43.159360+0000","last_fullsized":"2024-04-22T06:31:43.159360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158599+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:31:43.158599+0000","last_peered":"2024-04-22T06:31:43.158599+0000","last_clean":"2024-04-22T06:31:43.158599+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:31:43.158599+0000","last_undegraded":"2024-04-22T06:31:43.158599+0000","last_fullsized":"2024-04-22T06:31:43.158599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025578+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:31:45.025578+0000","last_peered":"2024-04-22T06:31:45.025578+0000","last_clean":"2024-04-22T06:31:45.025578+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:31:45.025578+0000","last_undegraded":"2024-04-22T06:31:45.025578+0000","last_fullsized":"2024-04-22T06:31:45.025578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855847+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:31:42.855847+0000","last_peered":"2024-04-22T06:31:42.855847+0000","last_clean":"2024-04-22T06:31:42.855847+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:31:42.855847+0000","last_undegraded":"2024-04-22T06:31:42.855847+0000","last_fullsized":"2024-04-22T06:31:42.855847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127692+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:31:45.127692+0000","last_peered":"2024-04-22T06:31:45.127692+0000","last_clean":"2024-04-22T06:31:45.127692+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:31:45.127692+0000","last_undegraded":"2024-04-22T06:31:45.127692+0000","last_fullsized":"2024-04-22T06:31:45.127692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857027+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:31:42.857027+0000","last_peered":"2024-04-22T06:31:42.857027+0000","last_clean":"2024-04-22T06:31:42.857027+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:31:42.857027+0000","last_undegraded":"2024-04-22T06:31:42.857027+0000","last_fullsized":"2024-04-22T06:31:42.857027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857459+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:31:42.857459+0000","last_peered":"2024-04-22T06:31:42.857459+0000","last_clean":"2024-04-22T06:31:42.857459+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:31:42.857459+0000","last_undegraded":"2024-04-22T06:31:42.857459+0000","last_fullsized":"2024-04-22T06:31:42.857459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128617+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:31:45.128617+0000","last_peered":"2024-04-22T06:31:45.128617+0000","last_clean":"2024-04-22T06:31:45.128617+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:31:45.128617+0000","last_undegraded":"2024-04-22T06:31:45.128617+0000","last_fullsized":"2024-04-22T06:31:45.128617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025635+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:31:45.025635+0000","last_peered":"2024-04-22T06:31:45.025635+0000","last_clean":"2024-04-22T06:31:45.025635+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:31:45.025635+0000","last_undegraded":"2024-04-22T06:31:45.025635+0000","last_fullsized":"2024-04-22T06:31:45.025635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857798+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:31:42.857798+0000","last_peered":"2024-04-22T06:31:42.857798+0000","last_clean":"2024-04-22T06:31:42.857798+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:31:42.857798+0000","last_undegraded":"2024-04-22T06:31:42.857798+0000","last_fullsized":"2024-04-22T06:31:42.857798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128726+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:31:45.128726+0000","last_peered":"2024-04-22T06:31:45.128726+0000","last_clean":"2024-04-22T06:31:45.128726+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:31:45.128726+0000","last_undegraded":"2024-04-22T06:31:45.128726+0000","last_fullsized":"2024-04-22T06:31:45.128726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127522+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:31:45.127522+0000","last_peered":"2024-04-22T06:31:45.127522+0000","last_clean":"2024-04-22T06:31:45.127522+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:31:45.127522+0000","last_undegraded":"2024-04-22T06:31:45.127522+0000","last_fullsized":"2024-04-22T06:31:45.127522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127064+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:31:45.127064+0000","last_peered":"2024-04-22T06:31:45.127064+0000","last_clean":"2024-04-22T06:31:45.127064+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:31:45.127064+0000","last_undegraded":"2024-04-22T06:31:45.127064+0000","last_fullsized":"2024-04-22T06:31:45.127064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857582+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:31:42.857582+0000","last_peered":"2024-04-22T06:31:42.857582+0000","last_clean":"2024-04-22T06:31:42.857582+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:31:42.857582+0000","last_undegraded":"2024-04-22T06:31:42.857582+0000","last_fullsized":"2024-04-22T06:31:42.857582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025665+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:31:45.025665+0000","last_peered":"2024-04-22T06:31:45.025665+0000","last_clean":"2024-04-22T06:31:45.025665+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:31:45.025665+0000","last_undegraded":"2024-04-22T06:31:45.025665+0000","last_fullsized":"2024-04-22T06:31:45.025665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:50.224897+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:31:50.224897+0000","last_peered":"2024-04-22T06:31:50.224897+0000","last_clean":"2024-04-22T06:31:50.224897+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:31:50.224897+0000","last_undegraded":"2024-04-22T06:31:50.224897+0000","last_fullsized":"2024-04-22T06:31:50.224897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282326+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:31:44.282326+0000","last_peered":"2024-04-22T06:31:44.282326+0000","last_clean":"2024-04-22T06:31:44.282326+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:31:44.282326+0000","last_undegraded":"2024-04-22T06:31:44.282326+0000","last_fullsized":"2024-04-22T06:31:44.282326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159136+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:31:43.159136+0000","last_peered":"2024-04-22T06:31:43.159136+0000","last_clean":"2024-04-22T06:31:43.159136+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:31:43.159136+0000","last_undegraded":"2024-04-22T06:31:43.159136+0000","last_fullsized":"2024-04-22T06:31:43.159136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282302+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:31:44.282302+0000","last_peered":"2024-04-22T06:31:44.282302+0000","last_clean":"2024-04-22T06:31:44.282302+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:31:44.282302+0000","last_undegraded":"2024-04-22T06:31:44.282302+0000","last_fullsized":"2024-04-22T06:31:44.282302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159104+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:31:43.159104+0000","last_peered":"2024-04-22T06:31:43.159104+0000","last_clean":"2024-04-22T06:31:43.159104+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:31:43.159104+0000","last_undegraded":"2024-04-22T06:31:43.159104+0000","last_fullsized":"2024-04-22T06:31:43.159104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128227+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:31:45.128227+0000","last_peered":"2024-04-22T06:31:45.128227+0000","last_clean":"2024-04-22T06:31:45.128227+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:31:45.128227+0000","last_undegraded":"2024-04-22T06:31:45.128227+0000","last_fullsized":"2024-04-22T06:31:45.128227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857867+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:31:42.857867+0000","last_peered":"2024-04-22T06:31:42.857867+0000","last_clean":"2024-04-22T06:31:42.857867+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:31:42.857867+0000","last_undegraded":"2024-04-22T06:31:42.857867+0000","last_fullsized":"2024-04-22T06:31:42.857867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129007+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:31:45.129007+0000","last_peered":"2024-04-22T06:31:45.129007+0000","last_clean":"2024-04-22T06:31:45.129007+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:31:45.129007+0000","last_undegraded":"2024-04-22T06:31:45.129007+0000","last_fullsized":"2024-04-22T06:31:45.129007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857776+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:31:42.857776+0000","last_peered":"2024-04-22T06:31:42.857776+0000","last_clean":"2024-04-22T06:31:42.857776+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:31:42.857776+0000","last_undegraded":"2024-04-22T06:31:42.857776+0000","last_fullsized":"2024-04-22T06:31:42.857776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857178+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:31:42.857178+0000","last_peered":"2024-04-22T06:31:42.857178+0000","last_clean":"2024-04-22T06:31:42.857178+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:31:42.857178+0000","last_undegraded":"2024-04-22T06:31:42.857178+0000","last_fullsized":"2024-04-22T06:31:42.857178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128174+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:31:45.128174+0000","last_peered":"2024-04-22T06:31:45.128174+0000","last_clean":"2024-04-22T06:31:45.128174+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:31:45.128174+0000","last_undegraded":"2024-04-22T06:31:45.128174+0000","last_fullsized":"2024-04-22T06:31:45.128174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127735+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:31:45.127735+0000","last_peered":"2024-04-22T06:31:45.127735+0000","last_clean":"2024-04-22T06:31:45.127735+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:31:45.127735+0000","last_undegraded":"2024-04-22T06:31:45.127735+0000","last_fullsized":"2024-04-22T06:31:45.127735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281798+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:31:44.281798+0000","last_peered":"2024-04-22T06:31:44.281798+0000","last_clean":"2024-04-22T06:31:44.281798+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:31:44.281798+0000","last_undegraded":"2024-04-22T06:31:44.281798+0000","last_fullsized":"2024-04-22T06:31:44.281798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856764+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:31:42.856764+0000","last_peered":"2024-04-22T06:31:42.856764+0000","last_clean":"2024-04-22T06:31:42.856764+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:31:42.856764+0000","last_undegraded":"2024-04-22T06:31:42.856764+0000","last_fullsized":"2024-04-22T06:31:42.856764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857039+0000","last_change":"2024-04-22T06:31:41.877804+0000","last_active":"2024-04-22T06:31:42.857039+0000","last_peered":"2024-04-22T06:31:42.857039+0000","last_clean":"2024-04-22T06:31:42.857039+0000","last_became_active":"2024-04-22T06:31:41.877413+0000","last_became_peered":"2024-04-22T06:31:41.877413+0000","last_unstale":"2024-04-22T06:31:42.857039+0000","last_undegraded":"2024-04-22T06:31:42.857039+0000","last_fullsized":"2024-04-22T06:31:42.857039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129073+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:31:45.129073+0000","last_peered":"2024-04-22T06:31:45.129073+0000","last_clean":"2024-04-22T06:31:45.129073+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:31:45.129073+0000","last_undegraded":"2024-04-22T06:31:45.129073+0000","last_fullsized":"2024-04-22T06:31:45.129073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127679+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:31:45.127679+0000","last_peered":"2024-04-22T06:31:45.127679+0000","last_clean":"2024-04-22T06:31:45.127679+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:31:45.127679+0000","last_undegraded":"2024-04-22T06:31:45.127679+0000","last_fullsized":"2024-04-22T06:31:45.127679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858059+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:31:42.858059+0000","last_peered":"2024-04-22T06:31:42.858059+0000","last_clean":"2024-04-22T06:31:42.858059+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:31:42.858059+0000","last_undegraded":"2024-04-22T06:31:42.858059+0000","last_fullsized":"2024-04-22T06:31:42.858059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127969+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:31:45.127969+0000","last_peered":"2024-04-22T06:31:45.127969+0000","last_clean":"2024-04-22T06:31:45.127969+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:31:45.127969+0000","last_undegraded":"2024-04-22T06:31:45.127969+0000","last_fullsized":"2024-04-22T06:31:45.127969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856224+0000","last_change":"2024-04-22T06:31:41.881465+0000","last_active":"2024-04-22T06:31:42.856224+0000","last_peered":"2024-04-22T06:31:42.856224+0000","last_clean":"2024-04-22T06:31:42.856224+0000","last_became_active":"2024-04-22T06:31:41.881079+0000","last_became_peered":"2024-04-22T06:31:41.881079+0000","last_unstale":"2024-04-22T06:31:42.856224+0000","last_undegraded":"2024-04-22T06:31:42.856224+0000","last_fullsized":"2024-04-22T06:31:42.856224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:22.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128905+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:31:45.128905+0000","last_peered":"2024-04-22T06:31:45.128905+0000","last_clean":"2024-04-22T06:31:45.128905+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:31:45.128905+0000","last_undegraded":"2024-04-22T06:31:45.128905+0000","last_fullsized":"2024-04-22T06:31:45.128905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158921+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:31:43.158921+0000","last_peered":"2024-04-22T06:31:43.158921+0000","last_clean":"2024-04-22T06:31:43.158921+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:31:43.158921+0000","last_undegraded":"2024-04-22T06:31:43.158921+0000","last_fullsized":"2024-04-22T06:31:43.158921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128692+0000","last_change":"2024-04-22T06:31:41.878179+0000","last_active":"2024-04-22T06:31:45.128692+0000","last_peered":"2024-04-22T06:31:45.128692+0000","last_clean":"2024-04-22T06:31:45.128692+0000","last_became_active":"2024-04-22T06:31:41.877745+0000","last_became_peered":"2024-04-22T06:31:41.877745+0000","last_unstale":"2024-04-22T06:31:45.128692+0000","last_undegraded":"2024-04-22T06:31:45.128692+0000","last_fullsized":"2024-04-22T06:31:45.128692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:12.198244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856815+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:31:42.856815+0000","last_peered":"2024-04-22T06:31:42.856815+0000","last_clean":"2024-04-22T06:31:42.856815+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:31:42.856815+0000","last_undegraded":"2024-04-22T06:31:42.856815+0000","last_fullsized":"2024-04-22T06:31:42.856815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855964+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:31:42.855964+0000","last_peered":"2024-04-22T06:31:42.855964+0000","last_clean":"2024-04-22T06:31:42.855964+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:31:42.855964+0000","last_undegraded":"2024-04-22T06:31:42.855964+0000","last_fullsized":"2024-04-22T06:31:42.855964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857763+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:31:42.857763+0000","last_peered":"2024-04-22T06:31:42.857763+0000","last_clean":"2024-04-22T06:31:42.857763+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:31:42.857763+0000","last_undegraded":"2024-04-22T06:31:42.857763+0000","last_fullsized":"2024-04-22T06:31:42.857763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127886+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:31:45.127886+0000","last_peered":"2024-04-22T06:31:45.127886+0000","last_clean":"2024-04-22T06:31:45.127886+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:31:45.127886+0000","last_undegraded":"2024-04-22T06:31:45.127886+0000","last_fullsized":"2024-04-22T06:31:45.127886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128913+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:31:45.128913+0000","last_peered":"2024-04-22T06:31:45.128913+0000","last_clean":"2024-04-22T06:31:45.128913+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:31:45.128913+0000","last_undegraded":"2024-04-22T06:31:45.128913+0000","last_fullsized":"2024-04-22T06:31:45.128913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282208+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:31:44.282208+0000","last_peered":"2024-04-22T06:31:44.282208+0000","last_clean":"2024-04-22T06:31:44.282208+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:31:44.282208+0000","last_undegraded":"2024-04-22T06:31:44.282208+0000","last_fullsized":"2024-04-22T06:31:44.282208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858025+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:31:42.858025+0000","last_peered":"2024-04-22T06:31:42.858025+0000","last_clean":"2024-04-22T06:31:42.858025+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:31:42.858025+0000","last_undegraded":"2024-04-22T06:31:42.858025+0000","last_fullsized":"2024-04-22T06:31:42.858025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128390+0000","last_change":"2024-04-22T06:31:37.849680+0000","last_active":"2024-04-22T06:31:45.128390+0000","last_peered":"2024-04-22T06:31:45.128390+0000","last_clean":"2024-04-22T06:31:45.128390+0000","last_became_active":"2024-04-22T06:31:37.849196+0000","last_became_peered":"2024-04-22T06:31:37.849196+0000","last_unstale":"2024-04-22T06:31:45.128390+0000","last_undegraded":"2024-04-22T06:31:45.128390+0000","last_fullsized":"2024-04-22T06:31:45.128390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:16:40.650719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856559+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:31:42.856559+0000","last_peered":"2024-04-22T06:31:42.856559+0000","last_clean":"2024-04-22T06:31:42.856559+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:31:42.856559+0000","last_undegraded":"2024-04-22T06:31:42.856559+0000","last_fullsized":"2024-04-22T06:31:42.856559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128430+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:31:45.128430+0000","last_peered":"2024-04-22T06:31:45.128430+0000","last_clean":"2024-04-22T06:31:45.128430+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:31:45.128430+0000","last_undegraded":"2024-04-22T06:31:45.128430+0000","last_fullsized":"2024-04-22T06:31:45.128430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857712+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:31:42.857712+0000","last_peered":"2024-04-22T06:31:42.857712+0000","last_clean":"2024-04-22T06:31:42.857712+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:31:42.857712+0000","last_undegraded":"2024-04-22T06:31:42.857712+0000","last_fullsized":"2024-04-22T06:31:42.857712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127630+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:31:45.127630+0000","last_peered":"2024-04-22T06:31:45.127630+0000","last_clean":"2024-04-22T06:31:45.127630+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:31:45.127630+0000","last_undegraded":"2024-04-22T06:31:45.127630+0000","last_fullsized":"2024-04-22T06:31:45.127630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857005+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:31:42.857005+0000","last_peered":"2024-04-22T06:31:42.857005+0000","last_clean":"2024-04-22T06:31:42.857005+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:31:42.857005+0000","last_undegraded":"2024-04-22T06:31:42.857005+0000","last_fullsized":"2024-04-22T06:31:42.857005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025893+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:31:45.025893+0000","last_peered":"2024-04-22T06:31:45.025893+0000","last_clean":"2024-04-22T06:31:45.025893+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:31:45.025893+0000","last_undegraded":"2024-04-22T06:31:45.025893+0000","last_fullsized":"2024-04-22T06:31:45.025893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856259+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:31:42.856259+0000","last_peered":"2024-04-22T06:31:42.856259+0000","last_clean":"2024-04-22T06:31:42.856259+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:31:42.856259+0000","last_undegraded":"2024-04-22T06:31:42.856259+0000","last_fullsized":"2024-04-22T06:31:42.856259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858268+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:31:42.858268+0000","last_peered":"2024-04-22T06:31:42.858268+0000","last_clean":"2024-04-22T06:31:42.858268+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:31:42.858268+0000","last_undegraded":"2024-04-22T06:31:42.858268+0000","last_fullsized":"2024-04-22T06:31:42.858268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856449+0000","last_change":"2024-04-22T06:31:37.851894+0000","last_active":"2024-04-22T06:31:42.856449+0000","last_peered":"2024-04-22T06:31:42.856449+0000","last_clean":"2024-04-22T06:31:42.856449+0000","last_became_active":"2024-04-22T06:31:37.851595+0000","last_became_peered":"2024-04-22T06:31:37.851595+0000","last_unstale":"2024-04-22T06:31:42.856449+0000","last_undegraded":"2024-04-22T06:31:42.856449+0000","last_fullsized":"2024-04-22T06:31:42.856449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:06.634700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281858+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:31:44.281858+0000","last_peered":"2024-04-22T06:31:44.281858+0000","last_clean":"2024-04-22T06:31:44.281858+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:31:44.281858+0000","last_undegraded":"2024-04-22T06:31:44.281858+0000","last_fullsized":"2024-04-22T06:31:44.281858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127492+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:31:45.127492+0000","last_peered":"2024-04-22T06:31:45.127492+0000","last_clean":"2024-04-22T06:31:45.127492+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:31:45.127492+0000","last_undegraded":"2024-04-22T06:31:45.127492+0000","last_fullsized":"2024-04-22T06:31:45.127492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128719+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:31:45.128719+0000","last_peered":"2024-04-22T06:31:45.128719+0000","last_clean":"2024-04-22T06:31:45.128719+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:31:45.128719+0000","last_undegraded":"2024-04-22T06:31:45.128719+0000","last_fullsized":"2024-04-22T06:31:45.128719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159105+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:31:43.159105+0000","last_peered":"2024-04-22T06:31:43.159105+0000","last_clean":"2024-04-22T06:31:43.159105+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:31:43.159105+0000","last_undegraded":"2024-04-22T06:31:43.159105+0000","last_fullsized":"2024-04-22T06:31:43.159105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858147+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:31:42.858147+0000","last_peered":"2024-04-22T06:31:42.858147+0000","last_clean":"2024-04-22T06:31:42.858147+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:31:42.858147+0000","last_undegraded":"2024-04-22T06:31:42.858147+0000","last_fullsized":"2024-04-22T06:31:42.858147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857952+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:31:42.857952+0000","last_peered":"2024-04-22T06:31:42.857952+0000","last_clean":"2024-04-22T06:31:42.857952+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:31:42.857952+0000","last_undegraded":"2024-04-22T06:31:42.857952+0000","last_fullsized":"2024-04-22T06:31:42.857952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025959+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:31:45.025959+0000","last_peered":"2024-04-22T06:31:45.025959+0000","last_clean":"2024-04-22T06:31:45.025959+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:31:45.025959+0000","last_undegraded":"2024-04-22T06:31:45.025959+0000","last_fullsized":"2024-04-22T06:31:45.025959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128919+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:31:45.128919+0000","last_peered":"2024-04-22T06:31:45.128919+0000","last_clean":"2024-04-22T06:31:45.128919+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:31:45.128919+0000","last_undegraded":"2024-04-22T06:31:45.128919+0000","last_fullsized":"2024-04-22T06:31:45.128919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025381+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:31:45.025381+0000","last_peered":"2024-04-22T06:31:45.025381+0000","last_clean":"2024-04-22T06:31:45.025381+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:31:45.025381+0000","last_undegraded":"2024-04-22T06:31:45.025381+0000","last_fullsized":"2024-04-22T06:31:45.025381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857644+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:31:42.857644+0000","last_peered":"2024-04-22T06:31:42.857644+0000","last_clean":"2024-04-22T06:31:42.857644+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:31:42.857644+0000","last_undegraded":"2024-04-22T06:31:42.857644+0000","last_fullsized":"2024-04-22T06:31:42.857644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025479+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:31:45.025479+0000","last_peered":"2024-04-22T06:31:45.025479+0000","last_clean":"2024-04-22T06:31:45.025479+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:31:45.025479+0000","last_undegraded":"2024-04-22T06:31:45.025479+0000","last_fullsized":"2024-04-22T06:31:45.025479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858020+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:31:42.858020+0000","last_peered":"2024-04-22T06:31:42.858020+0000","last_clean":"2024-04-22T06:31:42.858020+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:31:42.858020+0000","last_undegraded":"2024-04-22T06:31:42.858020+0000","last_fullsized":"2024-04-22T06:31:42.858020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127596+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:31:45.127596+0000","last_peered":"2024-04-22T06:31:45.127596+0000","last_clean":"2024-04-22T06:31:45.127596+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:31:45.127596+0000","last_undegraded":"2024-04-22T06:31:45.127596+0000","last_fullsized":"2024-04-22T06:31:45.127596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282236+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:31:44.282236+0000","last_peered":"2024-04-22T06:31:44.282236+0000","last_clean":"2024-04-22T06:31:44.282236+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:31:44.282236+0000","last_undegraded":"2024-04-22T06:31:44.282236+0000","last_fullsized":"2024-04-22T06:31:44.282236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025855+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:31:45.025855+0000","last_peered":"2024-04-22T06:31:45.025855+0000","last_clean":"2024-04-22T06:31:45.025855+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:31:45.025855+0000","last_undegraded":"2024-04-22T06:31:45.025855+0000","last_fullsized":"2024-04-22T06:31:45.025855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:32:05.863 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:32:05.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.996+0000 7f5c2e4f2640 1 Processor -- start 2024-04-22T06:32:05.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.996+0000 7f5c2e4f2640 1 -- start start 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c2e4f2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c28155230 0x7f5c28071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c2e4f2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2806d540 con 0x7f5c2815b030 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c2e4f2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2815b4c0 con 0x7f5c280cb330 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c2e4f2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5c280c9a80 con 0x7f5c28155230 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c277fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5c2815b030 0x7f5c2815ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45542/0 (socket says 172.21.15.113:45542) 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c277fe640 1 -- 172.21.15.113:0/3547107945 learned_addr learned my addr 172.21.15.113:0/3547107945 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c27fff640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c28155230 0x7f5c28071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379433427 0 0) 0x7f5c2806d540 con 0x7f5c2815b030 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c10003520 con 0x7f5c2815b030 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3506385895 0 0) 0x7f5c10003520 con 0x7f5c2815b030 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c28155230 msgr2=0x7f5c28071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:05.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c28155230 0x7f5c28071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 >> v1:172.21.15.145:6789/0 conn(0x7f5c280cb330 legacy=0x7f5c281659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2815b7a0 con 0x7f5c2815b030 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f5c1c001670 con 0x7f5c2815b030 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 >> v1:172.21.15.113:6789/0 conn(0x7f5c2815b030 legacy=0x7f5c2815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c28155230 0x7f5c100039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c10003f60 0x7f5c10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.997+0000 7f5c26ffd640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10004d40 0x7f5c100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1000ba70 con 0x7f5c10003f60 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1000bc20 con 0x7f5c10004d40 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1000be20 con 0x7f5c28155230 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c277fe640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c10003f60 0x7f5c10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c27fff640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c28155230 0x7f5c100039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c2ca8f640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10004d40 0x7f5c100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c277fe640 1 -- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c28155230 msgr2=0x7f5c100039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c277fe640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c28155230 0x7f5c100039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c277fe640 1 -- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10004d40 msgr2=0x7f5c100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c277fe640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10004d40 0x7f5c100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.998+0000 7f5c277fe640 1 -- 172.21.15.113:0/3547107945 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c10003520 con 0x7f5c10003f60 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c277fe640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c10003f60 0x7f5c10004800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c240 tx=0x7f5c10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc8dd323b4137b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007d10 con 0x7f5c10003f60 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c030070 con 0x7f5c10003f60 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c26ffd640 1 -- 172.21.15.113:0/3547107945 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c02cdc0 con 0x7f5c10003f60 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/3547107945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c10003f60 msgr2=0x7f5c10004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c2e4f2640 1 --2- 172.21.15.113:0/3547107945 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c10003f60 0x7f5c10004800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c240 tx=0x7f5c10005830 comp rx=0 tx=0).stop 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c2ca8f640 1 -- 172.21.15.113:0/3547107945 reap_dead start 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/3547107945 shutdown_connections 2024-04-22T06:32:06.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/3547107945 >> 172.21.15.113:0/3547107945 conn(0x7f5c28074f30 msgr2=0x7f5c28075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:06.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/3547107945 shutdown_connections 2024-04-22T06:32:06.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:05.999+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/3547107945 wait complete. 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.000+0000 7f5c2e4f2640 1 Processor -- start 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c2e4f2640 1 -- start start 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c2e4f2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c10003f60 0x7f5c28152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c2e4f2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2814e950 0x7f5c280ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c2e4f2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c28153390 0x7f5c28153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c2e4f2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2815e7c0 con 0x7f5c2814e950 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c2e4f2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2815bd60 con 0x7f5c28153390 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c2e4f2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2815f3f0 con 0x7f5c10003f60 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2814e950 0x7f5c280ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2814e950 0x7f5c280ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33782/0 (socket says 172.21.15.113:33782) 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.001+0000 7f5c277fe640 1 -- 172.21.15.113:0/806318347 learned_addr learned my addr 172.21.15.113:0/806318347 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c2ca8f640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c28153390 0x7f5c28153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c27fff640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c10003f60 0x7f5c28152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c277fe640 1 -- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c10003f60 msgr2=0x7f5c28152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c277fe640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c10003f60 0x7f5c28152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c277fe640 1 -- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c28153390 msgr2=0x7f5c28153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c277fe640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c28153390 0x7f5c28153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c277fe640 1 -- 172.21.15.113:0/806318347 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c28153d50 con 0x7f5c2814e950 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c2ca8f640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c28153390 0x7f5c28153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c277fe640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2814e950 0x7f5c280ced70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c02c570 tx=0x7f5c2815b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c24ff9640 1 -- 172.21.15.113:0/806318347 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c045070 con 0x7f5c2814e950 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c24ff9640 1 -- 172.21.15.113:0/806318347 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c004bf0 con 0x7f5c2814e950 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2814c670 con 0x7f5c2814e950 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c24ff9640 1 -- 172.21.15.113:0/806318347 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007d10 con 0x7f5c2814e950 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.002+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2814cc30 con 0x7f5c2814e950 2024-04-22T06:32:06.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.003+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c28068e40 con 0x7f5c2814e950 2024-04-22T06:32:06.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.004+0000 7f5c24ff9640 1 -- 172.21.15.113:0/806318347 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c1c007070 con 0x7f5c2814e950 2024-04-22T06:32:06.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.004+0000 7f5c24ff9640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c1406c8f0 0x7f5c1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.004+0000 7f5c24ff9640 1 -- 172.21.15.113:0/806318347 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5c1c0acea0 con 0x7f5c2814e950 2024-04-22T06:32:06.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.004+0000 7f5c27fff640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c1406c8f0 0x7f5c1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.004+0000 7f5c27fff640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c1406c8f0 0x7f5c1406edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009ae0 tx=0x7f5c18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.008+0000 7f5c24ff9640 1 -- 172.21.15.113:0/806318347 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5c28153d50 con 0x7f5c2814e950 2024-04-22T06:32:06.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.178+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c2814c410 con 0x7f5c1406c8f0 2024-04-22T06:32:06.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.185+0000 7f5c24ff9640 1 -- 172.21.15.113:0/806318347 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f5c18009730 con 0x7f5c1406c8f0 2024-04-22T06:32:06.188 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:06.190 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:32:06.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c1406c8f0 msgr2=0x7f5c1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c1406c8f0 0x7f5c1406edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009ae0 tx=0x7f5c18008040 comp rx=0 tx=0).stop 2024-04-22T06:32:06.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2814e950 msgr2=0x7f5c280ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2814e950 0x7f5c280ced70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c02c570 tx=0x7f5c2815b690 comp rx=0 tx=0).stop 2024-04-22T06:32:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 shutdown_connections 2024-04-22T06:32:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c28153390 0x7f5c28153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c1406c8f0 0x7f5c1406edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c2814e950 0x7f5c280ced70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 --2- 172.21.15.113:0/806318347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c10003f60 0x7f5c28152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 >> 172.21.15.113:0/806318347 conn(0x7f5c28074f30 msgr2=0x7f5c28071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 shutdown_connections 2024-04-22T06:32:06.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.189+0000 7f5c2e4f2640 1 -- 172.21.15.113:0/806318347 wait complete. 2024-04-22T06:32:06.199 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-22T06:32:04.974639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003224"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128312+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:31:45.128312+0000","last_peered":"2024-04-22T06:31:45.128312+0000","last_clean":"2024-04-22T06:31:45.128312+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:31:45.128312+0000","last_undegraded":"2024-04-22T06:31:45.128312+0000","last_fullsized":"2024-04-22T06:31:45.128312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128419+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:31:45.128419+0000","last_peered":"2024-04-22T06:31:45.128419+0000","last_clean":"2024-04-22T06:31:45.128419+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:31:45.128419+0000","last_undegraded":"2024-04-22T06:31:45.128419+0000","last_fullsized":"2024-04-22T06:31:45.128419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128781+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:31:45.128781+0000","last_peered":"2024-04-22T06:31:45.128781+0000","last_clean":"2024-04-22T06:31:45.128781+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:31:45.128781+0000","last_undegraded":"2024-04-22T06:31:45.128781+0000","last_fullsized":"2024-04-22T06:31:45.128781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128602+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:31:45.128602+0000","last_peered":"2024-04-22T06:31:45.128602+0000","last_clean":"2024-04-22T06:31:45.128602+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:31:45.128602+0000","last_undegraded":"2024-04-22T06:31:45.128602+0000","last_fullsized":"2024-04-22T06:31:45.128602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128070+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:31:45.128070+0000","last_peered":"2024-04-22T06:31:45.128070+0000","last_clean":"2024-04-22T06:31:45.128070+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:31:45.128070+0000","last_undegraded":"2024-04-22T06:31:45.128070+0000","last_fullsized":"2024-04-22T06:31:45.128070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158824+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:31:43.158824+0000","last_peered":"2024-04-22T06:31:43.158824+0000","last_clean":"2024-04-22T06:31:43.158824+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:31:43.158824+0000","last_undegraded":"2024-04-22T06:31:43.158824+0000","last_fullsized":"2024-04-22T06:31:43.158824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025053+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:31:45.025053+0000","last_peered":"2024-04-22T06:31:45.025053+0000","last_clean":"2024-04-22T06:31:45.025053+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:31:45.025053+0000","last_undegraded":"2024-04-22T06:31:45.025053+0000","last_fullsized":"2024-04-22T06:31:45.025053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858125+0000","last_change":"2024-04-22T06:31:37.850283+0000","last_active":"2024-04-22T06:31:42.858125+0000","last_peered":"2024-04-22T06:31:42.858125+0000","last_clean":"2024-04-22T06:31:42.858125+0000","last_became_active":"2024-04-22T06:31:37.849975+0000","last_became_peered":"2024-04-22T06:31:37.849975+0000","last_unstale":"2024-04-22T06:31:42.858125+0000","last_undegraded":"2024-04-22T06:31:42.858125+0000","last_fullsized":"2024-04-22T06:31:42.858125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:50.592700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158818+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:31:43.158818+0000","last_peered":"2024-04-22T06:31:43.158818+0000","last_clean":"2024-04-22T06:31:43.158818+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:31:43.158818+0000","last_undegraded":"2024-04-22T06:31:43.158818+0000","last_fullsized":"2024-04-22T06:31:43.158818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025025+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:31:45.025025+0000","last_peered":"2024-04-22T06:31:45.025025+0000","last_clean":"2024-04-22T06:31:45.025025+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:31:45.025025+0000","last_undegraded":"2024-04-22T06:31:45.025025+0000","last_fullsized":"2024-04-22T06:31:45.025025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857546+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:31:42.857546+0000","last_peered":"2024-04-22T06:31:42.857546+0000","last_clean":"2024-04-22T06:31:42.857546+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:31:42.857546+0000","last_undegraded":"2024-04-22T06:31:42.857546+0000","last_fullsized":"2024-04-22T06:31:42.857546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158709+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:31:43.158709+0000","last_peered":"2024-04-22T06:31:43.158709+0000","last_clean":"2024-04-22T06:31:43.158709+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:31:43.158709+0000","last_undegraded":"2024-04-22T06:31:43.158709+0000","last_fullsized":"2024-04-22T06:31:43.158709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857807+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:31:42.857807+0000","last_peered":"2024-04-22T06:31:42.857807+0000","last_clean":"2024-04-22T06:31:42.857807+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:31:42.857807+0000","last_undegraded":"2024-04-22T06:31:42.857807+0000","last_fullsized":"2024-04-22T06:31:42.857807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025023+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:31:45.025023+0000","last_peered":"2024-04-22T06:31:45.025023+0000","last_clean":"2024-04-22T06:31:45.025023+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:31:45.025023+0000","last_undegraded":"2024-04-22T06:31:45.025023+0000","last_fullsized":"2024-04-22T06:31:45.025023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159258+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:31:43.159258+0000","last_peered":"2024-04-22T06:31:43.159258+0000","last_clean":"2024-04-22T06:31:43.159258+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:31:43.159258+0000","last_undegraded":"2024-04-22T06:31:43.159258+0000","last_fullsized":"2024-04-22T06:31:43.159258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128813+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:31:45.128813+0000","last_peered":"2024-04-22T06:31:45.128813+0000","last_clean":"2024-04-22T06:31:45.128813+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:31:45.128813+0000","last_undegraded":"2024-04-22T06:31:45.128813+0000","last_fullsized":"2024-04-22T06:31:45.128813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282227+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:31:44.282227+0000","last_peered":"2024-04-22T06:31:44.282227+0000","last_clean":"2024-04-22T06:31:44.282227+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:31:44.282227+0000","last_undegraded":"2024-04-22T06:31:44.282227+0000","last_fullsized":"2024-04-22T06:31:44.282227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159037+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:31:43.159037+0000","last_peered":"2024-04-22T06:31:43.159037+0000","last_clean":"2024-04-22T06:31:43.159037+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:31:43.159037+0000","last_undegraded":"2024-04-22T06:31:43.159037+0000","last_fullsized":"2024-04-22T06:31:43.159037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129077+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:31:45.129077+0000","last_peered":"2024-04-22T06:31:45.129077+0000","last_clean":"2024-04-22T06:31:45.129077+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:31:45.129077+0000","last_undegraded":"2024-04-22T06:31:45.129077+0000","last_fullsized":"2024-04-22T06:31:45.129077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281957+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:31:44.281957+0000","last_peered":"2024-04-22T06:31:44.281957+0000","last_clean":"2024-04-22T06:31:44.281957+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:31:44.281957+0000","last_undegraded":"2024-04-22T06:31:44.281957+0000","last_fullsized":"2024-04-22T06:31:44.281957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282535+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:31:44.282535+0000","last_peered":"2024-04-22T06:31:44.282535+0000","last_clean":"2024-04-22T06:31:44.282535+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:31:44.282535+0000","last_undegraded":"2024-04-22T06:31:44.282535+0000","last_fullsized":"2024-04-22T06:31:44.282535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158989+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:31:43.158989+0000","last_peered":"2024-04-22T06:31:43.158989+0000","last_clean":"2024-04-22T06:31:43.158989+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:31:43.158989+0000","last_undegraded":"2024-04-22T06:31:43.158989+0000","last_fullsized":"2024-04-22T06:31:43.158989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025280+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:31:45.025280+0000","last_peered":"2024-04-22T06:31:45.025280+0000","last_clean":"2024-04-22T06:31:45.025280+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:31:45.025280+0000","last_undegraded":"2024-04-22T06:31:45.025280+0000","last_fullsized":"2024-04-22T06:31:45.025280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159260+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:31:43.159260+0000","last_peered":"2024-04-22T06:31:43.159260+0000","last_clean":"2024-04-22T06:31:43.159260+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:31:43.159260+0000","last_undegraded":"2024-04-22T06:31:43.159260+0000","last_fullsized":"2024-04-22T06:31:43.159260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127898+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:31:45.127898+0000","last_peered":"2024-04-22T06:31:45.127898+0000","last_clean":"2024-04-22T06:31:45.127898+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:31:45.127898+0000","last_undegraded":"2024-04-22T06:31:45.127898+0000","last_fullsized":"2024-04-22T06:31:45.127898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857376+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:31:42.857376+0000","last_peered":"2024-04-22T06:31:42.857376+0000","last_clean":"2024-04-22T06:31:42.857376+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:31:42.857376+0000","last_undegraded":"2024-04-22T06:31:42.857376+0000","last_fullsized":"2024-04-22T06:31:42.857376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159079+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:31:43.159079+0000","last_peered":"2024-04-22T06:31:43.159079+0000","last_clean":"2024-04-22T06:31:43.159079+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:31:43.159079+0000","last_undegraded":"2024-04-22T06:31:43.159079+0000","last_fullsized":"2024-04-22T06:31:43.159079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128503+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:31:45.128503+0000","last_peered":"2024-04-22T06:31:45.128503+0000","last_clean":"2024-04-22T06:31:45.128503+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:31:45.128503+0000","last_undegraded":"2024-04-22T06:31:45.128503+0000","last_fullsized":"2024-04-22T06:31:45.128503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282339+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:31:44.282339+0000","last_peered":"2024-04-22T06:31:44.282339+0000","last_clean":"2024-04-22T06:31:44.282339+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:31:44.282339+0000","last_undegraded":"2024-04-22T06:31:44.282339+0000","last_fullsized":"2024-04-22T06:31:44.282339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129012+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:31:45.129012+0000","last_peered":"2024-04-22T06:31:45.129012+0000","last_clean":"2024-04-22T06:31:45.129012+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:31:45.129012+0000","last_undegraded":"2024-04-22T06:31:45.129012+0000","last_fullsized":"2024-04-22T06:31:45.129012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282322+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:31:44.282322+0000","last_peered":"2024-04-22T06:31:44.282322+0000","last_clean":"2024-04-22T06:31:44.282322+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:31:44.282322+0000","last_undegraded":"2024-04-22T06:31:44.282322+0000","last_fullsized":"2024-04-22T06:31:44.282322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025900+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:31:45.025900+0000","last_peered":"2024-04-22T06:31:45.025900+0000","last_clean":"2024-04-22T06:31:45.025900+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:31:45.025900+0000","last_undegraded":"2024-04-22T06:31:45.025900+0000","last_fullsized":"2024-04-22T06:31:45.025900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127630+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:31:45.127630+0000","last_peered":"2024-04-22T06:31:45.127630+0000","last_clean":"2024-04-22T06:31:45.127630+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:31:45.127630+0000","last_undegraded":"2024-04-22T06:31:45.127630+0000","last_fullsized":"2024-04-22T06:31:45.127630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857639+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:31:42.857639+0000","last_peered":"2024-04-22T06:31:42.857639+0000","last_clean":"2024-04-22T06:31:42.857639+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:31:42.857639+0000","last_undegraded":"2024-04-22T06:31:42.857639+0000","last_fullsized":"2024-04-22T06:31:42.857639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282396+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:31:44.282396+0000","last_peered":"2024-04-22T06:31:44.282396+0000","last_clean":"2024-04-22T06:31:44.282396+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:31:44.282396+0000","last_undegraded":"2024-04-22T06:31:44.282396+0000","last_fullsized":"2024-04-22T06:31:44.282396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282029+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:31:44.282029+0000","last_peered":"2024-04-22T06:31:44.282029+0000","last_clean":"2024-04-22T06:31:44.282029+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:31:44.282029+0000","last_undegraded":"2024-04-22T06:31:44.282029+0000","last_fullsized":"2024-04-22T06:31:44.282029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159184+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:31:43.159184+0000","last_peered":"2024-04-22T06:31:43.159184+0000","last_clean":"2024-04-22T06:31:43.159184+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:31:43.159184+0000","last_undegraded":"2024-04-22T06:31:43.159184+0000","last_fullsized":"2024-04-22T06:31:43.159184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857873+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:31:42.857873+0000","last_peered":"2024-04-22T06:31:42.857873+0000","last_clean":"2024-04-22T06:31:42.857873+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:31:42.857873+0000","last_undegraded":"2024-04-22T06:31:42.857873+0000","last_fullsized":"2024-04-22T06:31:42.857873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282276+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:31:44.282276+0000","last_peered":"2024-04-22T06:31:44.282276+0000","last_clean":"2024-04-22T06:31:44.282276+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:31:44.282276+0000","last_undegraded":"2024-04-22T06:31:44.282276+0000","last_fullsized":"2024-04-22T06:31:44.282276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281878+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:31:44.281878+0000","last_peered":"2024-04-22T06:31:44.281878+0000","last_clean":"2024-04-22T06:31:44.281878+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:31:44.281878+0000","last_undegraded":"2024-04-22T06:31:44.281878+0000","last_fullsized":"2024-04-22T06:31:44.281878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855934+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:31:42.855934+0000","last_peered":"2024-04-22T06:31:42.855934+0000","last_clean":"2024-04-22T06:31:42.855934+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:31:42.855934+0000","last_undegraded":"2024-04-22T06:31:42.855934+0000","last_fullsized":"2024-04-22T06:31:42.855934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282665+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:31:44.282665+0000","last_peered":"2024-04-22T06:31:44.282665+0000","last_clean":"2024-04-22T06:31:44.282665+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:31:44.282665+0000","last_undegraded":"2024-04-22T06:31:44.282665+0000","last_fullsized":"2024-04-22T06:31:44.282665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127311+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:31:45.127311+0000","last_peered":"2024-04-22T06:31:45.127311+0000","last_clean":"2024-04-22T06:31:45.127311+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:31:45.127311+0000","last_undegraded":"2024-04-22T06:31:45.127311+0000","last_fullsized":"2024-04-22T06:31:45.127311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025001+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:31:45.025001+0000","last_peered":"2024-04-22T06:31:45.025001+0000","last_clean":"2024-04-22T06:31:45.025001+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:31:45.025001+0000","last_undegraded":"2024-04-22T06:31:45.025001+0000","last_fullsized":"2024-04-22T06:31:45.025001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127835+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:31:45.127835+0000","last_peered":"2024-04-22T06:31:45.127835+0000","last_clean":"2024-04-22T06:31:45.127835+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:31:45.127835+0000","last_undegraded":"2024-04-22T06:31:45.127835+0000","last_fullsized":"2024-04-22T06:31:45.127835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128116+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:31:45.128116+0000","last_peered":"2024-04-22T06:31:45.128116+0000","last_clean":"2024-04-22T06:31:45.128116+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:31:45.128116+0000","last_undegraded":"2024-04-22T06:31:45.128116+0000","last_fullsized":"2024-04-22T06:31:45.128116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857169+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:31:42.857169+0000","last_peered":"2024-04-22T06:31:42.857169+0000","last_clean":"2024-04-22T06:31:42.857169+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:31:42.857169+0000","last_undegraded":"2024-04-22T06:31:42.857169+0000","last_fullsized":"2024-04-22T06:31:42.857169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025414+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:31:45.025414+0000","last_peered":"2024-04-22T06:31:45.025414+0000","last_clean":"2024-04-22T06:31:45.025414+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:31:45.025414+0000","last_undegraded":"2024-04-22T06:31:45.025414+0000","last_fullsized":"2024-04-22T06:31:45.025414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858050+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:31:42.858050+0000","last_peered":"2024-04-22T06:31:42.858050+0000","last_clean":"2024-04-22T06:31:42.858050+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:31:42.858050+0000","last_undegraded":"2024-04-22T06:31:42.858050+0000","last_fullsized":"2024-04-22T06:31:42.858050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025766+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:31:45.025766+0000","last_peered":"2024-04-22T06:31:45.025766+0000","last_clean":"2024-04-22T06:31:45.025766+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:31:45.025766+0000","last_undegraded":"2024-04-22T06:31:45.025766+0000","last_fullsized":"2024-04-22T06:31:45.025766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856286+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:31:42.856286+0000","last_peered":"2024-04-22T06:31:42.856286+0000","last_clean":"2024-04-22T06:31:42.856286+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:31:42.856286+0000","last_undegraded":"2024-04-22T06:31:42.856286+0000","last_fullsized":"2024-04-22T06:31:42.856286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857752+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:31:42.857752+0000","last_peered":"2024-04-22T06:31:42.857752+0000","last_clean":"2024-04-22T06:31:42.857752+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:31:42.857752+0000","last_undegraded":"2024-04-22T06:31:42.857752+0000","last_fullsized":"2024-04-22T06:31:42.857752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858226+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:31:42.858226+0000","last_peered":"2024-04-22T06:31:42.858226+0000","last_clean":"2024-04-22T06:31:42.858226+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:31:42.858226+0000","last_undegraded":"2024-04-22T06:31:42.858226+0000","last_fullsized":"2024-04-22T06:31:42.858226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282329+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:31:44.282329+0000","last_peered":"2024-04-22T06:31:44.282329+0000","last_clean":"2024-04-22T06:31:44.282329+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:31:44.282329+0000","last_undegraded":"2024-04-22T06:31:44.282329+0000","last_fullsized":"2024-04-22T06:31:44.282329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127795+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:31:45.127795+0000","last_peered":"2024-04-22T06:31:45.127795+0000","last_clean":"2024-04-22T06:31:45.127795+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:31:45.127795+0000","last_undegraded":"2024-04-22T06:31:45.127795+0000","last_fullsized":"2024-04-22T06:31:45.127795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.026029+0000","last_change":"2024-04-22T06:31:37.854957+0000","last_active":"2024-04-22T06:31:45.026029+0000","last_peered":"2024-04-22T06:31:45.026029+0000","last_clean":"2024-04-22T06:31:45.026029+0000","last_became_active":"2024-04-22T06:31:37.852899+0000","last_became_peered":"2024-04-22T06:31:37.852899+0000","last_unstale":"2024-04-22T06:31:45.026029+0000","last_undegraded":"2024-04-22T06:31:45.026029+0000","last_fullsized":"2024-04-22T06:31:45.026029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:30:53.163996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856291+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:31:42.856291+0000","last_peered":"2024-04-22T06:31:42.856291+0000","last_clean":"2024-04-22T06:31:42.856291+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:31:42.856291+0000","last_undegraded":"2024-04-22T06:31:42.856291+0000","last_fullsized":"2024-04-22T06:31:42.856291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856491+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:31:42.856491+0000","last_peered":"2024-04-22T06:31:42.856491+0000","last_clean":"2024-04-22T06:31:42.856491+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:31:42.856491+0000","last_undegraded":"2024-04-22T06:31:42.856491+0000","last_fullsized":"2024-04-22T06:31:42.856491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025748+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:31:45.025748+0000","last_peered":"2024-04-22T06:31:45.025748+0000","last_clean":"2024-04-22T06:31:45.025748+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:31:45.025748+0000","last_undegraded":"2024-04-22T06:31:45.025748+0000","last_fullsized":"2024-04-22T06:31:45.025748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159360+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:31:43.159360+0000","last_peered":"2024-04-22T06:31:43.159360+0000","last_clean":"2024-04-22T06:31:43.159360+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:31:43.159360+0000","last_undegraded":"2024-04-22T06:31:43.159360+0000","last_fullsized":"2024-04-22T06:31:43.159360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158599+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:31:43.158599+0000","last_peered":"2024-04-22T06:31:43.158599+0000","last_clean":"2024-04-22T06:31:43.158599+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:31:43.158599+0000","last_undegraded":"2024-04-22T06:31:43.158599+0000","last_fullsized":"2024-04-22T06:31:43.158599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025578+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:31:45.025578+0000","last_peered":"2024-04-22T06:31:45.025578+0000","last_clean":"2024-04-22T06:31:45.025578+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:31:45.025578+0000","last_undegraded":"2024-04-22T06:31:45.025578+0000","last_fullsized":"2024-04-22T06:31:45.025578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855847+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:31:42.855847+0000","last_peered":"2024-04-22T06:31:42.855847+0000","last_clean":"2024-04-22T06:31:42.855847+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:31:42.855847+0000","last_undegraded":"2024-04-22T06:31:42.855847+0000","last_fullsized":"2024-04-22T06:31:42.855847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127692+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:31:45.127692+0000","last_peered":"2024-04-22T06:31:45.127692+0000","last_clean":"2024-04-22T06:31:45.127692+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:31:45.127692+0000","last_undegraded":"2024-04-22T06:31:45.127692+0000","last_fullsized":"2024-04-22T06:31:45.127692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857027+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:31:42.857027+0000","last_peered":"2024-04-22T06:31:42.857027+0000","last_clean":"2024-04-22T06:31:42.857027+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:31:42.857027+0000","last_undegraded":"2024-04-22T06:31:42.857027+0000","last_fullsized":"2024-04-22T06:31:42.857027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857459+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:31:42.857459+0000","last_peered":"2024-04-22T06:31:42.857459+0000","last_clean":"2024-04-22T06:31:42.857459+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:31:42.857459+0000","last_undegraded":"2024-04-22T06:31:42.857459+0000","last_fullsized":"2024-04-22T06:31:42.857459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128617+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:31:45.128617+0000","last_peered":"2024-04-22T06:31:45.128617+0000","last_clean":"2024-04-22T06:31:45.128617+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:31:45.128617+0000","last_undegraded":"2024-04-22T06:31:45.128617+0000","last_fullsized":"2024-04-22T06:31:45.128617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025635+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:31:45.025635+0000","last_peered":"2024-04-22T06:31:45.025635+0000","last_clean":"2024-04-22T06:31:45.025635+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:31:45.025635+0000","last_undegraded":"2024-04-22T06:31:45.025635+0000","last_fullsized":"2024-04-22T06:31:45.025635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857798+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:31:42.857798+0000","last_peered":"2024-04-22T06:31:42.857798+0000","last_clean":"2024-04-22T06:31:42.857798+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:31:42.857798+0000","last_undegraded":"2024-04-22T06:31:42.857798+0000","last_fullsized":"2024-04-22T06:31:42.857798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128726+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:31:45.128726+0000","last_peered":"2024-04-22T06:31:45.128726+0000","last_clean":"2024-04-22T06:31:45.128726+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:31:45.128726+0000","last_undegraded":"2024-04-22T06:31:45.128726+0000","last_fullsized":"2024-04-22T06:31:45.128726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127522+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:31:45.127522+0000","last_peered":"2024-04-22T06:31:45.127522+0000","last_clean":"2024-04-22T06:31:45.127522+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:31:45.127522+0000","last_undegraded":"2024-04-22T06:31:45.127522+0000","last_fullsized":"2024-04-22T06:31:45.127522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127064+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:31:45.127064+0000","last_peered":"2024-04-22T06:31:45.127064+0000","last_clean":"2024-04-22T06:31:45.127064+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:31:45.127064+0000","last_undegraded":"2024-04-22T06:31:45.127064+0000","last_fullsized":"2024-04-22T06:31:45.127064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857582+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:31:42.857582+0000","last_peered":"2024-04-22T06:31:42.857582+0000","last_clean":"2024-04-22T06:31:42.857582+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:31:42.857582+0000","last_undegraded":"2024-04-22T06:31:42.857582+0000","last_fullsized":"2024-04-22T06:31:42.857582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025665+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:31:45.025665+0000","last_peered":"2024-04-22T06:31:45.025665+0000","last_clean":"2024-04-22T06:31:45.025665+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:31:45.025665+0000","last_undegraded":"2024-04-22T06:31:45.025665+0000","last_fullsized":"2024-04-22T06:31:45.025665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:50.224897+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:31:50.224897+0000","last_peered":"2024-04-22T06:31:50.224897+0000","last_clean":"2024-04-22T06:31:50.224897+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:31:50.224897+0000","last_undegraded":"2024-04-22T06:31:50.224897+0000","last_fullsized":"2024-04-22T06:31:50.224897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282326+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:31:44.282326+0000","last_peered":"2024-04-22T06:31:44.282326+0000","last_clean":"2024-04-22T06:31:44.282326+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:31:44.282326+0000","last_undegraded":"2024-04-22T06:31:44.282326+0000","last_fullsized":"2024-04-22T06:31:44.282326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159136+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:31:43.159136+0000","last_peered":"2024-04-22T06:31:43.159136+0000","last_clean":"2024-04-22T06:31:43.159136+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:31:43.159136+0000","last_undegraded":"2024-04-22T06:31:43.159136+0000","last_fullsized":"2024-04-22T06:31:43.159136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282302+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:31:44.282302+0000","last_peered":"2024-04-22T06:31:44.282302+0000","last_clean":"2024-04-22T06:31:44.282302+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:31:44.282302+0000","last_undegraded":"2024-04-22T06:31:44.282302+0000","last_fullsized":"2024-04-22T06:31:44.282302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159104+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:31:43.159104+0000","last_peered":"2024-04-22T06:31:43.159104+0000","last_clean":"2024-04-22T06:31:43.159104+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:31:43.159104+0000","last_undegraded":"2024-04-22T06:31:43.159104+0000","last_fullsized":"2024-04-22T06:31:43.159104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128227+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:31:45.128227+0000","last_peered":"2024-04-22T06:31:45.128227+0000","last_clean":"2024-04-22T06:31:45.128227+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:31:45.128227+0000","last_undegraded":"2024-04-22T06:31:45.128227+0000","last_fullsized":"2024-04-22T06:31:45.128227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857867+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:31:42.857867+0000","last_peered":"2024-04-22T06:31:42.857867+0000","last_clean":"2024-04-22T06:31:42.857867+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:31:42.857867+0000","last_undegraded":"2024-04-22T06:31:42.857867+0000","last_fullsized":"2024-04-22T06:31:42.857867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129007+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:31:45.129007+0000","last_peered":"2024-04-22T06:31:45.129007+0000","last_clean":"2024-04-22T06:31:45.129007+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:31:45.129007+0000","last_undegraded":"2024-04-22T06:31:45.129007+0000","last_fullsized":"2024-04-22T06:31:45.129007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857776+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:31:42.857776+0000","last_peered":"2024-04-22T06:31:42.857776+0000","last_clean":"2024-04-22T06:31:42.857776+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:31:42.857776+0000","last_undegraded":"2024-04-22T06:31:42.857776+0000","last_fullsized":"2024-04-22T06:31:42.857776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857178+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:31:42.857178+0000","last_peered":"2024-04-22T06:31:42.857178+0000","last_clean":"2024-04-22T06:31:42.857178+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:31:42.857178+0000","last_undegraded":"2024-04-22T06:31:42.857178+0000","last_fullsized":"2024-04-22T06:31:42.857178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128174+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:31:45.128174+0000","last_peered":"2024-04-22T06:31:45.128174+0000","last_clean":"2024-04-22T06:31:45.128174+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:31:45.128174+0000","last_undegraded":"2024-04-22T06:31:45.128174+0000","last_fullsized":"2024-04-22T06:31:45.128174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127735+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:31:45.127735+0000","last_peered":"2024-04-22T06:31:45.127735+0000","last_clean":"2024-04-22T06:31:45.127735+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:31:45.127735+0000","last_undegraded":"2024-04-22T06:31:45.127735+0000","last_fullsized":"2024-04-22T06:31:45.127735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281798+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:31:44.281798+0000","last_peered":"2024-04-22T06:31:44.281798+0000","last_clean":"2024-04-22T06:31:44.281798+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:31:44.281798+0000","last_undegraded":"2024-04-22T06:31:44.281798+0000","last_fullsized":"2024-04-22T06:31:44.281798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856764+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:31:42.856764+0000","last_peered":"2024-04-22T06:31:42.856764+0000","last_clean":"2024-04-22T06:31:42.856764+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:31:42.856764+0000","last_undegraded":"2024-04-22T06:31:42.856764+0000","last_fullsized":"2024-04-22T06:31:42.856764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857039+0000","last_change":"2024-04-22T06:31:41.877804+0000","last_active":"2024-04-22T06:31:42.857039+0000","last_peered":"2024-04-22T06:31:42.857039+0000","last_clean":"2024-04-22T06:31:42.857039+0000","last_became_active":"2024-04-22T06:31:41.877413+0000","last_became_peered":"2024-04-22T06:31:41.877413+0000","last_unstale":"2024-04-22T06:31:42.857039+0000","last_undegraded":"2024-04-22T06:31:42.857039+0000","last_fullsized":"2024-04-22T06:31:42.857039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129073+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:31:45.129073+0000","last_peered":"2024-04-22T06:31:45.129073+0000","last_clean":"2024-04-22T06:31:45.129073+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:31:45.129073+0000","last_undegraded":"2024-04-22T06:31:45.129073+0000","last_fullsized":"2024-04-22T06:31:45.129073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127679+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:31:45.127679+0000","last_peered":"2024-04-22T06:31:45.127679+0000","last_clean":"2024-04-22T06:31:45.127679+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:31:45.127679+0000","last_undegraded":"2024-04-22T06:31:45.127679+0000","last_fullsized":"2024-04-22T06:31:45.127679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858059+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:31:42.858059+0000","last_peered":"2024-04-22T06:31:42.858059+0000","last_clean":"2024-04-22T06:31:42.858059+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:31:42.858059+0000","last_undegraded":"2024-04-22T06:31:42.858059+0000","last_fullsized":"2024-04-22T06:31:42.858059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127969+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:31:45.127969+0000","last_peered":"2024-04-22T06:31:45.127969+0000","last_clean":"2024-04-22T06:31:45.127969+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:31:45.127969+0000","last_undegraded":"2024-04-22T06:31:45.127969+0000","last_fullsized":"2024-04-22T06:31:45.127969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856224+0000","last_change":"2024-04-22T06:31:41.881465+0000","last_active":"2024-04-22T06:31:42.856224+0000","last_peered":"2024-04-22T06:31:42.856224+0000","last_clean":"2024-04-22T06:31:42.856224+0000","last_became_active":"2024-04-22T06:31:41.881079+0000","last_became_peered":"2024-04-22T06:31:41.881079+0000","last_unstale":"2024-04-22T06:31:42.856224+0000","last_undegraded":"2024-04-22T06:31:42.856224+0000","last_fullsized":"2024-04-22T06:31:42.856224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:22.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128905+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:31:45.128905+0000","last_peered":"2024-04-22T06:31:45.128905+0000","last_clean":"2024-04-22T06:31:45.128905+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:31:45.128905+0000","last_undegraded":"2024-04-22T06:31:45.128905+0000","last_fullsized":"2024-04-22T06:31:45.128905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158921+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:31:43.158921+0000","last_peered":"2024-04-22T06:31:43.158921+0000","last_clean":"2024-04-22T06:31:43.158921+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:31:43.158921+0000","last_undegraded":"2024-04-22T06:31:43.158921+0000","last_fullsized":"2024-04-22T06:31:43.158921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128692+0000","last_change":"2024-04-22T06:31:41.878179+0000","last_active":"2024-04-22T06:31:45.128692+0000","last_peered":"2024-04-22T06:31:45.128692+0000","last_clean":"2024-04-22T06:31:45.128692+0000","last_became_active":"2024-04-22T06:31:41.877745+0000","last_became_peered":"2024-04-22T06:31:41.877745+0000","last_unstale":"2024-04-22T06:31:45.128692+0000","last_undegraded":"2024-04-22T06:31:45.128692+0000","last_fullsized":"2024-04-22T06:31:45.128692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:12.198244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856815+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:31:42.856815+0000","last_peered":"2024-04-22T06:31:42.856815+0000","last_clean":"2024-04-22T06:31:42.856815+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:31:42.856815+0000","last_undegraded":"2024-04-22T06:31:42.856815+0000","last_fullsized":"2024-04-22T06:31:42.856815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855964+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:31:42.855964+0000","last_peered":"2024-04-22T06:31:42.855964+0000","last_clean":"2024-04-22T06:31:42.855964+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:31:42.855964+0000","last_undegraded":"2024-04-22T06:31:42.855964+0000","last_fullsized":"2024-04-22T06:31:42.855964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857763+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:31:42.857763+0000","last_peered":"2024-04-22T06:31:42.857763+0000","last_clean":"2024-04-22T06:31:42.857763+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:31:42.857763+0000","last_undegraded":"2024-04-22T06:31:42.857763+0000","last_fullsized":"2024-04-22T06:31:42.857763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127886+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:31:45.127886+0000","last_peered":"2024-04-22T06:31:45.127886+0000","last_clean":"2024-04-22T06:31:45.127886+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:31:45.127886+0000","last_undegraded":"2024-04-22T06:31:45.127886+0000","last_fullsized":"2024-04-22T06:31:45.127886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128913+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:31:45.128913+0000","last_peered":"2024-04-22T06:31:45.128913+0000","last_clean":"2024-04-22T06:31:45.128913+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:31:45.128913+0000","last_undegraded":"2024-04-22T06:31:45.128913+0000","last_fullsized":"2024-04-22T06:31:45.128913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282208+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:31:44.282208+0000","last_peered":"2024-04-22T06:31:44.282208+0000","last_clean":"2024-04-22T06:31:44.282208+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:31:44.282208+0000","last_undegraded":"2024-04-22T06:31:44.282208+0000","last_fullsized":"2024-04-22T06:31:44.282208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858025+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:31:42.858025+0000","last_peered":"2024-04-22T06:31:42.858025+0000","last_clean":"2024-04-22T06:31:42.858025+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:31:42.858025+0000","last_undegraded":"2024-04-22T06:31:42.858025+0000","last_fullsized":"2024-04-22T06:31:42.858025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128390+0000","last_change":"2024-04-22T06:31:37.849680+0000","last_active":"2024-04-22T06:31:45.128390+0000","last_peered":"2024-04-22T06:31:45.128390+0000","last_clean":"2024-04-22T06:31:45.128390+0000","last_became_active":"2024-04-22T06:31:37.849196+0000","last_became_peered":"2024-04-22T06:31:37.849196+0000","last_unstale":"2024-04-22T06:31:45.128390+0000","last_undegraded":"2024-04-22T06:31:45.128390+0000","last_fullsized":"2024-04-22T06:31:45.128390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:16:40.650719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856559+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:31:42.856559+0000","last_peered":"2024-04-22T06:31:42.856559+0000","last_clean":"2024-04-22T06:31:42.856559+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:31:42.856559+0000","last_undegraded":"2024-04-22T06:31:42.856559+0000","last_fullsized":"2024-04-22T06:31:42.856559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128430+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:31:45.128430+0000","last_peered":"2024-04-22T06:31:45.128430+0000","last_clean":"2024-04-22T06:31:45.128430+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:31:45.128430+0000","last_undegraded":"2024-04-22T06:31:45.128430+0000","last_fullsized":"2024-04-22T06:31:45.128430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857712+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:31:42.857712+0000","last_peered":"2024-04-22T06:31:42.857712+0000","last_clean":"2024-04-22T06:31:42.857712+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:31:42.857712+0000","last_undegraded":"2024-04-22T06:31:42.857712+0000","last_fullsized":"2024-04-22T06:31:42.857712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127630+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:31:45.127630+0000","last_peered":"2024-04-22T06:31:45.127630+0000","last_clean":"2024-04-22T06:31:45.127630+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:31:45.127630+0000","last_undegraded":"2024-04-22T06:31:45.127630+0000","last_fullsized":"2024-04-22T06:31:45.127630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857005+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:31:42.857005+0000","last_peered":"2024-04-22T06:31:42.857005+0000","last_clean":"2024-04-22T06:31:42.857005+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:31:42.857005+0000","last_undegraded":"2024-04-22T06:31:42.857005+0000","last_fullsized":"2024-04-22T06:31:42.857005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025893+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:31:45.025893+0000","last_peered":"2024-04-22T06:31:45.025893+0000","last_clean":"2024-04-22T06:31:45.025893+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:31:45.025893+0000","last_undegraded":"2024-04-22T06:31:45.025893+0000","last_fullsized":"2024-04-22T06:31:45.025893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856259+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:31:42.856259+0000","last_peered":"2024-04-22T06:31:42.856259+0000","last_clean":"2024-04-22T06:31:42.856259+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:31:42.856259+0000","last_undegraded":"2024-04-22T06:31:42.856259+0000","last_fullsized":"2024-04-22T06:31:42.856259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858268+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:31:42.858268+0000","last_peered":"2024-04-22T06:31:42.858268+0000","last_clean":"2024-04-22T06:31:42.858268+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:31:42.858268+0000","last_undegraded":"2024-04-22T06:31:42.858268+0000","last_fullsized":"2024-04-22T06:31:42.858268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856449+0000","last_change":"2024-04-22T06:31:37.851894+0000","last_active":"2024-04-22T06:31:42.856449+0000","last_peered":"2024-04-22T06:31:42.856449+0000","last_clean":"2024-04-22T06:31:42.856449+0000","last_became_active":"2024-04-22T06:31:37.851595+0000","last_became_peered":"2024-04-22T06:31:37.851595+0000","last_unstale":"2024-04-22T06:31:42.856449+0000","last_undegraded":"2024-04-22T06:31:42.856449+0000","last_fullsized":"2024-04-22T06:31:42.856449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:06.634700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281858+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:31:44.281858+0000","last_peered":"2024-04-22T06:31:44.281858+0000","last_clean":"2024-04-22T06:31:44.281858+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:31:44.281858+0000","last_undegraded":"2024-04-22T06:31:44.281858+0000","last_fullsized":"2024-04-22T06:31:44.281858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127492+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:31:45.127492+0000","last_peered":"2024-04-22T06:31:45.127492+0000","last_clean":"2024-04-22T06:31:45.127492+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:31:45.127492+0000","last_undegraded":"2024-04-22T06:31:45.127492+0000","last_fullsized":"2024-04-22T06:31:45.127492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128719+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:31:45.128719+0000","last_peered":"2024-04-22T06:31:45.128719+0000","last_clean":"2024-04-22T06:31:45.128719+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:31:45.128719+0000","last_undegraded":"2024-04-22T06:31:45.128719+0000","last_fullsized":"2024-04-22T06:31:45.128719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159105+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:31:43.159105+0000","last_peered":"2024-04-22T06:31:43.159105+0000","last_clean":"2024-04-22T06:31:43.159105+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:31:43.159105+0000","last_undegraded":"2024-04-22T06:31:43.159105+0000","last_fullsized":"2024-04-22T06:31:43.159105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858147+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:31:42.858147+0000","last_peered":"2024-04-22T06:31:42.858147+0000","last_clean":"2024-04-22T06:31:42.858147+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:31:42.858147+0000","last_undegraded":"2024-04-22T06:31:42.858147+0000","last_fullsized":"2024-04-22T06:31:42.858147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857952+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:31:42.857952+0000","last_peered":"2024-04-22T06:31:42.857952+0000","last_clean":"2024-04-22T06:31:42.857952+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:31:42.857952+0000","last_undegraded":"2024-04-22T06:31:42.857952+0000","last_fullsized":"2024-04-22T06:31:42.857952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025959+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:31:45.025959+0000","last_peered":"2024-04-22T06:31:45.025959+0000","last_clean":"2024-04-22T06:31:45.025959+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:31:45.025959+0000","last_undegraded":"2024-04-22T06:31:45.025959+0000","last_fullsized":"2024-04-22T06:31:45.025959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128919+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:31:45.128919+0000","last_peered":"2024-04-22T06:31:45.128919+0000","last_clean":"2024-04-22T06:31:45.128919+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:31:45.128919+0000","last_undegraded":"2024-04-22T06:31:45.128919+0000","last_fullsized":"2024-04-22T06:31:45.128919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025381+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:31:45.025381+0000","last_peered":"2024-04-22T06:31:45.025381+0000","last_clean":"2024-04-22T06:31:45.025381+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:31:45.025381+0000","last_undegraded":"2024-04-22T06:31:45.025381+0000","last_fullsized":"2024-04-22T06:31:45.025381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857644+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:31:42.857644+0000","last_peered":"2024-04-22T06:31:42.857644+0000","last_clean":"2024-04-22T06:31:42.857644+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:31:42.857644+0000","last_undegraded":"2024-04-22T06:31:42.857644+0000","last_fullsized":"2024-04-22T06:31:42.857644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025479+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:31:45.025479+0000","last_peered":"2024-04-22T06:31:45.025479+0000","last_clean":"2024-04-22T06:31:45.025479+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:31:45.025479+0000","last_undegraded":"2024-04-22T06:31:45.025479+0000","last_fullsized":"2024-04-22T06:31:45.025479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858020+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:31:42.858020+0000","last_peered":"2024-04-22T06:31:42.858020+0000","last_clean":"2024-04-22T06:31:42.858020+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:31:42.858020+0000","last_undegraded":"2024-04-22T06:31:42.858020+0000","last_fullsized":"2024-04-22T06:31:42.858020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127596+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:31:45.127596+0000","last_peered":"2024-04-22T06:31:45.127596+0000","last_clean":"2024-04-22T06:31:45.127596+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:31:45.127596+0000","last_undegraded":"2024-04-22T06:31:45.127596+0000","last_fullsized":"2024-04-22T06:31:45.127596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282236+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:31:44.282236+0000","last_peered":"2024-04-22T06:31:44.282236+0000","last_clean":"2024-04-22T06:31:44.282236+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:31:44.282236+0000","last_undegraded":"2024-04-22T06:31:44.282236+0000","last_fullsized":"2024-04-22T06:31:44.282236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025855+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:31:45.025855+0000","last_peered":"2024-04-22T06:31:45.025855+0000","last_clean":"2024-04-22T06:31:45.025855+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:31:45.025855+0000","last_undegraded":"2024-04-22T06:31:45.025855+0000","last_fullsized":"2024-04-22T06:31:45.025855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:32:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-22T06:32:06.204 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-22T06:32:06.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-22T06:32:06.204 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-22T06:32:06.204 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-22T06:32:06.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.336+0000 7fc3e88fb640 1 Processor -- start 2024-04-22T06:32:06.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.336+0000 7fc3e88fb640 1 -- start start 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e88fb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc3e4074160 0x7fc3e40c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e88fb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e4071df0 con 0x7fc3e40c5b10 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e88fb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e4159e10 con 0x7fc3e4142280 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e88fb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e4142660 con 0x7fc3e4074160 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3dbfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc3e40c5b10 0x7fc3e4073a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45546/0 (socket says 172.21.15.113:45546) 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3dbfff640 1 -- 172.21.15.113:0/916699815 learned_addr learned my addr 172.21.15.113:0/916699815 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724553616 0 0) 0x7fc3e4071df0 con 0x7fc3e40c5b10 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d0003520 con 0x7fc3e40c5b10 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e2d9d640 1 --2- 172.21.15.113:0/916699815 >> v2:172.21.15.145:3300/0 conn(0x7fc3e4074160 0x7fc3e40c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2853486886 0 0) 0x7fc3d0003520 con 0x7fc3e40c5b10 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 >> v2:172.21.15.145:3300/0 conn(0x7fc3e4074160 msgr2=0x7fc3e40c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 --2- 172.21.15.113:0/916699815 >> v2:172.21.15.145:3300/0 conn(0x7fc3e4074160 0x7fc3e40c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 >> v1:172.21.15.145:6789/0 conn(0x7fc3e4142280 legacy=0x7fc3e40c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e4159290 con 0x7fc3e40c5b10 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fc3cc001670 con 0x7fc3e40c5b10 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 >> v1:172.21.15.113:6789/0 conn(0x7fc3e40c5b10 legacy=0x7fc3e4073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3d00039b0 0x7fc3d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d0004800 0x7fc3d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3d00051c0 0x7fc3d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e4142660 con 0x7fc3d00039b0 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d000c070 con 0x7fc3d00051c0 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d000c270 con 0x7fc3d0004800 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.337+0000 7fc3e259c640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3d00039b0 0x7fc3d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3e2d9d640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3d00051c0 0x7fc3d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3dbfff640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d0004800 0x7fc3d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3e259c640 1 -- 172.21.15.113:0/916699815 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d0004800 msgr2=0x7fc3d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3e259c640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d0004800 0x7fc3d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3e259c640 1 -- 172.21.15.113:0/916699815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3d00051c0 msgr2=0x7fc3d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3e259c640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3d00051c0 0x7fc3d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3e2d9d640 1 -- 172.21.15.113:0/916699815 reap_dead start 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3e259c640 1 -- 172.21.15.113:0/916699815 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d0003520 con 0x7fc3d00039b0 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.338+0000 7fc3e259c640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3d00039b0 0x7fc3d0003dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4001750 tx=0x7fc3d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bd8e127e7fe65e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4001370 con 0x7fc3d00039b0 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d40052d0 con 0x7fc3d00039b0 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e1d9b640 1 -- 172.21.15.113:0/916699815 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4003830 con 0x7fc3d00039b0 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e88fb640 1 -- 172.21.15.113:0/916699815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3d00039b0 msgr2=0x7fc3d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e88fb640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3d00039b0 0x7fc3d0003dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4001750 tx=0x7fc3d0005830 comp rx=0 tx=0).stop 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e88fb640 1 -- 172.21.15.113:0/916699815 shutdown_connections 2024-04-22T06:32:06.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e88fb640 1 --2- 172.21.15.113:0/916699815 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3d00039b0 0x7fc3d0003dd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e88fb640 1 -- 172.21.15.113:0/916699815 >> 172.21.15.113:0/916699815 conn(0x7fc3e406d610 msgr2=0x7fc3e4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:06.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e88fb640 1 -- 172.21.15.113:0/916699815 shutdown_connections 2024-04-22T06:32:06.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.339+0000 7fc3e88fb640 1 -- 172.21.15.113:0/916699815 wait complete. 2024-04-22T06:32:06.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.340+0000 7fc3e88fb640 1 Processor -- start 2024-04-22T06:32:06.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e88fb640 1 -- start start 2024-04-22T06:32:06.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e88fb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d00039b0 0x7fc3e41e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e88fb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3e41e5740 0x7fc3e4154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e88fb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e4156430 0x7fc3e40c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e88fb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e4159850 con 0x7fc3e4156430 2024-04-22T06:32:06.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e88fb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e40735c0 con 0x7fc3e41e5740 2024-04-22T06:32:06.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e88fb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e4159b30 con 0x7fc3d00039b0 2024-04-22T06:32:06.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e4156430 0x7fc3e40c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e4156430 0x7fc3e40c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33794/0 (socket says 172.21.15.113:33794) 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e2d9d640 1 -- 172.21.15.113:0/3297612377 learned_addr learned my addr 172.21.15.113:0/3297612377 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3e259c640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d00039b0 0x7fc3e41e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.341+0000 7fc3dbfff640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3e41e5740 0x7fc3e4154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3e2d9d640 1 -- 172.21.15.113:0/3297612377 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d00039b0 msgr2=0x7fc3e41e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3e2d9d640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d00039b0 0x7fc3e41e3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3e2d9d640 1 -- 172.21.15.113:0/3297612377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3e41e5740 msgr2=0x7fc3e4154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3e2d9d640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3e41e5740 0x7fc3e4154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3e2d9d640 1 -- 172.21.15.113:0/3297612377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e41534d0 con 0x7fc3e4156430 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3e2d9d640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e4156430 0x7fc3e40c82c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40cb0a0 tx=0x7fc3dc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3daffd640 1 -- 172.21.15.113:0/3297612377 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00fdb0 con 0x7fc3e4156430 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3daffd640 1 -- 172.21.15.113:0/3297612377 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3dc01d070 con 0x7fc3e4156430 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e41e3300 con 0x7fc3e4156430 2024-04-22T06:32:06.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3daffd640 1 -- 172.21.15.113:0/3297612377 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc015670 con 0x7fc3e4156430 2024-04-22T06:32:06.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.342+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e4152f10 con 0x7fc3e4156430 2024-04-22T06:32:06.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.343+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e4068e40 con 0x7fc3e4156430 2024-04-22T06:32:06.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.343+0000 7fc3daffd640 1 -- 172.21.15.113:0/3297612377 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3dc015810 con 0x7fc3e4156430 2024-04-22T06:32:06.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.344+0000 7fc3daffd640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3c406c920 0x7fc3c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.344+0000 7fc3daffd640 1 -- 172.21.15.113:0/3297612377 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc3dc08c800 con 0x7fc3e4156430 2024-04-22T06:32:06.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.344+0000 7fc3e259c640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3c406c920 0x7fc3c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.344+0000 7fc3e259c640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3c406c920 0x7fc3c406ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4033000 tx=0x7fc3d4009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.349+0000 7fc3daffd640 1 -- 172.21.15.113:0/3297612377 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3dc027020 con 0x7fc3e4156430 2024-04-22T06:32:06.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.570+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc3e40c3590 con 0x7fc3e4156430 2024-04-22T06:32:06.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.573+0000 7fc3daffd640 1 -- 172.21.15.113:0/3297612377 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174144 (secure 0 0 0) 0x7fc3dc010040 con 0x7fc3e4156430 2024-04-22T06:32:06.574 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:06.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3c406c920 msgr2=0x7fc3c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3c406c920 0x7fc3c406ede0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4033000 tx=0x7fc3d4009030 comp rx=0 tx=0).stop 2024-04-22T06:32:06.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e4156430 msgr2=0x7fc3e40c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e4156430 0x7fc3e40c82c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40cb0a0 tx=0x7fc3dc00f580 comp rx=0 tx=0).stop 2024-04-22T06:32:06.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 shutdown_connections 2024-04-22T06:32:06.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3c406c920 0x7fc3c406ede0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3e4156430 0x7fc3e40c82c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3e41e5740 0x7fc3e4154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 --2- 172.21.15.113:0/3297612377 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3d00039b0 0x7fc3e41e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 >> 172.21.15.113:0/3297612377 conn(0x7fc3e406d610 msgr2=0x7fc3e40cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:06.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 shutdown_connections 2024-04-22T06:32:06.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.577+0000 7fc3e88fb640 1 -- 172.21.15.113:0/3297612377 wait complete. 2024-04-22T06:32:06.586 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2607561866},{"type":"v1","addr":"172.21.15.113:6833","nonce":2607561866}]},"active_addr":"172.21.15.113:6833/2607561866","active_change":"2024-04-22T06:31:16.959604+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4099,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":4243372784}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":2419489142}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":3858042077}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":4024220909}]}]} 2024-04-22T06:32:06.589 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-22T06:32:06.589 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-22T06:32:06.589 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:06.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64bb474640 1 Processor -- start 2024-04-22T06:32:06.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64bb474640 1 -- start start 2024-04-22T06:32:06.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64bb474640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f64b4151f10 0x7f64b4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64bb474640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f64b40c9610 0x7f64b40ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64bb474640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b41582e0 con 0x7f64b40c5b80 2024-04-22T06:32:06.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64bb474640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f64b415b8a0 con 0x7f64b40c9610 2024-04-22T06:32:06.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64bb474640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f64b4158570 con 0x7f64b4151f10 2024-04-22T06:32:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64b9a11640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f64b40c9610 0x7f64b40ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.687+0000 7f64b9a11640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f64b40c9610 0x7f64b40ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33804/0 (socket says 172.21.15.113:33804) 2024-04-22T06:32:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.688+0000 7f64b9a11640 1 -- 172.21.15.113:0/1568189228 learned_addr learned my addr 172.21.15.113:0/1568189228 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.688+0000 7f64b9210640 1 --2- 172.21.15.113:0/1568189228 >> v2:172.21.15.145:3300/0 conn(0x7f64b4151f10 0x7f64b4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.688+0000 7f64b9a11640 1 -- 172.21.15.113:0/1568189228 >> v2:172.21.15.145:3300/0 conn(0x7f64b4151f10 msgr2=0x7f64b4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.688+0000 7f64b9a11640 1 --2- 172.21.15.113:0/1568189228 >> v2:172.21.15.145:3300/0 conn(0x7f64b4151f10 0x7f64b4157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.688+0000 7f64b9a11640 1 -- 172.21.15.113:0/1568189228 >> v1:172.21.15.145:6789/0 conn(0x7f64b40c5b80 legacy=0x7f64b415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.688+0000 7f64b9a11640 1 -- 172.21.15.113:0/1568189228 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b4158850 con 0x7f64b40c9610 2024-04-22T06:32:06.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.688+0000 7f64b9a11640 1 --2- 172.21.15.113:0/1568189228 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b40c9610 0x7f64b40ca560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f64b40708a0 tx=0x7f64ac02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84995fa25047de62 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64abfff640 1 -- 172.21.15.113:0/1568189228 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac02cbb0 con 0x7f64b40c9610 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64abfff640 1 -- 172.21.15.113:0/1568189228 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac02cd50 con 0x7f64b40c9610 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64abfff640 1 -- 172.21.15.113:0/1568189228 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac034610 con 0x7f64b40c9610 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64bb474640 1 -- 172.21.15.113:0/1568189228 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b40c9610 msgr2=0x7f64b40ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64bb474640 1 --2- 172.21.15.113:0/1568189228 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b40c9610 0x7f64b40ca560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f64b40708a0 tx=0x7f64ac02c010 comp rx=0 tx=0).stop 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64bb474640 1 -- 172.21.15.113:0/1568189228 shutdown_connections 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64bb474640 1 --2- 172.21.15.113:0/1568189228 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b40c9610 0x7f64b40ca560 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64bb474640 1 --2- 172.21.15.113:0/1568189228 >> v2:172.21.15.145:3300/0 conn(0x7f64b4151f10 0x7f64b4157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64bb474640 1 -- 172.21.15.113:0/1568189228 >> 172.21.15.113:0/1568189228 conn(0x7f64b406bd10 msgr2=0x7f64b406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64bb474640 1 -- 172.21.15.113:0/1568189228 shutdown_connections 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.689+0000 7f64bb474640 1 -- 172.21.15.113:0/1568189228 wait complete. 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.690+0000 7f64bb474640 1 Processor -- start 2024-04-22T06:32:06.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.690+0000 7f64bb474640 1 -- start start 2024-04-22T06:32:06.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64bb474640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64b40c5b80 0x7f64b4073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64bb474640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64b40c9610 0x7f64b41e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64bb474640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b4151f10 0x7f64b41e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64bb474640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f64b40c7f80 con 0x7f64b4151f10 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64bb474640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f64b415b530 con 0x7f64b40c5b80 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64bb474640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f64b40c8100 con 0x7f64b40c9610 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9a11640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b4151f10 0x7f64b41e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9a11640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b4151f10 0x7f64b41e4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33816/0 (socket says 172.21.15.113:33816) 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9a11640 1 -- 172.21.15.113:0/2807289221 learned_addr learned my addr 172.21.15.113:0/2807289221 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9210640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64b40c5b80 0x7f64b4073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b8a0f640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64b40c9610 0x7f64b41e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9a11640 1 -- 172.21.15.113:0/2807289221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64b40c9610 msgr2=0x7f64b41e3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9a11640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64b40c9610 0x7f64b41e3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9a11640 1 -- 172.21.15.113:0/2807289221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64b40c5b80 msgr2=0x7f64b4073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9a11640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64b40c5b80 0x7f64b4073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.691+0000 7f64b9a11640 1 -- 172.21.15.113:0/2807289221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b40cb480 con 0x7f64b4151f10 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.692+0000 7f64b9a11640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b4151f10 0x7f64b41e4c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f64ac02c620 tx=0x7f64ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.692+0000 7f64a9ffb640 1 -- 172.21.15.113:0/2807289221 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac043020 con 0x7f64b4151f10 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.692+0000 7f64a9ffb640 1 -- 172.21.15.113:0/2807289221 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac03e450 con 0x7f64b4151f10 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.692+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b40cb760 con 0x7f64b4151f10 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.692+0000 7f64a9ffb640 1 -- 172.21.15.113:0/2807289221 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac009510 con 0x7f64b4151f10 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.692+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b41e5790 con 0x7f64b4151f10 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.693+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b41e5990 con 0x7f64b4151f10 2024-04-22T06:32:06.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.693+0000 7f64a9ffb640 1 -- 172.21.15.113:0/2807289221 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64ac046020 con 0x7f64b4151f10 2024-04-22T06:32:06.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.694+0000 7f64a9ffb640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f649806c8f0 0x7f649806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.694+0000 7f64a9ffb640 1 -- 172.21.15.113:0/2807289221 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f64ac0ae590 con 0x7f64b4151f10 2024-04-22T06:32:06.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.694+0000 7f64b9210640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f649806c8f0 0x7f649806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.694+0000 7f64b9210640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f649806c8f0 0x7f649806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009aa0 tx=0x7f64a4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.698+0000 7f64a9ffb640 1 -- 172.21.15.113:0/2807289221 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64b41e5990 con 0x7f64b4151f10 2024-04-22T06:32:06.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.873+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64b4068e40 con 0x7f64b4151f10 2024-04-22T06:32:06.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.874+0000 7f64a9ffb640 1 -- 172.21.15.113:0/2807289221 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f64ac04d030 con 0x7f64b4151f10 2024-04-22T06:32:06.874 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:06.874 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:06.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f649806c8f0 msgr2=0x7f649806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f649806c8f0 0x7f649806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009aa0 tx=0x7f64a4009190 comp rx=0 tx=0).stop 2024-04-22T06:32:06.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b4151f10 msgr2=0x7f64b41e4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b4151f10 0x7f64b41e4c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f64ac02c620 tx=0x7f64ac004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 shutdown_connections 2024-04-22T06:32:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f649806c8f0 0x7f649806edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64b4151f10 0x7f64b41e4c80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f64b40c9610 0x7f64b41e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 --2- 172.21.15.113:0/2807289221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64b40c5b80 0x7f64b4073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 >> 172.21.15.113:0/2807289221 conn(0x7f64b406bd10 msgr2=0x7f64b4156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 shutdown_connections 2024-04-22T06:32:06.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.877+0000 7f64bb474640 1 -- 172.21.15.113:0/2807289221 wait complete. 2024-04-22T06:32:06.887 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-22T06:32:06.888 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:06.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.986+0000 7f8cfe3ef640 1 Processor -- start 2024-04-22T06:32:06.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.986+0000 7f8cfe3ef640 1 -- start start 2024-04-22T06:32:06.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cfe3ef640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf815b810 0x7f8cf81668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cfe3ef640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf8155740 con 0x7f8cf80c9aa0 2024-04-22T06:32:06.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cfe3ef640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf80caad0 con 0x7f8cf8155360 2024-04-22T06:32:06.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cfe3ef640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf80cadb0 con 0x7f8cf815b810 2024-04-22T06:32:06.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf77fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8cf80c9aa0 0x7f8cf815b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45554/0 (socket says 172.21.15.113:45554) 2024-04-22T06:32:06.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf77fe640 1 -- 172.21.15.113:0/42229531 learned_addr learned my addr 172.21.15.113:0/42229531 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:06.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cfc98c640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf815b810 0x7f8cf81668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402786558 0 0) 0x7f8ce8001110 con 0x7f8cf80c9aa0 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce4003520 con 0x7f8cf80c9aa0 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1897748957 0 0) 0x7f8ce4003520 con 0x7f8cf80c9aa0 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf815b810 msgr2=0x7f8cf81668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf815b810 0x7f8cf81668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 >> v1:172.21.15.145:6789/0 conn(0x7f8cf8155360 legacy=0x7f8cf80cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf806b9c0 con 0x7f8cf80c9aa0 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f8ce8001840 con 0x7f8cf80c9aa0 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 >> v1:172.21.15.113:6789/0 conn(0x7f8cf80c9aa0 legacy=0x7f8cf815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce40039e0 0x7f8ce4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ce4004390 0x7f8ce4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf815b810 0x7f8ce40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf80cadb0 con 0x7f8ce4004390 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce400b9c0 con 0x7f8ce40039e0 2024-04-22T06:32:06.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce400bbc0 con 0x7f8cf815b810 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ce4004390 0x7f8ce4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf7fff640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce40039e0 0x7f8ce4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cfc98c640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf815b810 0x7f8ce40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf77fe640 1 -- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf815b810 msgr2=0x7f8ce40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf815b810 0x7f8ce40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf77fe640 1 -- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce40039e0 msgr2=0x7f8ce4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce40039e0 0x7f8ce4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.987+0000 7f8cf77fe640 1 -- 172.21.15.113:0/42229531 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce4003520 con 0x7f8ce4004390 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ce4004390 0x7f8ce4004860 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c4c0 tx=0x7f8ce4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e555591cf74c28f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800c0e0 con 0x7f8ce4004390 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce8030070 con 0x7f8ce4004390 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cf6ffd640 1 -- 172.21.15.113:0/42229531 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80058d0 con 0x7f8ce4004390 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/42229531 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ce4004390 msgr2=0x7f8ce4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cfe3ef640 1 --2- 172.21.15.113:0/42229531 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ce4004390 0x7f8ce4004860 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c4c0 tx=0x7f8ce4005830 comp rx=0 tx=0).stop 2024-04-22T06:32:06.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cfc98c640 1 -- 172.21.15.113:0/42229531 reap_dead start 2024-04-22T06:32:06.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/42229531 shutdown_connections 2024-04-22T06:32:06.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/42229531 >> 172.21.15.113:0/42229531 conn(0x7f8cf8074f30 msgr2=0x7f8cf8075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:06.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/42229531 shutdown_connections 2024-04-22T06:32:06.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.989+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/42229531 wait complete. 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.991+0000 7f8cfe3ef640 1 Processor -- start 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.991+0000 7f8cfe3ef640 1 -- start start 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.991+0000 7f8cfe3ef640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce4004390 0x7f8cf81f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cfe3ef640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf815aba0 0x7f8cf80cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cfe3ef640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf80cca00 0x7f8cf8141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cfe3ef640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf80ca770 con 0x7f8cf815aba0 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cfe3ef640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf806bf80 con 0x7f8ce4004390 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cfe3ef640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf80c8ff0 con 0x7f8cf80cca00 2024-04-22T06:32:06.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf815aba0 0x7f8cf80cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf815aba0 0x7f8cf80cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33828/0 (socket says 172.21.15.113:33828) 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 -- 172.21.15.113:0/3863163390 learned_addr learned my addr 172.21.15.113:0/3863163390 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf7fff640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce4004390 0x7f8cf81f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 -- 172.21.15.113:0/3863163390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf80cca00 msgr2=0x7f8cf8141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf80cca00 0x7f8cf8141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 -- 172.21.15.113:0/3863163390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce4004390 msgr2=0x7f8cf81f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce4004390 0x7f8cf81f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 -- 172.21.15.113:0/3863163390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf81f4c00 con 0x7f8cf815aba0 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf815aba0 0x7f8cf80cc4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c5b0 tx=0x7f8cf80c8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf4ff9640 1 -- 172.21.15.113:0/3863163390 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8004bf0 con 0x7f8cf815aba0 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf4ff9640 1 -- 172.21.15.113:0/3863163390 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce8004d90 con 0x7f8cf815aba0 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf8159960 con 0x7f8cf815aba0 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cf4ff9640 1 -- 172.21.15.113:0/3863163390 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8007270 con 0x7f8cf815aba0 2024-04-22T06:32:06.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.992+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf8159f20 con 0x7f8cf815aba0 2024-04-22T06:32:06.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.993+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf8068e40 con 0x7f8cf815aba0 2024-04-22T06:32:06.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.994+0000 7f8cf4ff9640 1 -- 172.21.15.113:0/3863163390 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ce8007410 con 0x7f8cf815aba0 2024-04-22T06:32:06.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.994+0000 7f8cf4ff9640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c8f0 0x7f8cd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:06.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.994+0000 7f8cf4ff9640 1 -- 172.21.15.113:0/3863163390 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8ce80ad930 con 0x7f8cf815aba0 2024-04-22T06:32:06.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.994+0000 7f8cf7fff640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c8f0 0x7f8cd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:06.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.994+0000 7f8cf7fff640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c8f0 0x7f8cd806edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00055a0 tx=0x7f8ce0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:06.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:06.997+0000 7f8cf4ff9640 1 -- 172.21.15.113:0/3863163390 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8cf8155740 con 0x7f8cf815aba0 2024-04-22T06:32:07.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.174+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cf8145ef0 con 0x7f8cf815aba0 2024-04-22T06:32:07.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.175+0000 7f8cf4ff9640 1 -- 172.21.15.113:0/3863163390 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f8ce807ba50 con 0x7f8cf815aba0 2024-04-22T06:32:07.173 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:07.174 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":24,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:31:42.210595+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c8f0 msgr2=0x7f8cd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c8f0 0x7f8cd806edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00055a0 tx=0x7f8ce0009040 comp rx=0 tx=0).stop 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf815aba0 msgr2=0x7f8cf80cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf815aba0 0x7f8cf80cc4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c5b0 tx=0x7f8cf80c8c00 comp rx=0 tx=0).stop 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 shutdown_connections 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf80cca00 0x7f8cf8141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c8f0 0x7f8cd806edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf815aba0 0x7f8cf80cc4c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 --2- 172.21.15.113:0/3863163390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ce4004390 0x7f8cf81f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 >> 172.21.15.113:0/3863163390 conn(0x7f8cf8074f30 msgr2=0x7f8cf814fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 shutdown_connections 2024-04-22T06:32:07.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.177+0000 7f8cfe3ef640 1 -- 172.21.15.113:0/3863163390 wait complete. 2024-04-22T06:32:07.187 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-22T06:32:07.187 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-22T06:32:07.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-22T06:32:07.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-22T06:32:07.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-22T06:32:07.189 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-22T06:32:07.189 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-22T06:32:07.190 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-22T06:32:07.204 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:32:07.242 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.370+0000 7efef225c640 1 Processor -- start 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.370+0000 7efef225c640 1 -- start start 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.372+0000 7efef225c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efeec06f870 0x7efeec1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.372+0000 7efef225c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeec0c46b0 con 0x7efeec06e850 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.372+0000 7efef225c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeec0c4990 con 0x7efeec06ec30 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.372+0000 7efef225c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7efeec0c4c70 con 0x7efeec06f870 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.372+0000 7efeeb7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7efeec06e850 0x7efeec150f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45570/0 (socket says 172.21.15.113:45570) 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.372+0000 7efeeb7fe640 1 -- 172.21.15.113:0/1268444638 learned_addr learned my addr 172.21.15.113:0/1268444638 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.372+0000 7efeeaffd640 1 --2- 172.21.15.113:0/1268444638 >> v2:172.21.15.113:3300/0 conn(0x7efeec06f870 0x7efeec1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.373+0000 7f85f5281640 1 Processor -- start 2024-04-22T06:32:07.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.373+0000 7f85f5281640 1 -- start start 2024-04-22T06:32:07.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.373+0000 7efeeaffd640 1 -- 172.21.15.113:0/1268444638 >> v1:172.21.15.145:6789/0 conn(0x7efeec06ec30 legacy=0x7efeec161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.373+0000 7efeeaffd640 1 -- 172.21.15.113:0/1268444638 >> v1:172.21.15.113:6789/0 conn(0x7efeec06e850 legacy=0x7efeec150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.373+0000 7efeeaffd640 1 -- 172.21.15.113:0/1268444638 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec0c4f50 con 0x7efeec06f870 2024-04-22T06:32:07.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.373+0000 7efeea7fc640 1 -- 172.21.15.113:0/1268444638 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213535153 0 0) 0x7efeec0c46b0 con 0x7efeec06e850 2024-04-22T06:32:07.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.374+0000 7efeeaffd640 1 --2- 172.21.15.113:0/1268444638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec06f870 0x7efeec1570f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efee400d1e0 tx=0x7efee402e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af42c203d296e21f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85f5281640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f01570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85f5281640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f85f00c5a30 0x7f85f00c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85f5281640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f00c4990 con 0x7f85f006f870 2024-04-22T06:32:07.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85f5281640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f85f00c4c70 con 0x7f85f00c5a30 2024-04-22T06:32:07.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85f5281640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f85f00c4f50 con 0x7f85f00c99f0 2024-04-22T06:32:07.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7efeea7fc640 1 -- 172.21.15.113:0/1268444638 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4034070 con 0x7efeec06f870 2024-04-22T06:32:07.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7efeea7fc640 1 -- 172.21.15.113:0/1268444638 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee4038600 con 0x7efeec06f870 2024-04-22T06:32:07.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7efeea7fc640 1 -- 172.21.15.113:0/1268444638 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee40389f0 con 0x7efeec06f870 2024-04-22T06:32:07.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85ef7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f85f00c5a30 0x7f85f00c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f01570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f01570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:48386/0 (socket says 172.21.15.113:48386) 2024-04-22T06:32:07.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.375+0000 7f85ee7fc640 1 -- 172.21.15.113:0/3764509751 learned_addr learned my addr 172.21.15.113:0/3764509751 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.376+0000 7f85ee7fc640 1 -- 172.21.15.113:0/3764509751 >> v2:172.21.15.113:3300/0 conn(0x7f85f00c5a30 msgr2=0x7f85f00c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.376+0000 7f85ee7fc640 1 --2- 172.21.15.113:0/3764509751 >> v2:172.21.15.113:3300/0 conn(0x7f85f00c5a30 0x7f85f00c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.376+0000 7f85ee7fc640 1 -- 172.21.15.113:0/3764509751 >> v1:172.21.15.113:6789/0 conn(0x7f85f006f870 legacy=0x7f85f006e5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:07.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.376+0000 7f85ee7fc640 1 -- 172.21.15.113:0/3764509751 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f00c5230 con 0x7f85f00c99f0 2024-04-22T06:32:07.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.377+0000 7f85ef7fe640 1 --2- 172.21.15.113:0/3764509751 >> v2:172.21.15.113:3300/0 conn(0x7f85f00c5a30 0x7f85f00c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:07.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.377+0000 7f85ee7fc640 1 --2- 172.21.15.113:0/3764509751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f01570f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009e50 tx=0x7f85e802bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6593f71e1477bc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7efef225c640 1 -- 172.21.15.113:0/1268444638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec06f870 msgr2=0x7efeec1570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7efef225c640 1 --2- 172.21.15.113:0/1268444638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec06f870 0x7efeec1570f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efee400d1e0 tx=0x7efee402e330 comp rx=0 tx=0).stop 2024-04-22T06:32:07.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7f4a09dbd640 1 Processor -- start 2024-04-22T06:32:07.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7f4a09dbd640 1 -- start start 2024-04-22T06:32:07.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7f85edffb640 1 -- 172.21.15.113:0/3764509751 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e802cb20 con 0x7f85f00c99f0 2024-04-22T06:32:07.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7f85edffb640 1 -- 172.21.15.113:0/3764509751 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e802ccc0 con 0x7f85f00c99f0 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7f85edffb640 1 -- 172.21.15.113:0/3764509751 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e80345f0 con 0x7f85f00c99f0 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.379+0000 7f85f5281640 1 -- 172.21.15.113:0/3764509751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 msgr2=0x7f85f01570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.379+0000 7f85f5281640 1 --2- 172.21.15.113:0/3764509751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f01570f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009e50 tx=0x7f85e802bf80 comp rx=0 tx=0).stop 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.379+0000 7f85f5281640 1 -- 172.21.15.113:0/3764509751 shutdown_connections 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.379+0000 7f85f5281640 1 --2- 172.21.15.113:0/3764509751 >> v2:172.21.15.113:3300/0 conn(0x7f85f00c5a30 0x7f85f00c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.379+0000 7f85f5281640 1 --2- 172.21.15.113:0/3764509751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f01570f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.379+0000 7f85f5281640 1 -- 172.21.15.113:0/3764509751 >> 172.21.15.113:0/3764509751 conn(0x7f85f00c8f00 msgr2=0x7f85f00c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7efef225c640 1 -- 172.21.15.113:0/1268444638 shutdown_connections 2024-04-22T06:32:07.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7efef225c640 1 --2- 172.21.15.113:0/1268444638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec06f870 0x7efeec1570f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7efef225c640 1 -- 172.21.15.113:0/1268444638 >> 172.21.15.113:0/1268444638 conn(0x7efeec0c8f00 msgr2=0x7efeec0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7efef225c640 1 -- 172.21.15.113:0/1268444638 shutdown_connections 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.378+0000 7efef225c640 1 -- 172.21.15.113:0/1268444638 wait complete. 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.380+0000 7efef225c640 1 Processor -- start 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.380+0000 7efef225c640 1 -- start start 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efef225c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeec06e850 0x7efeec1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efef225c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efeec06ec30 0x7efeec1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efef225c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec06f870 0x7efeec158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efef225c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7efeec151610 con 0x7efeec06f870 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efef225c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efeec0c5510 con 0x7efeec06e850 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efeeb7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeec06e850 0x7efeec1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efeeb7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeec06e850 0x7efeec1478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57068/0 (socket says 172.21.15.113:57068) 2024-04-22T06:32:07.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efeeb7fe640 1 -- 172.21.15.113:0/1442174766 learned_addr learned my addr 172.21.15.113:0/1442174766 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7efeec151790 con 0x7efeec06ec30 2024-04-22T06:32:07.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.381+0000 7efeeaffd640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efeec06ec30 0x7efeec1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.382+0000 7efeeb7fe640 1 -- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efeec06ec30 msgr2=0x7efeec1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.382+0000 7efeeb7fe640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efeec06ec30 0x7efeec1587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.382+0000 7efeeb7fe640 1 -- 172.21.15.113:0/1442174766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec06f870 msgr2=0x7efeec158cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:07.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.382+0000 7efeeb7fe640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efeec06f870 0x7efeec158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.382+0000 7efeeb7fe640 1 -- 172.21.15.113:0/1442174766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec1fdb80 con 0x7efeec06e850 2024-04-22T06:32:07.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.382+0000 7efeeb7fe640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeec06e850 0x7efeec1478c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c4a0 tx=0x7efedc00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a09dbd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f49fc0dd450 0x7f49fc04b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a09dbd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f49fc0e6770 0x7f49fc0e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a09dbd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49fc04b840 con 0x7f49fc0452d0 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a09dbd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f49fc007650 con 0x7f49fc0dd450 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a09dbd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f49fc006a40 con 0x7f49fc0e6770 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a03fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f49fc0e6770 0x7f49fc0e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a03fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f49fc0e6770 0x7f49fc0e6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57070/0 (socket says 172.21.15.113:57070) 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a03fff640 1 -- 172.21.15.113:0/2132776382 learned_addr learned my addr 172.21.15.113:0/2132776382 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f85f5281640 1 -- 172.21.15.113:0/3764509751 shutdown_connections 2024-04-22T06:32:07.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0075a0 con 0x7efeec06e850 2024-04-22T06:32:07.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a03fff640 1 -- 172.21.15.113:0/2132776382 >> v2:172.21.15.113:3300/0 conn(0x7f49fc0dd450 msgr2=0x7f49fc04b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7f4a037fe640 1 --2- 172.21.15.113:0/2132776382 >> v2:172.21.15.113:3300/0 conn(0x7f49fc0dd450 0x7f49fc04b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec1582b0 con 0x7efeec06e850 2024-04-22T06:32:07.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.383+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec1fe0e0 con 0x7efeec06e850 2024-04-22T06:32:07.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.384+0000 7f4a03fff640 1 --2- 172.21.15.113:0/2132776382 >> v2:172.21.15.113:3300/0 conn(0x7f49fc0dd450 0x7f49fc04b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.384+0000 7f4a03fff640 1 -- 172.21.15.113:0/2132776382 >> v1:172.21.15.145:6789/0 conn(0x7f49fc0452d0 legacy=0x7f49fc045720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.384+0000 7f4a03fff640 1 -- 172.21.15.113:0/2132776382 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc006d20 con 0x7f49fc0e6770 2024-04-22T06:32:07.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.384+0000 7f4a037fe640 1 --2- 172.21.15.113:0/2132776382 >> v2:172.21.15.113:3300/0 conn(0x7f49fc0dd450 0x7f49fc04b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:07.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.384+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc015030 con 0x7efeec06e850 2024-04-22T06:32:07.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.384+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc004a20 con 0x7efeec06e850 2024-04-22T06:32:07.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.385+0000 7f85f5281640 1 -- 172.21.15.113:0/3764509751 wait complete. 2024-04-22T06:32:07.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.386+0000 7f4a03fff640 1 --2- 172.21.15.113:0/2132776382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0e6770 0x7f49fc0e6be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4a04064fa0 tx=0x7f4a040a8040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=792c43eb2d8ee91d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.386+0000 7fb21f59e640 1 Processor -- start 2024-04-22T06:32:07.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.386+0000 7fb21f59e640 1 -- start start 2024-04-22T06:32:07.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.386+0000 7f4a027fc640 1 -- 172.21.15.113:0/2132776382 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a040b5070 con 0x7f49fc0e6770 2024-04-22T06:32:07.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.386+0000 7f4a027fc640 1 -- 172.21.15.113:0/2132776382 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a040b0440 con 0x7f49fc0e6770 2024-04-22T06:32:07.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.386+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efedc004bc0 con 0x7efeec06e850 2024-04-22T06:32:07.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7efed3fff640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efed806c9f0 0x7efed806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7f4a027fc640 1 -- 172.21.15.113:0/2132776382 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a040b08b0 con 0x7f49fc0e6770 2024-04-22T06:32:07.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7f352f0eb640 1 Processor -- start 2024-04-22T06:32:07.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7fb21f59e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb2180452d0 0x7fb218045700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7fb21f59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb2180e6770 0x7fb2180e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7fb21f59e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb218045c40 con 0x7fb2180dd450 2024-04-22T06:32:07.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7fb21f59e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb218007650 con 0x7fb2180e6770 2024-04-22T06:32:07.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7fb21f59e640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb218006a40 con 0x7fb2180452d0 2024-04-22T06:32:07.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7fb21ed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb2180e6770 0x7fb2180e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7efeeaffd640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efed806c9f0 0x7efed806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efecc001030 con 0x7efeec06e850 2024-04-22T06:32:07.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7efeeaffd640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efed806c9f0 0x7efed806eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efee4039000 tx=0x7efee400a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7fb21ed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb2180e6770 0x7fb2180e6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33878/0 (socket says 172.21.15.113:33878) 2024-04-22T06:32:07.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.387+0000 7fb21ed9d640 1 -- 172.21.15.113:0/3446633362 learned_addr learned my addr 172.21.15.113:0/3446633362 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7fb21ed9d640 1 -- 172.21.15.113:0/3446633362 >> v2:172.21.15.145:3300/0 conn(0x7fb2180452d0 msgr2=0x7fb218045700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7f4a09dbd640 1 -- 172.21.15.113:0/2132776382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0e6770 msgr2=0x7f49fc0e6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7f4a09dbd640 1 --2- 172.21.15.113:0/2132776382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0e6770 0x7f49fc0e6be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4a04064fa0 tx=0x7f4a040a8040 comp rx=0 tx=0).stop 2024-04-22T06:32:07.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7f4a09dbd640 1 -- 172.21.15.113:0/2132776382 shutdown_connections 2024-04-22T06:32:07.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7f4a09dbd640 1 --2- 172.21.15.113:0/2132776382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0e6770 0x7f49fc0e6be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7f4a09dbd640 1 --2- 172.21.15.113:0/2132776382 >> v2:172.21.15.113:3300/0 conn(0x7f49fc0dd450 0x7f49fc04b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7f4a09dbd640 1 -- 172.21.15.113:0/2132776382 >> 172.21.15.113:0/2132776382 conn(0x7f49fc050180 msgr2=0x7f49fc050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7fb21ed9d640 1 --2- 172.21.15.113:0/3446633362 >> v2:172.21.15.145:3300/0 conn(0x7fb2180452d0 0x7fb218045700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efedc08f8a0 con 0x7efeec06e850 2024-04-22T06:32:07.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7efed3fff640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:6800/1083398722,v1:172.21.15.145:6801/1083398722] conn(0x7efed8076060 0x7efed80784a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 --> [v2:172.21.15.145:6800/1083398722,v1:172.21.15.145:6801/1083398722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efedc00ae50 con 0x7efed8076060 2024-04-22T06:32:07.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7fb21ed9d640 1 -- 172.21.15.113:0/3446633362 >> v1:172.21.15.145:6789/0 conn(0x7fb2180dd450 legacy=0x7fb21804b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7fb21ed9d640 1 -- 172.21.15.113:0/3446633362 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb218006d20 con 0x7fb2180e6770 2024-04-22T06:32:07.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.388+0000 7f352f0eb640 1 -- start start 2024-04-22T06:32:07.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f4a09dbd640 1 -- 172.21.15.113:0/2132776382 shutdown_connections 2024-04-22T06:32:07.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f85f5281640 1 Processor -- start 2024-04-22T06:32:07.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efedc096050 con 0x7efeec06e850 2024-04-22T06:32:07.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f85f5281640 1 -- start start 2024-04-22T06:32:07.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f352f0eb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f352806f870 0x7f35281570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f352f0eb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35280c46b0 con 0x7f352806ec30 2024-04-22T06:32:07.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f352f0eb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35280c4990 con 0x7f352806e850 2024-04-22T06:32:07.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f352f0eb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f35280c4c70 con 0x7f352806f870 2024-04-22T06:32:07.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f3527fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f352806f870 0x7f35281570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f3527fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f352806f870 0x7f35281570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57090/0 (socket says 172.21.15.113:57090) 2024-04-22T06:32:07.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7fb21ed9d640 1 --2- 172.21.15.113:0/3446633362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 0x7fb2180e6bc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb218050ff0 tx=0x7fb21402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a291937b7c8f8825 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f3527fff640 1 -- 172.21.15.113:0/2906397647 learned_addr learned my addr 172.21.15.113:0/2906397647 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.390+0000 7fb21d59a640 1 -- 172.21.15.113:0/3446633362 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214034070 con 0x7fb2180e6770 2024-04-22T06:32:07.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.390+0000 7fb21d59a640 1 -- 172.21.15.113:0/3446633362 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb214030860 con 0x7fb2180e6770 2024-04-22T06:32:07.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.390+0000 7fb21d59a640 1 -- 172.21.15.113:0/3446633362 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214030c30 con 0x7fb2180e6770 2024-04-22T06:32:07.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.390+0000 7f85f5281640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f006f870 0x7f85f01f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85f5281640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f00c5a30 0x7f85f0153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f3527fff640 1 -- 172.21.15.113:0/2906397647 >> v1:172.21.15.145:6789/0 conn(0x7f352806e850 legacy=0x7f3528150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f3527fff640 1 -- 172.21.15.113:0/2906397647 >> v1:172.21.15.113:6789/0 conn(0x7f352806ec30 legacy=0x7f3528161a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:07.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85f5281640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f0153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.390+0000 7f3527fff640 1 -- 172.21.15.113:0/2906397647 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35280c4f50 con 0x7f352806f870 2024-04-22T06:32:07.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f3527fff640 1 --2- 172.21.15.113:0/2906397647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 0x7f35281570f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3514009870 tx=0x7f351402dbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5296c7df0808d07 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.401 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f00c5a30 0x7f85f0153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.401 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f00c5a30 0x7f85f0153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33886/0 (socket says 172.21.15.113:33886) 2024-04-22T06:32:07.401 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85ee7fc640 1 -- 172.21.15.113:0/4292907352 learned_addr learned my addr 172.21.15.113:0/4292907352 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.401 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f85f006ee70 con 0x7f85f00c5a30 2024-04-22T06:32:07.401 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85ef7fe640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f0153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.401 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f85f006ecf0 con 0x7f85f006f870 2024-04-22T06:32:07.401 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f85f00c6e00 con 0x7f85f00c99f0 2024-04-22T06:32:07.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7fb21f59e640 1 -- 172.21.15.113:0/3446633362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 msgr2=0x7fb2180e6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7fb21f59e640 1 --2- 172.21.15.113:0/3446633362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 0x7fb2180e6bc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb218050ff0 tx=0x7fb21402b9a0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7fdc89a77640 1 Processor -- start 2024-04-22T06:32:07.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7efeebfff640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:6800/1083398722,v1:172.21.15.145:6801/1083398722] conn(0x7efed8076060 0x7efed80784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7fb21f59e640 1 -- 172.21.15.113:0/3446633362 shutdown_connections 2024-04-22T06:32:07.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7fb21f59e640 1 --2- 172.21.15.113:0/3446633362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 0x7fb2180e6bc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7fb21f59e640 1 --2- 172.21.15.113:0/3446633362 >> v2:172.21.15.145:3300/0 conn(0x7fb2180452d0 0x7fb218045700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7fb21f59e640 1 -- 172.21.15.113:0/3446633362 >> 172.21.15.113:0/3446633362 conn(0x7fb218050180 msgr2=0x7fb218050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f35277fe640 1 -- 172.21.15.113:0/2906397647 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351403b070 con 0x7f352806f870 2024-04-22T06:32:07.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7fb21f59e640 1 -- 172.21.15.113:0/3446633362 shutdown_connections 2024-04-22T06:32:07.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f35277fe640 1 -- 172.21.15.113:0/2906397647 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351402e970 con 0x7f352806f870 2024-04-22T06:32:07.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f35277fe640 1 -- 172.21.15.113:0/2906397647 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351402ed40 con 0x7f352806f870 2024-04-22T06:32:07.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f352f0eb640 1 -- 172.21.15.113:0/2906397647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 msgr2=0x7f35281570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f352f0eb640 1 --2- 172.21.15.113:0/2906397647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 0x7f35281570f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3514009870 tx=0x7f351402dbc0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f352f0eb640 1 -- 172.21.15.113:0/2906397647 shutdown_connections 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f352f0eb640 1 --2- 172.21.15.113:0/2906397647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 0x7f35281570f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f352f0eb640 1 -- 172.21.15.113:0/2906397647 >> 172.21.15.113:0/2906397647 conn(0x7f35280c8f00 msgr2=0x7f35280c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f85ee7fc640 1 -- 172.21.15.113:0/4292907352 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 msgr2=0x7f85f0153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f85ee7fc640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f00c99f0 0x7f85f0153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f85ee7fc640 1 -- 172.21.15.113:0/4292907352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f006f870 msgr2=0x7f85f01f9370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f85ee7fc640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f006f870 0x7f85f01f9370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f85ee7fc640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f0145270 con 0x7f85f00c5a30 2024-04-22T06:32:07.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.389+0000 7f4a09dbd640 1 -- 172.21.15.113:0/2132776382 wait complete. 2024-04-22T06:32:07.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f4a09dbd640 1 Processor -- start 2024-04-22T06:32:07.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.391+0000 7f4a09dbd640 1 -- start start 2024-04-22T06:32:07.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f4a09dbd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49fc0452d0 0x7f49fc0d4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f4a09dbd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0dd450 0x7f49fc005810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f4a09dbd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc0e6770 0x7f49fc195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f4a09dbd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc0dd830 con 0x7f49fc0452d0 2024-04-22T06:32:07.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f352f0eb640 1 -- 172.21.15.113:0/2906397647 shutdown_connections 2024-04-22T06:32:07.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f4a09dbd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc0072e0 con 0x7f49fc0dd450 2024-04-22T06:32:07.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f4a09dbd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f49fc04c700 con 0x7f49fc0e6770 2024-04-22T06:32:07.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f85ee7fc640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f00c5a30 0x7f85f0153a40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f85e8036040 tx=0x7f85e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7f352f0eb640 1 -- 172.21.15.113:0/2906397647 wait complete. 2024-04-22T06:32:07.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8042020 con 0x7f85f00c5a30 2024-04-22T06:32:07.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8004600 con 0x7f85f00c5a30 2024-04-22T06:32:07.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e803e450 con 0x7f85f00c5a30 2024-04-22T06:32:07.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.392+0000 7fdc89a77640 1 -- start start 2024-04-22T06:32:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7fdc89a77640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 0x7fdc840c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7fdc89a77640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdc840c3870 0x7fdc84150c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7fdc89a77640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc84157ef0 con 0x7fdc8406e9e0 2024-04-22T06:32:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7fdc89a77640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fdc840c8600 con 0x7fdc840c3870 2024-04-22T06:32:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7fdc89a77640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fdc840c6d00 con 0x7fdc8406e600 2024-04-22T06:32:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49fc0452d0 0x7f49fc0d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49fc0452d0 0x7f49fc0d4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33898/0 (socket says 172.21.15.113:33898) 2024-04-22T06:32:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 -- 172.21.15.113:0/1578430652 learned_addr learned my addr 172.21.15.113:0/1578430652 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 -- 172.21.15.113:0/1578430652 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc0e6770 msgr2=0x7f49fc195a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f49fc0e6770 0x7f49fc195a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 -- 172.21.15.113:0/1578430652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0dd450 msgr2=0x7f49fc005810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49fc0dd450 0x7f49fc005810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 -- 172.21.15.113:0/1578430652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc0d6360 con 0x7f49fc0452d0 2024-04-22T06:32:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f4a037fe640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49fc0452d0 0x7f49fc0d4170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f49f800c820 tx=0x7f49f800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f0145550 con 0x7f85f00c5a30 2024-04-22T06:32:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.394+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f0139a70 con 0x7f85f00c5a30 2024-04-22T06:32:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7fdc89276640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdc840c3870 0x7fdc84150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7fdc89276640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdc840c3870 0x7fdc84150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57124/0 (socket says 172.21.15.113:57124) 2024-04-22T06:32:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.394+0000 7fdc83fff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fdc8406e9e0 0x7fdc840c3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:40972/0 (socket says 172.21.15.113:40972) 2024-04-22T06:32:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.394+0000 7fdc83fff640 1 -- 172.21.15.113:0/1263065141 learned_addr learned my addr 172.21.15.113:0/1263065141 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.394+0000 7fdc88a75640 1 --2- 172.21.15.113:0/1263065141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 0x7fdc840c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.393+0000 7fb21f59e640 1 -- 172.21.15.113:0/3446633362 wait complete. 2024-04-22T06:32:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7fb21f59e640 1 Processor -- start 2024-04-22T06:32:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7fb21f59e640 1 -- start start 2024-04-22T06:32:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85f0145020 con 0x7f85f00c5a30 2024-04-22T06:32:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7fdc89276640 1 -- 172.21.15.113:0/1263065141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 msgr2=0x7fdc840c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7fdc89276640 1 --2- 172.21.15.113:0/1263065141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 0x7fdc840c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7fdc89276640 1 -- 172.21.15.113:0/1263065141 >> v1:172.21.15.145:6789/0 conn(0x7fdc8406e9e0 legacy=0x7fdc840c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7fdc89276640 1 -- 172.21.15.113:0/1263065141 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc840c6f50 con 0x7fdc840c3870 2024-04-22T06:32:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7f352f0eb640 1 Processor -- start 2024-04-22T06:32:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85e8045020 con 0x7f85f00c5a30 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21f59e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2180452d0 0x7fb218179a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21f59e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2180dd450 0x7fb2180df170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21f59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 0x7fb218034990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21f59e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180dd830 con 0x7fb2180e6770 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21f59e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180072e0 con 0x7fb2180452d0 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21f59e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb21804c700 con 0x7fb2180dd450 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 0x7fb218034990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21ed9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 0x7fb218034990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33906/0 (socket says 172.21.15.113:33906) 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21ed9d640 1 -- 172.21.15.113:0/4114549290 learned_addr learned my addr 172.21.15.113:0/4114549290 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21e59c640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2180452d0 0x7fb218179a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8015070 con 0x7f49fc0452d0 2024-04-22T06:32:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f8007a30 con 0x7f49fc0452d0 2024-04-22T06:32:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.395+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8007de0 con 0x7f49fc0452d0 2024-04-22T06:32:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7f85d77fe640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f85dc06c8f0 0x7f85dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f85e80ae240 con 0x7f85f00c5a30 2024-04-22T06:32:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7f85d77fe640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f85dc075f60 0x7f85dc0783a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85e803ae50 con 0x7f85dc075f60 2024-04-22T06:32:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49fc0d4900 con 0x7f49fc0452d0 2024-04-22T06:32:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49fc0d65d0 con 0x7f49fc0452d0 2024-04-22T06:32:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.396+0000 7fb21dd9b640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2180dd450 0x7fb2180df170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7f352f0eb640 1 -- start start 2024-04-22T06:32:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49fc0d46b0 con 0x7f49fc0452d0 2024-04-22T06:32:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fdc89276640 1 --2- 172.21.15.113:0/1263065141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc840c3870 0x7fdc84150c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009d90 tx=0x7fdc7c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70516d6e22b1603 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fb21e59c640 1 -- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2180dd450 msgr2=0x7fb2180df170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f85e80b5050 con 0x7f85f00c5a30 2024-04-22T06:32:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fb21e59c640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2180dd450 0x7fb2180df170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fb21e59c640 1 -- 172.21.15.113:0/4114549290 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 msgr2=0x7fb218034990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7f85eeffd640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f85dc06c8f0 0x7f85dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7f85ef7fe640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f85dc075f60 0x7f85dc0783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fb21e59c640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 0x7fb218034990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fb21e59c640 1 -- 172.21.15.113:0/4114549290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb218178f90 con 0x7fb2180452d0 2024-04-22T06:32:07.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fdc837fe640 1 -- 172.21.15.113:0/1263065141 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c039070 con 0x7fdc840c3870 2024-04-22T06:32:07.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fdc837fe640 1 -- 172.21.15.113:0/1263065141 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c02cc90 con 0x7fdc840c3870 2024-04-22T06:32:07.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fdc837fe640 1 -- 172.21.15.113:0/1263065141 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c034660 con 0x7fdc840c3870 2024-04-22T06:32:07.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fb21dd9b640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2180dd450 0x7fb2180df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:07.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7f85ef7fe640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f85dc075f60 0x7f85dc0783a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fddfa1bd640 1 Processor -- start 2024-04-22T06:32:07.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7fddfa1bd640 1 -- start start 2024-04-22T06:32:07.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fddfa1bd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fddf40ca700 0x7fddf4071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fddfa1bd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf4157d70 con 0x7fddf40741b0 2024-04-22T06:32:07.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fddfa1bd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf4071c60 con 0x7fddf414db90 2024-04-22T06:32:07.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fddfa1bd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fddf415b550 con 0x7fddf40ca700 2024-04-22T06:32:07.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7f352f0eb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f352806e850 0x7f3528151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7f352f0eb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f352806ec30 0x7f352814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7f352f0eb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 0x7f352814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7f352f0eb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3528151610 con 0x7f352806e850 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7f3527fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f352806ec30 0x7f352814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7f3527fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f352806ec30 0x7f352814ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:48446/0 (socket says 172.21.15.113:48446) 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7f3527fff640 1 -- 172.21.15.113:0/331231349 learned_addr learned my addr 172.21.15.113:0/331231349 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7f352f0eb640 1 -- 172.21.15.113:0/331231349 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f35280c5510 con 0x7f352806f870 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7f352f0eb640 1 -- 172.21.15.113:0/331231349 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3528151790 con 0x7f352806ec30 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7fb21e59c640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2180452d0 0x7fb218179a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb220050a90 tx=0x7fb220069e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220074460 con 0x7fb2180452d0 2024-04-22T06:32:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2200763a0 con 0x7fb2180452d0 2024-04-22T06:32:07.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22006bb60 con 0x7fb2180452d0 2024-04-22T06:32:07.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7fb21f59e640 1 -- 172.21.15.113:0/4114549290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21817cfa0 con 0x7fb2180452d0 2024-04-22T06:32:07.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7fb21f59e640 1 -- 172.21.15.113:0/4114549290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb218179510 con 0x7fb2180452d0 2024-04-22T06:32:07.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fb21ed9d640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2180e6770 0x7fb218034990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:07.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49f8018070 con 0x7f49fc0452d0 2024-04-22T06:32:07.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7f85eeffd640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f85dc06c8f0 0x7f85dc06edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85e40095d0 tx=0x7f85e4006b30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 <== osd.2 v2:172.21.15.113:6817/3529664663 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85e803ae50 con 0x7f85dc075f60 2024-04-22T06:32:07.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fddf3fff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fddf414db90 0x7fddf4071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:40988/0 (socket says 172.21.15.113:40988) 2024-04-22T06:32:07.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fddf3fff640 1 -- 172.21.15.113:0/3002567596 learned_addr learned my addr 172.21.15.113:0/3002567596 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:07.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7fdc89a77640 1 -- 172.21.15.113:0/1263065141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc840c3870 msgr2=0x7fdc84150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7fdc89a77640 1 --2- 172.21.15.113:0/1263065141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc840c3870 0x7fdc84150c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009d90 tx=0x7fdc7c02bee0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fdc89a77640 1 -- 172.21.15.113:0/1263065141 shutdown_connections 2024-04-22T06:32:07.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fdc89a77640 1 --2- 172.21.15.113:0/1263065141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc840c3870 0x7fdc84150c80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fdc89a77640 1 --2- 172.21.15.113:0/1263065141 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 0x7fdc840c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fdc89a77640 1 -- 172.21.15.113:0/1263065141 >> 172.21.15.113:0/1263065141 conn(0x7fdc840c8e00 msgr2=0x7fdc840c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.399+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434267168 0 0) 0x7fddf4071c60 con 0x7fddf414db90 2024-04-22T06:32:07.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddd8003520 con 0x7fddf414db90 2024-04-22T06:32:07.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.397+0000 7efeebfff640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:6800/1083398722,v1:172.21.15.145:6801/1083398722] conn(0x7efed8076060 0x7efed80784a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.398+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 <== osd.4 v2:172.21.15.145:6800/1083398722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efedc00ae50 con 0x7efed8076060 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7f49effff640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f49e806c9c0 0x7f49e806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f49f808be40 con 0x7f49fc0452d0 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7f49effff640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f49e80760c0 0x7f49e8078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 --> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49e8078bd0 con 0x7f49e80760c0 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7f4a02ffd640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f49e806c9c0 0x7f49e806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7f4a03fff640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f49e80760c0 0x7f49e8078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7f4a02ffd640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f49e806c9c0 0x7f49e806ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49f0000f60 tx=0x7f49f00079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7f4a03fff640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f49e80760c0 0x7f49e8078500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3702333382 0 0) 0x7fddd8003520 con 0x7fddf414db90 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 >> v2:172.21.15.145:3300/0 conn(0x7fddf40ca700 msgr2=0x7fddf4071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 --2- 172.21.15.113:0/3002567596 >> v2:172.21.15.145:3300/0 conn(0x7fddf40ca700 0x7fddf4071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 >> v1:172.21.15.113:6789/0 conn(0x7fddf40741b0 legacy=0x7fddf4074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 --> v1:172.21.15.145:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf415a790 con 0x7fddf414db90 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 <== mon.1 v1:172.21.15.145:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fddec0019f0 con 0x7fddf414db90 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 >> v1:172.21.15.145:6789/0 conn(0x7fddf414db90 legacy=0x7fddf4071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddd8003a00 0x7fddd8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd8004800 0x7fddd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddd80053c0 0x7fddd800ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fddf415b550 con 0x7fddd8004800 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fddd800c2e0 con 0x7fddd80053c0 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fddd800c4e0 con 0x7fddd8003a00 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fddf3fff640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddd80053c0 0x7fddd800ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fddf2ffd640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd8004800 0x7fddd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fddf37fe640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddd8003a00 0x7fddd8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fddf2ffd640 1 -- 172.21.15.113:0/3002567596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddd8003a00 msgr2=0x7fddd8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fddf2ffd640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddd8003a00 0x7fddd8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fddf2ffd640 1 -- 172.21.15.113:0/3002567596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddd80053c0 msgr2=0x7fddd800ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fddf2ffd640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddd80053c0 0x7fddd800ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fddf2ffd640 1 -- 172.21.15.113:0/3002567596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd8003520 con 0x7fddd8004800 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7f352d688640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 0x7f352814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7f352d688640 1 -- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f352806ec30 msgr2=0x7f352814ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7f352d688640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f352806ec30 0x7f352814ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7f352d688640 1 -- 172.21.15.113:0/331231349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f352806e850 msgr2=0x7f3528151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7f352d688640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f352806e850 0x7f3528151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7f352d688640 1 -- 172.21.15.113:0/331231349 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3528152470 con 0x7f352806f870 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7f352d688640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 0x7f352814cf10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f352000bdd0 tx=0x7f3520009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7f35257fa640 1 -- 172.21.15.113:0/331231349 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520019070 con 0x7f352806f870 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7f35257fa640 1 -- 172.21.15.113:0/331231349 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f352000cdf0 con 0x7f352806f870 2024-04-22T06:32:07.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7f35257fa640 1 -- 172.21.15.113:0/331231349 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520014660 con 0x7f352806f870 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fb21f59e640 1 -- 172.21.15.113:0/4114549290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb204001030 con 0x7fb2180452d0 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.400+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb22006bd00 con 0x7fb2180452d0 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fb20effd640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb20006c940 0x7fb20006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb220107610 con 0x7fb2180452d0 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fb20effd640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:6824/1218898013,v1:172.21.15.145:6825/1218898013] conn(0x7fb2000760b0 0x7fb2000784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 --> [v2:172.21.15.145:6824/1218898013,v1:172.21.15.145:6825/1218898013] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb220071e50 con 0x7fb2000760b0 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb22010e050 con 0x7fb2180452d0 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fb21dd9b640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb20006c940 0x7fb20006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.401+0000 7fb21dd9b640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb20006c940 0x7fb20006ee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb2180d9230 tx=0x7fb210008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7fb21ed9d640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:6824/1218898013,v1:172.21.15.145:6825/1218898013] conn(0x7fb2000760b0 0x7fb2000784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7fddf2ffd640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd8004800 0x7fddd8004c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009880 tx=0x7fddd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30da8924f35a491b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7fddf3fff640 1 -- 172.21.15.113:0/3002567596 reap_dead start 2024-04-22T06:32:07.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.402+0000 7fb21ed9d640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:6824/1218898013,v1:172.21.15.145:6825/1218898013] conn(0x7fb2000760b0 0x7fb2000784f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7f3527fff640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f352806ec30 0x7f352814ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:07.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4037070 con 0x7fddd8004800 2024-04-22T06:32:07.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde4032600 con 0x7fddd8004800 2024-04-22T06:32:07.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7fddf27fc640 1 -- 172.21.15.113:0/3002567596 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4009480 con 0x7fddd8004800 2024-04-22T06:32:07.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7f352f0eb640 1 -- 172.21.15.113:0/331231349 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3528152730 con 0x7f352806f870 2024-04-22T06:32:07.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7f352f0eb640 1 -- 172.21.15.113:0/331231349 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f352815a450 con 0x7f352806f870 2024-04-22T06:32:07.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f49f8055ab0 con 0x7f49fc0452d0 2024-04-22T06:32:07.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7fdc89a77640 1 -- 172.21.15.113:0/1263065141 shutdown_connections 2024-04-22T06:32:07.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 <== osd.0 v2:172.21.15.113:6801/3692586623 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49e8078bd0 con 0x7f49e80760c0 2024-04-22T06:32:07.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7fdc89a77640 1 -- 172.21.15.113:0/1263065141 wait complete. 2024-04-22T06:32:07.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.403+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 <== osd.7 v2:172.21.15.145:6824/1218898013 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb220071e50 con 0x7fb2000760b0 2024-04-22T06:32:07.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.404+0000 7fddfa1bd640 1 -- 172.21.15.113:0/3002567596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd8004800 msgr2=0x7fddd8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.404+0000 7fddfa1bd640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd8004800 0x7fddd8004c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009880 tx=0x7fddd8005830 comp rx=0 tx=0).stop 2024-04-22T06:32:07.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.404+0000 7fddfa1bd640 1 -- 172.21.15.113:0/3002567596 shutdown_connections 2024-04-22T06:32:07.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.404+0000 7fddfa1bd640 1 --2- 172.21.15.113:0/3002567596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddd8004800 0x7fddd8004c80 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009880 tx=0x7fddd8005830 comp rx=0 tx=0).stop 2024-04-22T06:32:07.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.404+0000 7fddfa1bd640 1 -- 172.21.15.113:0/3002567596 >> 172.21.15.113:0/3002567596 conn(0x7fddf40c8e00 msgr2=0x7fddf40c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.404+0000 7fddfa1bd640 1 -- 172.21.15.113:0/3002567596 shutdown_connections 2024-04-22T06:32:07.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.405+0000 7f35257fa640 1 -- 172.21.15.113:0/331231349 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3520014800 con 0x7f352806f870 2024-04-22T06:32:07.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.405+0000 7fdc89a77640 1 Processor -- start 2024-04-22T06:32:07.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.405+0000 7fdc89a77640 1 -- start start 2024-04-22T06:32:07.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.406+0000 7f35257fa640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f350c06c9f0 0x7f350c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.404+0000 7fddfa1bd640 1 -- 172.21.15.113:0/3002567596 wait complete. 2024-04-22T06:32:07.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.406+0000 7f352ce87640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f350c06c9f0 0x7f350c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.406+0000 7f35257fa640 1 -- 172.21.15.113:0/331231349 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f352008bd60 con 0x7f352806f870 2024-04-22T06:32:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.406+0000 7fddfa1bd640 1 Processor -- start 2024-04-22T06:32:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.406+0000 7fddfa1bd640 1 -- start start 2024-04-22T06:32:07.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7f352f0eb640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:6802/294884846,v1:172.21.15.145:6804/294884846] conn(0x7f352815ab50 0x7f35280cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7f352f0eb640 1 -- 172.21.15.113:0/331231349 --> [v2:172.21.15.145:6802/294884846,v1:172.21.15.145:6804/294884846] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3528068e40 con 0x7f352815ab50 2024-04-22T06:32:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7f352ce87640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f350c06c9f0 0x7f350c06eeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f351c001560 tx=0x7f351c007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7f3527fff640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:6802/294884846,v1:172.21.15.145:6804/294884846] conn(0x7f352815ab50 0x7f35280cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fdc89a77640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 0x7fdc84201390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fdc89a77640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8406e9e0 0x7fdc84153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fdc89a77640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c3870 0x7fdc84151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fdc89a77640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fdc840c77f0 con 0x7fdc840c3870 2024-04-22T06:32:07.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fdc89a77640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdc840c7510 con 0x7fdc8406e9e0 2024-04-22T06:32:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fdc89a77640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fdc84157b90 con 0x7fdc8406e600 2024-04-22T06:32:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fddfa1bd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddf41537c0 0x7fddf4149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fddfa1bd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddf414d040 0x7fddf4153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fddfa1bd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf41540e0 0x7fddf414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7f663bfff640 1 Processor -- start 2024-04-22T06:32:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fddfa1bd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fddf415ad50 con 0x7fddf414d040 2024-04-22T06:32:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fddfa1bd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fddf415b030 con 0x7fddf41540e0 2024-04-22T06:32:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fddfa1bd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fddf4157a70 con 0x7fddf41537c0 2024-04-22T06:32:07.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7f663bfff640 1 -- start start 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf41540e0 0x7fddf414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf41540e0 0x7fddf414b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57172/0 (socket says 172.21.15.113:57172) 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 -- 172.21.15.113:0/1595803231 learned_addr learned my addr 172.21.15.113:0/1595803231 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf37fe640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddf41537c0 0x7fddf4149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf2ffd640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddf414d040 0x7fddf4153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 -- 172.21.15.113:0/1595803231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddf41537c0 msgr2=0x7fddf4149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fddf41537c0 0x7fddf4149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 -- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddf414d040 msgr2=0x7fddf4153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddf414d040 0x7fddf4153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 -- 172.21.15.113:0/1595803231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf4145c10 con 0x7fddf41540e0 2024-04-22T06:32:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf2ffd640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddf414d040 0x7fddf4153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7f3527fff640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:6802/294884846,v1:172.21.15.145:6804/294884846] conn(0x7f352815ab50 0x7f35280cb660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.407+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8406e9e0 0x7fdc84153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fdc88a75640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 0x7fdc84201390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8406e9e0 0x7fdc84153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57182/0 (socket says 172.21.15.113:57182) 2024-04-22T06:32:07.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fdc83fff640 1 -- 172.21.15.113:0/823432571 learned_addr learned my addr 172.21.15.113:0/823432571 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fdc89276640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c3870 0x7fdc84151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fddf3fff640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf41540e0 0x7fddf414b710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fddf406ce30 tx=0x7fddec007b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fdc89276640 1 -- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 msgr2=0x7fdc84201390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.408+0000 7fdc89276640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8406e600 0x7fdc84201390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fdc89276640 1 -- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8406e9e0 msgr2=0x7fdc84153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fdc89276640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8406e9e0 0x7fdc84153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fdc89276640 1 -- 172.21.15.113:0/823432571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc842018d0 con 0x7fdc840c3870 2024-04-22T06:32:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fdc83fff640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8406e9e0 0x7fdc84153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec00aad0 con 0x7fddf41540e0 2024-04-22T06:32:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec018070 con 0x7fddf41540e0 2024-04-22T06:32:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec0133f0 con 0x7fddf41540e0 2024-04-22T06:32:07.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf4154560 con 0x7fddf41540e0 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf4169e70 con 0x7fddf41540e0 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7fdde9ffb640 1 -- 172.21.15.113:0/1595803231 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fddf4068cc0 con 0x7fddf41540e0 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.411+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fddec013590 con 0x7fddf41540e0 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.411+0000 7fddebfff640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdddc06c9c0 0x7fdddc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fddec08c3e0 con 0x7fddf41540e0 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7fddebfff640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fdddc076130 0x7fdddc078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 --> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddec005e50 con 0x7fdddc076130 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fddec093050 con 0x7fddf41540e0 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7f663bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6634045720 0x7f6634045b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7f663bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 0x7f66340de840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7f663bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6634046090 con 0x7f66340d5090 2024-04-22T06:32:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7f663bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f6634007aa0 con 0x7f6634045720 2024-04-22T06:32:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7f663b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 0x7f66340de840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7f663b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 0x7f66340de840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:48478/0 (socket says 172.21.15.113:48478) 2024-04-22T06:32:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7f663b7fe640 1 -- 172.21.15.113:0/1413175504 learned_addr learned my addr 172.21.15.113:0/1413175504 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7f663bfff640 1 -- 172.21.15.113:0/1413175504 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6634006e90 con 0x7f66340de3b0 2024-04-22T06:32:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7f35257fa640 1 -- 172.21.15.113:0/331231349 <== osd.5 v2:172.21.15.145:6802/294884846 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3528068e40 con 0x7f352815ab50 2024-04-22T06:32:07.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.409+0000 7fdc89276640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c3870 0x7fdc84151a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c033000 tx=0x7fdc7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.410+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c044020 con 0x7fdc840c3870 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.411+0000 7fdc89a77640 1 -- 172.21.15.113:0/823432571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc84154510 con 0x7fdc840c3870 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.411+0000 7fdc89a77640 1 -- 172.21.15.113:0/823432571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc841547c0 con 0x7fdc840c3870 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.411+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c03f470 con 0x7fdc840c3870 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.411+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c039040 con 0x7fdc840c3870 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc64001030 con 0x7fdc840c3870 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.413+0000 7fddf37fe640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdddc06c9c0 0x7fdddc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.413+0000 7fddf2ffd640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fdddc076130 0x7fdddc078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.414+0000 7fddf37fe640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdddc06c9c0 0x7fdddc06ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fddf40cb740 tx=0x7fdde0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7f663b7fe640 1 -- 172.21.15.113:0/1413175504 >> v2:172.21.15.145:3300/0 conn(0x7f6634045720 msgr2=0x7f6634045b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T06:32:07.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7f663b7fe640 1 --2- 172.21.15.113:0/1413175504 >> v2:172.21.15.145:3300/0 conn(0x7f6634045720 0x7f6634045b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7f663b7fe640 1 -- 172.21.15.113:0/1413175504 >> v1:172.21.15.145:6789/0 conn(0x7f66340d5090 legacy=0x7f663404b750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T06:32:07.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.412+0000 7f663b7fe640 1 -- 172.21.15.113:0/1413175504 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6634007170 con 0x7f66340de3b0 2024-04-22T06:32:07.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.413+0000 7f663b7fe640 1 --2- 172.21.15.113:0/1413175504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 0x7f66340de840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f663c07ccd0 tx=0x7f663c0a90a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=addf9ee230f452de server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.414+0000 7f6639ffb640 1 -- 172.21.15.113:0/1413175504 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c06e9e0 con 0x7f66340de3b0 2024-04-22T06:32:07.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.414+0000 7f6639ffb640 1 -- 172.21.15.113:0/1413175504 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663c06eb80 con 0x7f66340de3b0 2024-04-22T06:32:07.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.414+0000 7f6639ffb640 1 -- 172.21.15.113:0/1413175504 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c0700d0 con 0x7f66340de3b0 2024-04-22T06:32:07.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.414+0000 7fddf2ffd640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fdddc076130 0x7fdddc078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.414+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc7c047020 con 0x7fdc840c3870 2024-04-22T06:32:07.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.415+0000 7fdc817fa640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c9c0 0x7fdc7006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.415+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 <== osd.1 v2:172.21.15.113:6800/2620218774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fddec005e50 con 0x7fdddc076130 2024-04-22T06:32:07.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.415+0000 7f663bfff640 1 -- 172.21.15.113:0/1413175504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 msgr2=0x7f66340de840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.415+0000 7f663bfff640 1 --2- 172.21.15.113:0/1413175504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 0x7f66340de840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f663c07ccd0 tx=0x7f663c0a90a0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7f663bfff640 1 -- 172.21.15.113:0/1413175504 shutdown_connections 2024-04-22T06:32:07.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7f663bfff640 1 --2- 172.21.15.113:0/1413175504 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 0x7f66340de840 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7f663bfff640 1 --2- 172.21.15.113:0/1413175504 >> v2:172.21.15.145:3300/0 conn(0x7f6634045720 0x7f6634045b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7f663bfff640 1 -- 172.21.15.113:0/1413175504 >> 172.21.15.113:0/1413175504 conn(0x7f66340505d0 msgr2=0x7f66340509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.415+0000 7fdc88a75640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c9c0 0x7fdc7006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7fdc88a75640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c9c0 0x7fdc7006ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009b90 tx=0x7fdc78009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdc7c0aeda0 con 0x7fdc840c3870 2024-04-22T06:32:07.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7fdc817fa640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:6816/289848006,v1:172.21.15.145:6817/289848006] conn(0x7fdc700760c0 0x7fdc70078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 --> [v2:172.21.15.145:6816/289848006,v1:172.21.15.145:6817/289848006] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc7c02cc90 con 0x7fdc700760c0 2024-04-22T06:32:07.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdc7c0af190 con 0x7fdc840c3870 2024-04-22T06:32:07.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.416+0000 7fdc83fff640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:6816/289848006,v1:172.21.15.145:6817/289848006] conn(0x7fdc700760c0 0x7fdc70078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.417+0000 7f663bfff640 1 -- 172.21.15.113:0/1413175504 shutdown_connections 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.417+0000 7f663bfff640 1 -- 172.21.15.113:0/1413175504 wait complete. 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.419+0000 7f663bfff640 1 Processor -- start 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.419+0000 7f663bfff640 1 -- start start 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.421+0000 7f663bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6634045720 0x7f66341715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.421+0000 7f663bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66340d5090 0x7f66340d64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.421+0000 7f663a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66340d5090 0x7f66340d64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.421+0000 7f663a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66340d5090 0x7f66340d64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33974/0 (socket says 172.21.15.113:33974) 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.421+0000 7f663a7fc640 1 -- 172.21.15.113:0/384604493 learned_addr learned my addr 172.21.15.113:0/384604493 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663bfff640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 0x7f6634174930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f66340d5470 con 0x7f66340d5090 2024-04-22T06:32:07.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6634007730 con 0x7f6634045720 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f663404cb50 con 0x7f66340de3b0 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663a7fc640 1 -- 172.21.15.113:0/384604493 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 msgr2=0x7f6634174930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663a7fc640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66340de3b0 0x7f6634174930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663a7fc640 1 -- 172.21.15.113:0/384604493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6634045720 msgr2=0x7f66341715a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663a7fc640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6634045720 0x7f66341715a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.422+0000 7f663a7fc640 1 -- 172.21.15.113:0/384604493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66340d8700 con 0x7f66340d5090 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.423+0000 7f663a7fc640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66340d5090 0x7f66340d64b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f662c00b700 tx=0x7f662c00bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.423+0000 7f66237fe640 1 -- 172.21.15.113:0/384604493 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c019070 con 0x7f66340d5090 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.424+0000 7f66237fe640 1 -- 172.21.15.113:0/384604493 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662c00c740 con 0x7f66340d5090 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.424+0000 7f66237fe640 1 -- 172.21.15.113:0/384604493 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c00cb30 con 0x7f66340d5090 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.424+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66340d5b10 con 0x7f66340d5090 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.424+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6634170ac0 con 0x7f66340d5090 2024-04-22T06:32:07.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.427+0000 7f66237fe640 1 -- 172.21.15.113:0/384604493 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f662c01c070 con 0x7f66340d5090 2024-04-22T06:32:07.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.427+0000 7f66237fe640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f662806c9c0 0x7f662806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.428+0000 7f663affd640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f662806c9c0 0x7f662806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.428+0000 7f66237fe640 1 -- 172.21.15.113:0/384604493 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f662c08b350 con 0x7f66340d5090 2024-04-22T06:32:07.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.428+0000 7f663affd640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f662806c9c0 0x7f662806ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6630009670 tx=0x7f6630006bd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.428+0000 7fdc83fff640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:6816/289848006,v1:172.21.15.145:6817/289848006] conn(0x7fdc700760c0 0x7fdc70078500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.429+0000 7f663bfff640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6816/1451172414,v1:172.21.15.113:6818/1451172414] conn(0x7f661c001650 0x7f661c003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.429+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 --> [v2:172.21.15.113:6816/1451172414,v1:172.21.15.113:6818/1451172414] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f661c006bb0 con 0x7f661c001650 2024-04-22T06:32:07.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.429+0000 7f663b7fe640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6816/1451172414,v1:172.21.15.113:6818/1451172414] conn(0x7f661c001650 0x7f661c003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.429+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 <== osd.6 v2:172.21.15.145:6816/289848006 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc7c02cc90 con 0x7fdc700760c0 2024-04-22T06:32:07.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.429+0000 7f663b7fe640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6816/1451172414,v1:172.21.15.113:6818/1451172414] conn(0x7f661c001650 0x7f661c003b10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.431+0000 7f66237fe640 1 -- 172.21.15.113:0/384604493 <== osd.3 v2:172.21.15.113:6816/1451172414 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f661c006bb0 con 0x7f661c001650 2024-04-22T06:32:07.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.434+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 --> [v2:172.21.15.145:6800/1083398722,v1:172.21.15.145:6801/1083398722] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efecc002d50 con 0x7efed8076060 2024-04-22T06:32:07.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.435+0000 7fb21f59e640 1 -- 172.21.15.113:0/4114549290 --> [v2:172.21.15.145:6824/1218898013,v1:172.21.15.145:6825/1218898013] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb204002dd0 con 0x7fb2000760b0 2024-04-22T06:32:07.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.436+0000 7fb20effd640 1 -- 172.21.15.113:0/4114549290 <== osd.7 v2:172.21.15.145:6824/1218898013 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb204002dd0 con 0x7fb2000760b0 2024-04-22T06:32:07.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.436+0000 7fb20cff9640 1 -- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:6824/1218898013,v1:172.21.15.145:6825/1218898013] conn(0x7fb2000760b0 msgr2=0x7fb2000784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.436+0000 7fb20cff9640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:6824/1218898013,v1:172.21.15.145:6825/1218898013] conn(0x7fb2000760b0 0x7fb2000784f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.436+0000 7fb20cff9640 1 -- 172.21.15.113:0/4114549290 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb20006c940 msgr2=0x7fb20006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.436+0000 7fb20cff9640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb20006c940 0x7fb20006ee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb2180d9230 tx=0x7fb210008040 comp rx=0 tx=0).stop 2024-04-22T06:32:07.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.436+0000 7fb20cff9640 1 -- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2180452d0 msgr2=0x7fb218179a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7fb20cff9640 1 --2- 172.21.15.113:0/4114549290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2180452d0 0x7fb218179a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb220050a90 tx=0x7fb220069e70 comp rx=0 tx=0).stop 2024-04-22T06:32:07.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7fb21ed9d640 1 -- 172.21.15.113:0/4114549290 reap_dead start 2024-04-22T06:32:07.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7fb20cff9640 1 -- 172.21.15.113:0/4114549290 shutdown_connections 2024-04-22T06:32:07.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7fb20cff9640 1 -- 172.21.15.113:0/4114549290 >> 172.21.15.113:0/4114549290 conn(0x7fb218050180 msgr2=0x7fb2180db760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7efed3fff640 1 -- 172.21.15.113:0/1442174766 <== osd.4 v2:172.21.15.145:6800/1083398722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efecc002d50 con 0x7efed8076060 2024-04-22T06:32:07.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7fb20cff9640 1 -- 172.21.15.113:0/4114549290 shutdown_connections 2024-04-22T06:32:07.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:6800/1083398722,v1:172.21.15.145:6801/1083398722] conn(0x7efed8076060 msgr2=0x7efed80784a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7efef225c640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:6800/1083398722,v1:172.21.15.145:6801/1083398722] conn(0x7efed8076060 0x7efed80784a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.437+0000 7fb20cff9640 1 -- 172.21.15.113:0/4114549290 wait complete. 2024-04-22T06:32:07.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 --> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f85f0068e40 con 0x7f85dc075f60 2024-04-22T06:32:07.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efed806c9f0 msgr2=0x7efed806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efef225c640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7efed806c9f0 0x7efed806eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efee4039000 tx=0x7efee400a040 comp rx=0 tx=0).stop 2024-04-22T06:32:07.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeec06e850 msgr2=0x7efeec1478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efef225c640 1 --2- 172.21.15.113:0/1442174766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efeec06e850 0x7efeec1478c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c4a0 tx=0x7efedc00c960 comp rx=0 tx=0).stop 2024-04-22T06:32:07.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efeebfff640 1 -- 172.21.15.113:0/1442174766 reap_dead start 2024-04-22T06:32:07.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 shutdown_connections 2024-04-22T06:32:07.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 >> 172.21.15.113:0/1442174766 conn(0x7efeec0c8f00 msgr2=0x7efeec071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 shutdown_connections 2024-04-22T06:32:07.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7efef225c640 1 -- 172.21.15.113:0/1442174766 wait complete. 2024-04-22T06:32:07.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.438+0000 7f85d77fe640 1 -- 172.21.15.113:0/4292907352 <== osd.2 v2:172.21.15.113:6817/3529664663 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f85f0068e40 con 0x7f85dc075f60 2024-04-22T06:32:07.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f85dc075f60 msgr2=0x7f85dc0783a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f85dc075f60 0x7f85dc0783a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f85dc06c8f0 msgr2=0x7f85dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f85dc06c8f0 0x7f85dc06edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85e40095d0 tx=0x7f85e4006b30 comp rx=0 tx=0).stop 2024-04-22T06:32:07.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f00c5a30 msgr2=0x7f85f0153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 --2- 172.21.15.113:0/4292907352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f00c5a30 0x7f85f0153a40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f85e8036040 tx=0x7f85e8004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:07.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85ef7fe640 1 -- 172.21.15.113:0/4292907352 reap_dead start 2024-04-22T06:32:07.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 shutdown_connections 2024-04-22T06:32:07.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 >> 172.21.15.113:0/4292907352 conn(0x7f85f00c8f00 msgr2=0x7f85f0150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.439+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 shutdown_connections 2024-04-22T06:32:07.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.440+0000 7f85f5281640 1 -- 172.21.15.113:0/4292907352 wait complete. 2024-04-22T06:32:07.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.443+0000 7f352f0eb640 1 -- 172.21.15.113:0/331231349 --> [v2:172.21.15.145:6802/294884846,v1:172.21.15.145:6804/294884846] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f352814b6f0 con 0x7f352815ab50 2024-04-22T06:32:07.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.443+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 --> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49fc005390 con 0x7f49e80760c0 2024-04-22T06:32:07.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.444+0000 7f49effff640 1 -- 172.21.15.113:0/1578430652 <== osd.0 v2:172.21.15.113:6801/3692586623 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49fc005390 con 0x7f49e80760c0 2024-04-22T06:32:07.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.444+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f49e80760c0 msgr2=0x7f49e8078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.444+0000 7f4a09dbd640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f49e80760c0 0x7f49e8078500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.444+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f49e806c9c0 msgr2=0x7f49e806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.444+0000 7f4a09dbd640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f49e806c9c0 0x7f49e806ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49f0000f60 tx=0x7f49f00079b0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.444+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49fc0452d0 msgr2=0x7f49fc0d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.444+0000 7f4a09dbd640 1 --2- 172.21.15.113:0/1578430652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f49fc0452d0 0x7f49fc0d4170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f49f800c820 tx=0x7f49f800cc20 comp rx=0 tx=0).stop 2024-04-22T06:32:07.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.444+0000 7f4a03fff640 1 -- 172.21.15.113:0/1578430652 reap_dead start 2024-04-22T06:32:07.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.445+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 shutdown_connections 2024-04-22T06:32:07.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.445+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 >> 172.21.15.113:0/1578430652 conn(0x7f49fc050180 msgr2=0x7f49fc04f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.445+0000 7f35257fa640 1 -- 172.21.15.113:0/331231349 <== osd.5 v2:172.21.15.145:6802/294884846 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f352814b6f0 con 0x7f352815ab50 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f3512ffd640 1 -- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:6802/294884846,v1:172.21.15.145:6804/294884846] conn(0x7f352815ab50 msgr2=0x7f35280cb660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f3512ffd640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:6802/294884846,v1:172.21.15.145:6804/294884846] conn(0x7f352815ab50 0x7f35280cb660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f3512ffd640 1 -- 172.21.15.113:0/331231349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f350c06c9f0 msgr2=0x7f350c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f3512ffd640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f350c06c9f0 0x7f350c06eeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f351c001560 tx=0x7f351c007990 comp rx=0 tx=0).stop 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f3512ffd640 1 -- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 msgr2=0x7f352814cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f3512ffd640 1 --2- 172.21.15.113:0/331231349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f352806f870 0x7f352814cf10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f352000bdd0 tx=0x7f3520009ed0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f352d688640 1 -- 172.21.15.113:0/331231349 reap_dead start 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f3512ffd640 1 -- 172.21.15.113:0/331231349 shutdown_connections 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.446+0000 7f3512ffd640 1 -- 172.21.15.113:0/331231349 >> 172.21.15.113:0/331231349 conn(0x7f35280c8f00 msgr2=0x7f35280c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.447+0000 7f3512ffd640 1 -- 172.21.15.113:0/331231349 shutdown_connections 2024-04-22T06:32:07.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.447+0000 7f3512ffd640 1 -- 172.21.15.113:0/331231349 wait complete. 2024-04-22T06:32:07.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.448+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 shutdown_connections 2024-04-22T06:32:07.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.448+0000 7f4a09dbd640 1 -- 172.21.15.113:0/1578430652 wait complete. 2024-04-22T06:32:07.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.448+0000 7fdde9ffb640 1 -- 172.21.15.113:0/1595803231 --> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fddf40ccaf0 con 0x7fdddc076130 2024-04-22T06:32:07.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.449+0000 7fddebfff640 1 -- 172.21.15.113:0/1595803231 <== osd.1 v2:172.21.15.113:6800/2620218774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fddf40ccaf0 con 0x7fdddc076130 2024-04-22T06:32:07.471 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:07.472 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T06:32:07.472 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:07.473 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.459+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fdddc076130 msgr2=0x7fdddc078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.459+0000 7fddfa1bd640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fdddc076130 0x7fdddc078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.459+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdddc06c9c0 msgr2=0x7fdddc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.459+0000 7fddfa1bd640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdddc06c9c0 0x7fdddc06ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fddf40cb740 tx=0x7fdde0009040 comp rx=0 tx=0).stop 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.460+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf41540e0 msgr2=0x7fddf414b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.460+0000 7fddfa1bd640 1 --2- 172.21.15.113:0/1595803231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fddf41540e0 0x7fddf414b710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fddf406ce30 tx=0x7fddec007b00 comp rx=0 tx=0).stop 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.460+0000 7fddf3fff640 1 -- 172.21.15.113:0/1595803231 reap_dead start 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.460+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 shutdown_connections 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.460+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 >> 172.21.15.113:0/1595803231 conn(0x7fddf40c8e00 msgr2=0x7fddf40c6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.460+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 shutdown_connections 2024-04-22T06:32:07.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.461+0000 7fddfa1bd640 1 -- 172.21.15.113:0/1595803231 wait complete. 2024-04-22T06:32:07.475 INFO:teuthology.orchestra.run.smithi113.stdout:55834574860 2024-04-22T06:32:07.475 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T06:32:07.476 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:07.476 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T06:32:07.477 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.464+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 --> [v2:172.21.15.145:6816/289848006,v1:172.21.15.145:6817/289848006] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc64002dd0 con 0x7fdc700760c0 2024-04-22T06:32:07.477 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.465+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 --> [v2:172.21.15.113:6816/1451172414,v1:172.21.15.113:6818/1451172414] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f661c005c40 con 0x7f661c001650 2024-04-22T06:32:07.477 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.465+0000 7fdc817fa640 1 -- 172.21.15.113:0/823432571 <== osd.6 v2:172.21.15.145:6816/289848006 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc64002dd0 con 0x7fdc700760c0 2024-04-22T06:32:07.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.465+0000 7f66237fe640 1 -- 172.21.15.113:0/384604493 <== osd.3 v2:172.21.15.113:6816/1451172414 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f661c005c40 con 0x7f661c001650 2024-04-22T06:32:07.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.465+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:6816/289848006,v1:172.21.15.145:6817/289848006] conn(0x7fdc700760c0 msgr2=0x7fdc70078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.465+0000 7fdc6affd640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.145:6816/289848006,v1:172.21.15.145:6817/289848006] conn(0x7fdc700760c0 0x7fdc70078500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c9c0 msgr2=0x7fdc7006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc6affd640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdc7006c9c0 0x7fdc7006ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009b90 tx=0x7fdc78009190 comp rx=0 tx=0).stop 2024-04-22T06:32:07.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c3870 msgr2=0x7fdc84151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc6affd640 1 --2- 172.21.15.113:0/823432571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc840c3870 0x7fdc84151a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c033000 tx=0x7fdc7c004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:07.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc89276640 1 -- 172.21.15.113:0/823432571 reap_dead start 2024-04-22T06:32:07.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6816/1451172414,v1:172.21.15.113:6818/1451172414] conn(0x7f661c001650 msgr2=0x7f661c003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6816/1451172414,v1:172.21.15.113:6818/1451172414] conn(0x7f661c001650 0x7f661c003b10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f662806c9c0 msgr2=0x7f662806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 shutdown_connections 2024-04-22T06:32:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 >> 172.21.15.113:0/823432571 conn(0x7fdc840c8e00 msgr2=0x7fdc84162450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f662806c9c0 0x7f662806ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6630009670 tx=0x7f6630006bd0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66340d5090 msgr2=0x7f66340d64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 --2- 172.21.15.113:0/384604493 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66340d5090 0x7f66340d64b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f662c00b700 tx=0x7f662c00bbc0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663b7fe640 1 -- 172.21.15.113:0/384604493 reap_dead start 2024-04-22T06:32:07.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 shutdown_connections 2024-04-22T06:32:07.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 >> 172.21.15.113:0/384604493 conn(0x7f66340505d0 msgr2=0x7f66340d3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 shutdown_connections 2024-04-22T06:32:07.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7fdc6affd640 1 -- 172.21.15.113:0/823432571 wait complete. 2024-04-22T06:32:07.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 shutdown_connections 2024-04-22T06:32:07.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.466+0000 7f663bfff640 1 -- 172.21.15.113:0/384604493 wait complete. 2024-04-22T06:32:07.482 INFO:teuthology.orchestra.run.smithi113.stdout:55834574859 2024-04-22T06:32:07.483 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T06:32:07.484 INFO:teuthology.orchestra.run.smithi113.stdout:55834574860 2024-04-22T06:32:07.484 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T06:32:07.485 INFO:teuthology.orchestra.run.smithi113.stdout:55834574860 2024-04-22T06:32:07.485 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T06:32:07.486 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:07.486 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T06:32:07.688 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.689+0000 7fcdc265c640 1 Processor -- start 2024-04-22T06:32:07.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.690+0000 7f5c50811640 1 Processor -- start 2024-04-22T06:32:07.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.690+0000 7f5c50811640 1 -- start start 2024-04-22T06:32:07.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7f5c50811640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 0x7f5c4c157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.690+0000 7fcdc265c640 1 -- start start 2024-04-22T06:32:07.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7fcdc265c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcdbc14da80 0x7fcdbc157a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7fcdc265c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdbc0cb0d0 0x7fcdbc1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7fcdc265c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdbc15b440 con 0x7fcdbc0cac70 2024-04-22T06:32:07.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7fcdc265c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fcdbc14de60 con 0x7fcdbc14da80 2024-04-22T06:32:07.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7fcdc265c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fcdbc15a550 con 0x7fcdbc0cb0d0 2024-04-22T06:32:07.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7fcdbbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcdbc14da80 0x7fcdbc157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7f5c50811640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5c4c0cc830 0x7f5c4c071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7f5c50811640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c0ccd30 con 0x7f5c4c0cc3f0 2024-04-22T06:32:07.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7f5c50811640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4c15a6c0 con 0x7f5c4c0cc830 2024-04-22T06:32:07.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7f5c50811640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4c15a9a0 con 0x7f5c4c151370 2024-04-22T06:32:07.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7f5c4ad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5c4c0cc830 0x7f5c4c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7f5c4ad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5c4c0cc830 0x7f5c4c071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33982/0 (socket says 172.21.15.113:33982) 2024-04-22T06:32:07.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7f5c4ad9d640 1 -- 172.21.15.113:0/531383217 learned_addr learned my addr 172.21.15.113:0/531383217 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7f5c4ad9d640 1 -- 172.21.15.113:0/531383217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 msgr2=0x7f5c4c157b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:07.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7f5c4ad9d640 1 --2- 172.21.15.113:0/531383217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 0x7f5c4c157b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7f5c4ad9d640 1 -- 172.21.15.113:0/531383217 >> v1:172.21.15.145:6789/0 conn(0x7f5c4c0cc3f0 legacy=0x7f5c4c0ca880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T06:32:07.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7f5c4ad9d640 1 -- 172.21.15.113:0/531383217 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c15ac80 con 0x7f5c4c0cc830 2024-04-22T06:32:07.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.693+0000 7f5c4ad9d640 1 --2- 172.21.15.113:0/531383217 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cc830 0x7f5c4c071710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5c44007a60 tx=0x7f5c44034950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fa9c192c538cb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7fcdbbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcdbc14da80 0x7fcdbc157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33978/0 (socket says 172.21.15.113:33978) 2024-04-22T06:32:07.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.691+0000 7fcdbbfff640 1 -- 172.21.15.113:0/2841177757 learned_addr learned my addr 172.21.15.113:0/2841177757 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7fcdbbfff640 1 -- 172.21.15.113:0/2841177757 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdbc0cb0d0 msgr2=0x7fcdbc1586f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:07.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.694+0000 7f5c4959a640 1 -- 172.21.15.113:0/531383217 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4403f020 con 0x7f5c4c0cc830 2024-04-22T06:32:07.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7fcdbbfff640 1 --2- 172.21.15.113:0/2841177757 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdbc0cb0d0 0x7fcdbc1586f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7fcdbbfff640 1 -- 172.21.15.113:0/2841177757 >> v1:172.21.15.145:6789/0 conn(0x7fcdbc0cac70 legacy=0x7fcdbc0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.694+0000 7f5c4959a640 1 -- 172.21.15.113:0/531383217 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4403b620 con 0x7f5c4c0cc830 2024-04-22T06:32:07.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.692+0000 7fcdbbfff640 1 -- 172.21.15.113:0/2841177757 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc15a830 con 0x7fcdbc14da80 2024-04-22T06:32:07.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.693+0000 7fcdbbfff640 1 --2- 172.21.15.113:0/2841177757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdbc14da80 0x7fcdbc157a70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009ad0 tx=0x7fcdac02bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f203855fc26b9a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.694+0000 7fcdbaffd640 1 -- 172.21.15.113:0/2841177757 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac039070 con 0x7fcdbc14da80 2024-04-22T06:32:07.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.694+0000 7fcdbaffd640 1 -- 172.21.15.113:0/2841177757 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdac02c710 con 0x7fcdbc14da80 2024-04-22T06:32:07.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.695+0000 7f5c50811640 1 -- 172.21.15.113:0/531383217 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cc830 msgr2=0x7f5c4c071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.695+0000 7f5c50811640 1 --2- 172.21.15.113:0/531383217 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cc830 0x7f5c4c071710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5c44007a60 tx=0x7f5c44034950 comp rx=0 tx=0).stop 2024-04-22T06:32:07.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.695+0000 7f5c50811640 1 -- 172.21.15.113:0/531383217 shutdown_connections 2024-04-22T06:32:07.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.695+0000 7f5c50811640 1 --2- 172.21.15.113:0/531383217 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cc830 0x7f5c4c071710 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.695+0000 7fcdc265c640 1 -- 172.21.15.113:0/2841177757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdbc14da80 msgr2=0x7fcdbc157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.695+0000 7f5c50811640 1 --2- 172.21.15.113:0/531383217 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 0x7f5c4c157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.695+0000 7f5c50811640 1 -- 172.21.15.113:0/531383217 >> 172.21.15.113:0/531383217 conn(0x7f5c4c06d610 msgr2=0x7f5c4c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.695+0000 7fcdc265c640 1 --2- 172.21.15.113:0/2841177757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdbc14da80 0x7fcdbc157a70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009ad0 tx=0x7fcdac02bb70 comp rx=0 tx=0).stop 2024-04-22T06:32:07.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.696+0000 7fcdc265c640 1 -- 172.21.15.113:0/2841177757 shutdown_connections 2024-04-22T06:32:07.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.696+0000 7fcdc265c640 1 --2- 172.21.15.113:0/2841177757 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdbc0cb0d0 0x7fcdbc1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.696+0000 7fcdc265c640 1 --2- 172.21.15.113:0/2841177757 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdbc14da80 0x7fcdbc157a70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.696+0000 7fcdc265c640 1 -- 172.21.15.113:0/2841177757 >> 172.21.15.113:0/2841177757 conn(0x7fcdbc06d610 msgr2=0x7fcdbc074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.696+0000 7fcdc265c640 1 -- 172.21.15.113:0/2841177757 shutdown_connections 2024-04-22T06:32:07.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.696+0000 7fcdc265c640 1 -- 172.21.15.113:0/2841177757 wait complete. 2024-04-22T06:32:07.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.696+0000 7f5c50811640 1 -- 172.21.15.113:0/531383217 shutdown_connections 2024-04-22T06:32:07.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.696+0000 7f5c50811640 1 -- 172.21.15.113:0/531383217 wait complete. 2024-04-22T06:32:07.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.698+0000 7f5c50811640 1 Processor -- start 2024-04-22T06:32:07.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.698+0000 7f5c50811640 1 -- start start 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c50811640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c4c0cc3f0 0x7f5c4c14d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c50811640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 0x7f5c4c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c50811640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cd130 0x7f5c4c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c50811640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c151750 con 0x7f5c4c0cd130 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c50811640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c15b240 con 0x7f5c4c0cc3f0 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c50811640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4c0caf90 con 0x7f5c4c151370 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c4ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cd130 0x7f5c4c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c4ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cd130 0x7f5c4c15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33994/0 (socket says 172.21.15.113:33994) 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c4ad9d640 1 -- 172.21.15.113:0/2865312349 learned_addr learned my addr 172.21.15.113:0/2865312349 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7f5c49d9b640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 0x7f5c4c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7f5c4ad9d640 1 -- 172.21.15.113:0/2865312349 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 msgr2=0x7f5c4c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7f5c4ad9d640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 0x7f5c4c159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7f5c4ad9d640 1 -- 172.21.15.113:0/2865312349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c4c0cc3f0 msgr2=0x7f5c4c14d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.698+0000 7fcdc265c640 1 Processor -- start 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.698+0000 7fcdc265c640 1 -- start start 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7fcdc265c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdbc0cac70 0x7fcdbc1472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7fcdc265c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdbc0cb0d0 0x7fcdbc1623e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.699+0000 7fcdc265c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdbc0c29e0 0x7fcdbc1f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7fcdc265c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc15b0d0 con 0x7fcdbc0cb0d0 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7fcdc265c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc15adf0 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7fcdc265c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fcdbc0ccb20 con 0x7fcdbc0cac70 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.702+0000 7fcdc0bf9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdbc0c29e0 0x7fcdbc1f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.702+0000 7fcdc0bf9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdbc0c29e0 0x7fcdbc1f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57214/0 (socket says 172.21.15.113:57214) 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.702+0000 7fcdc0bf9640 1 -- 172.21.15.113:0/2718974279 learned_addr learned my addr 172.21.15.113:0/2718974279 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.703+0000 7fcdc0bf9640 1 -- 172.21.15.113:0/2718974279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdbc0cac70 msgr2=0x7fcdbc1472e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.703+0000 7fcdc0bf9640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdbc0cac70 0x7fcdbc1472e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.703+0000 7fcdc0bf9640 1 -- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdbc0cb0d0 msgr2=0x7fcdbc1623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.703+0000 7fcdc0bf9640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdbc0cb0d0 0x7fcdbc1623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.703+0000 7fcdc0bf9640 1 -- 172.21.15.113:0/2718974279 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc1f98c0 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.703+0000 7fcdc0bf9640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdbc0c29e0 0x7fcdbc1f57f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000b3f0 tx=0x7fcdb000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.704+0000 7fcdb8ff9640 1 -- 172.21.15.113:0/2718974279 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0015020 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.704+0000 7fcdc265c640 1 -- 172.21.15.113:0/2718974279 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc1f8a60 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.705+0000 7fcdc265c640 1 -- 172.21.15.113:0/2718974279 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc1f9020 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.705+0000 7fcdb8ff9640 1 -- 172.21.15.113:0/2718974279 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb0011830 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.706+0000 7fdbefcfd640 1 Processor -- start 2024-04-22T06:32:07.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.706+0000 7fcdb8ff9640 1 -- 172.21.15.113:0/2718974279 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0011c00 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.708+0000 7f4aec375640 1 Processor -- start 2024-04-22T06:32:07.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7f5c4ad9d640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c4c0cc3f0 0x7f5c4c14d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.709+0000 7f4aec375640 1 -- start start 2024-04-22T06:32:07.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7f5c4ad9d640 1 -- 172.21.15.113:0/2865312349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c145d40 con 0x7f5c4c0cd130 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7f5c4ad9d640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cd130 0x7f5c4c15a0f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c4403e040 tx=0x7f5c44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7f5c3affd640 1 -- 172.21.15.113:0/2865312349 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44049070 con 0x7f5c4c0cd130 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.700+0000 7f5c50811640 1 -- 172.21.15.113:0/2865312349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c154720 con 0x7f5c4c0cd130 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.701+0000 7f5c50811640 1 -- 172.21.15.113:0/2865312349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c159690 con 0x7f5c4c0cd130 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.701+0000 7f5c3affd640 1 -- 172.21.15.113:0/2865312349 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c44019580 con 0x7f5c4c0cd130 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.701+0000 7f5c3affd640 1 -- 172.21.15.113:0/2865312349 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4403f040 con 0x7f5c4c0cd130 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.703+0000 7f5c38ff9640 1 -- 172.21.15.113:0/2865312349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4c159890 con 0x7f5c4c0cd130 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.706+0000 7f5c3affd640 1 -- 172.21.15.113:0/2865312349 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c4404c070 con 0x7f5c4c0cd130 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.707+0000 7f5c3affd640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c3406cb30 0x7f5c3406eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.707+0000 7f5c3affd640 1 -- 172.21.15.113:0/2865312349 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5c440ae2f0 con 0x7f5c4c0cd130 2024-04-22T06:32:07.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.709+0000 7fcdb8ff9640 1 -- 172.21.15.113:0/2718974279 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcdb0018020 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.710+0000 7fcdb8ff9640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcda806c9f0 0x7fcda806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.710+0000 7fcdb8ff9640 1 -- 172.21.15.113:0/2718974279 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcdb008be60 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.710+0000 7f4aec375640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4157b50 0x7f4ae40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.710+0000 7f4aec375640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae40ccd30 con 0x7f4ae4151370 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.707+0000 7fdbefcfd640 1 -- start start 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.708+0000 7fdbefcfd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdbe81586f0 0x7fdbe8158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.708+0000 7fdbefcfd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe815b440 con 0x7fdbe814da80 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.708+0000 7fdbefcfd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe81590c0 con 0x7fdbe8157a70 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.708+0000 7fdbefcfd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe814de60 con 0x7fdbe81586f0 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.709+0000 7fdbee29a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdbe81586f0 0x7fdbe8158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.709+0000 7fdbee29a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdbe81586f0 0x7fdbe8158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34008/0 (socket says 172.21.15.113:34008) 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.709+0000 7fdbee29a640 1 -- 172.21.15.113:0/1892289003 learned_addr learned my addr 172.21.15.113:0/1892289003 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.709+0000 7fdbee29a640 1 -- 172.21.15.113:0/1892289003 >> v1:172.21.15.145:6789/0 conn(0x7fdbe8157a70 legacy=0x7fdbe80cc410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.709+0000 7fdbee29a640 1 -- 172.21.15.113:0/1892289003 >> v1:172.21.15.113:6789/0 conn(0x7fdbe814da80 legacy=0x7fdbe80cac70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:07.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.709+0000 7fdbee29a640 1 -- 172.21.15.113:0/1892289003 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe815a550 con 0x7fdbe81586f0 2024-04-22T06:32:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.711+0000 7fcdbbfff640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcda806c9f0 0x7fcda806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.711+0000 7f4aea912640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f4ae40cadc0 0x7f4ae4071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:41024/0 (socket says 172.21.15.113:41024) 2024-04-22T06:32:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.711+0000 7f4aea912640 1 -- 172.21.15.113:0/2777517882 learned_addr learned my addr 172.21.15.113:0/2777517882 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.711+0000 7f4aec375640 1 -- 172.21.15.113:0/2777517882 --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae415a6c0 con 0x7f4ae40cadc0 2024-04-22T06:32:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.711+0000 7f4aec375640 1 -- 172.21.15.113:0/2777517882 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae40ccb00 con 0x7f4ae4157b50 2024-04-22T06:32:07.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.711+0000 7fdbee29a640 1 --2- 172.21.15.113:0/1892289003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe81586f0 0x7fdbe8158b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009870 tx=0x7fdbe402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a7cf5a57a0aa48 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.707+0000 7f5c4a59c640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c3406cb30 0x7f5c3406eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.708+0000 7f5c4a59c640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c3406cb30 0x7f5c3406eff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c001520 tx=0x7f5c3c007a50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.712+0000 7fcdbbfff640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcda806c9f0 0x7fcda806eeb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdac036000 tx=0x7fcdac030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.711+0000 7f4ae9910640 1 --2- 172.21.15.113:0/2777517882 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4157b50 0x7f4ae40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.712+0000 7f4ae9910640 1 -- 172.21.15.113:0/2777517882 >> v1:172.21.15.145:6789/0 conn(0x7f4ae40cadc0 legacy=0x7f4ae4071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.712+0000 7f93508c7640 1 Processor -- start 2024-04-22T06:32:07.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.713+0000 7f93508c7640 1 -- start start 2024-04-22T06:32:07.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.712+0000 7f4ae9910640 1 -- 172.21.15.113:0/2777517882 >> v1:172.21.15.113:6789/0 conn(0x7f4ae4151370 legacy=0x7f4ae40cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.712+0000 7f4ae9910640 1 -- 172.21.15.113:0/2777517882 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae415a9a0 con 0x7f4ae4157b50 2024-04-22T06:32:07.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.713+0000 7f4ae9910640 1 --2- 172.21.15.113:0/2777517882 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4157b50 0x7f4ae40ca880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097d0 tx=0x7f4ae002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca8746894435ded5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.713+0000 7fcdc265c640 1 -- 172.21.15.113:0/2718974279 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9c005290 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.714+0000 7f4ae910f640 1 -- 172.21.15.113:0/2777517882 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0035020 con 0x7f4ae4157b50 2024-04-22T06:32:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.714+0000 7f4ae910f640 1 -- 172.21.15.113:0/2777517882 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae0031800 con 0x7f4ae4157b50 2024-04-22T06:32:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.714+0000 7f4ae910f640 1 -- 172.21.15.113:0/2777517882 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0031bd0 con 0x7f4ae4157b50 2024-04-22T06:32:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.714+0000 7f93508c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f934c1594c0 0x7f934c0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.714+0000 7f93508c7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f934c0c86b0 0x7f934c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.714+0000 7f93508c7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934c162890 con 0x7f934c0c7390 2024-04-22T06:32:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.714+0000 7f93508c7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f934c163780 con 0x7f934c0c86b0 2024-04-22T06:32:07.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.714+0000 7f93508c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f934c162b70 con 0x7f934c1594c0 2024-04-22T06:32:07.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.715+0000 7f4aec375640 1 -- 172.21.15.113:0/2777517882 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4157b50 msgr2=0x7f4ae40ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.715+0000 7f4aec375640 1 --2- 172.21.15.113:0/2777517882 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4157b50 0x7f4ae40ca880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097d0 tx=0x7f4ae002b8a0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.715+0000 7f4aec375640 1 -- 172.21.15.113:0/2777517882 shutdown_connections 2024-04-22T06:32:07.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.715+0000 7f4aec375640 1 --2- 172.21.15.113:0/2777517882 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4157b50 0x7f4ae40ca880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.716+0000 7f4aec375640 1 -- 172.21.15.113:0/2777517882 >> 172.21.15.113:0/2777517882 conn(0x7f4ae406d610 msgr2=0x7f4ae4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.716+0000 7f4aec375640 1 -- 172.21.15.113:0/2777517882 shutdown_connections 2024-04-22T06:32:07.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.716+0000 7f4aec375640 1 -- 172.21.15.113:0/2777517882 wait complete. 2024-04-22T06:32:07.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.717+0000 7f934a59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f934c0c86b0 0x7f934c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.717+0000 7f934a59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f934c0c86b0 0x7f934c0c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34012/0 (socket says 172.21.15.113:34012) 2024-04-22T06:32:07.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.717+0000 7f934a59c640 1 -- 172.21.15.113:0/1053750082 learned_addr learned my addr 172.21.15.113:0/1053750082 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.718+0000 7f4aec375640 1 Processor -- start 2024-04-22T06:32:07.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.718+0000 7f4aec375640 1 -- start start 2024-04-22T06:32:07.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f4aec375640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ae40cadc0 0x7f4ae414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f4aec375640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4151370 0x7f4ae4156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f4aec375640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae4157b50 0x7f4ae41f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f4ae9910640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4151370 0x7f4ae4156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f4ae9910640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4151370 0x7f4ae4156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:48518/0 (socket says 172.21.15.113:48518) 2024-04-22T06:32:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f934a59c640 1 -- 172.21.15.113:0/1053750082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f934c1594c0 msgr2=0x7f934c0c90e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f934a59c640 1 --2- 172.21.15.113:0/1053750082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f934c1594c0 0x7f934c0c90e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f934a59c640 1 -- 172.21.15.113:0/1053750082 >> v1:172.21.15.113:6789/0 conn(0x7f934c0c7390 legacy=0x7f934c15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.719+0000 7f934a59c640 1 -- 172.21.15.113:0/1053750082 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c162e50 con 0x7f934c0c86b0 2024-04-22T06:32:07.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.720+0000 7f4ae9910640 1 -- 172.21.15.113:0/2859940589 learned_addr learned my addr 172.21.15.113:0/2859940589 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.720+0000 7f4aea912640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae4157b50 0x7f4ae41f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.720+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae415b240 con 0x7f4ae40cadc0 2024-04-22T06:32:07.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.720+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae415af60 con 0x7f4ae4157b50 2024-04-22T06:32:07.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.720+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae4157f90 con 0x7f4ae4151370 2024-04-22T06:32:07.722 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.720+0000 7fcdb8ff9640 1 -- 172.21.15.113:0/2718974279 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcdb001f020 con 0x7fcdbc0c29e0 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aea111640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ae40cadc0 0x7f4ae414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aea912640 1 -- 172.21.15.113:0/2859940589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4151370 msgr2=0x7f4ae4156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aea912640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4151370 0x7f4ae4156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aea912640 1 -- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ae40cadc0 msgr2=0x7f4ae414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aea912640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ae40cadc0 0x7f4ae414e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aea912640 1 -- 172.21.15.113:0/2859940589 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae4152850 con 0x7f4ae4157b50 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aea111640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ae40cadc0 0x7f4ae414e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aea912640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae4157b50 0x7f4ae41f50e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00caf0 tx=0x7f4adc00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4adaffd640 1 -- 172.21.15.113:0/2859940589 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00abd0 con 0x7f4ae4157b50 2024-04-22T06:32:07.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.721+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae40c8150 con 0x7f4ae4157b50 2024-04-22T06:32:07.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.722+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae40c8710 con 0x7f4ae4157b50 2024-04-22T06:32:07.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.722+0000 7f4adaffd640 1 -- 172.21.15.113:0/2859940589 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4adc00ad70 con 0x7f4ae4157b50 2024-04-22T06:32:07.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.723+0000 7fdbeca97640 1 -- 172.21.15.113:0/1892289003 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4035020 con 0x7fdbe81586f0 2024-04-22T06:32:07.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.723+0000 7f5c3affd640 1 -- 172.21.15.113:0/2865312349 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5c4c159890 con 0x7f5c4c0cd130 2024-04-22T06:32:07.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.724+0000 7f4adaffd640 1 -- 172.21.15.113:0/2859940589 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc012640 con 0x7f4ae4157b50 2024-04-22T06:32:07.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.724+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4acc005290 con 0x7f4ae4157b50 2024-04-22T06:32:07.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.723+0000 7fdbeca97640 1 -- 172.21.15.113:0/1892289003 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe4031870 con 0x7fdbe81586f0 2024-04-22T06:32:07.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.724+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1892289003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe81586f0 msgr2=0x7fdbe8158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.724+0000 7fdbeca97640 1 -- 172.21.15.113:0/1892289003 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4035020 con 0x7fdbe81586f0 2024-04-22T06:32:07.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.724+0000 7fdbefcfd640 1 --2- 172.21.15.113:0/1892289003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe81586f0 0x7fdbe8158b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009870 tx=0x7fdbe402b910 comp rx=0 tx=0).stop 2024-04-22T06:32:07.726 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.725+0000 7f934a59c640 1 --2- 172.21.15.113:0/1053750082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f934c0c86b0 0x7f934c0c9620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9340009870 tx=0x7f934002ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e67b5493bc9962 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.726 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.725+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1892289003 shutdown_connections 2024-04-22T06:32:07.726 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.725+0000 7fdbefcfd640 1 --2- 172.21.15.113:0/1892289003 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe81586f0 0x7fdbe8158b80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.726 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.725+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1892289003 >> 172.21.15.113:0/1892289003 conn(0x7fdbe806d610 msgr2=0x7fdbe8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.725+0000 7f9349d9b640 1 -- 172.21.15.113:0/1053750082 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934002f870 con 0x7f934c0c86b0 2024-04-22T06:32:07.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.725+0000 7f9349d9b640 1 -- 172.21.15.113:0/1053750082 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934002fa10 con 0x7f934c0c86b0 2024-04-22T06:32:07.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f4adaffd640 1 -- 172.21.15.113:0/2859940589 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4adc0127e0 con 0x7f4ae4157b50 2024-04-22T06:32:07.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f4adaffd640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4ac806c9c0 0x7f4ac806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f93508c7640 1 -- 172.21.15.113:0/1053750082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f934c0c86b0 msgr2=0x7f934c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.728 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f93508c7640 1 --2- 172.21.15.113:0/1053750082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f934c0c86b0 0x7f934c0c9620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9340009870 tx=0x7f934002ba50 comp rx=0 tx=0).stop 2024-04-22T06:32:07.728 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f4adaffd640 1 -- 172.21.15.113:0/2859940589 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4adc08c6d0 con 0x7f4ae4157b50 2024-04-22T06:32:07.728 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f93508c7640 1 -- 172.21.15.113:0/1053750082 shutdown_connections 2024-04-22T06:32:07.728 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f93508c7640 1 --2- 172.21.15.113:0/1053750082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f934c0c86b0 0x7f934c0c9620 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9340009870 tx=0x7f934002ba50 comp rx=0 tx=0).stop 2024-04-22T06:32:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f93508c7640 1 --2- 172.21.15.113:0/1053750082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f934c1594c0 0x7f934c0c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.726+0000 7f93508c7640 1 -- 172.21.15.113:0/1053750082 >> 172.21.15.113:0/1053750082 conn(0x7f934c06eb30 msgr2=0x7f934c06ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.727+0000 7f93508c7640 1 -- 172.21.15.113:0/1053750082 shutdown_connections 2024-04-22T06:32:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.728+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1892289003 shutdown_connections 2024-04-22T06:32:07.729 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.727+0000 7f93508c7640 1 -- 172.21.15.113:0/1053750082 wait complete. 2024-04-22T06:32:07.730 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.728+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1892289003 wait complete. 2024-04-22T06:32:07.730 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.728+0000 7f4aea111640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4ac806c9c0 0x7f4ac806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.730 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.729+0000 7f4aea111640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4ac806c9c0 0x7f4ac806ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ae41f2300 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.730 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.729+0000 7f93508c7640 1 Processor -- start 2024-04-22T06:32:07.731 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7fa05edbd640 1 Processor -- start 2024-04-22T06:32:07.731 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7fdbefcfd640 1 Processor -- start 2024-04-22T06:32:07.731 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7f4adaffd640 1 -- 172.21.15.113:0/2859940589 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ae4152850 con 0x7f4ae4157b50 2024-04-22T06:32:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.729+0000 7f93508c7640 1 -- start start 2024-04-22T06:32:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7f93508c7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f934c0c7390 0x7f934c1f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7f93508c7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f934c1594c0 0x7f934c144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7fa05edbd640 1 -- start start 2024-04-22T06:32:07.732 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05edbd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa058151f90 0x7fa05815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05edbd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058070630 0x7fa05806f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05edbd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa058074240 con 0x7fa058072bd0 2024-04-22T06:32:07.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05edbd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fa0580736a0 con 0x7fa058151f90 2024-04-22T06:32:07.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05edbd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa05815b9b0 con 0x7fa058070630 2024-04-22T06:32:07.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7f93508c7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f934c162340 0x7f934c149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05cb59640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa058151f90 0x7fa05815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05cb59640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa058151f90 0x7fa05815b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57248/0 (socket says 172.21.15.113:57248) 2024-04-22T06:32:07.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05cb59640 1 -- 172.21.15.113:0/1700376836 learned_addr learned my addr 172.21.15.113:0/1700376836 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7fa05d35a640 1 --2- 172.21.15.113:0/1700376836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058070630 0x7fa05806f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7f93508c7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1598a0 con 0x7f934c0c7390 2024-04-22T06:32:07.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7fdbefcfd640 1 -- start start 2024-04-22T06:32:07.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7fdbefcfd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdbe814da80 0x7fdbe80c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7f93508c7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f934c163410 con 0x7f934c1594c0 2024-04-22T06:32:07.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.730+0000 7f93508c7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f934c15fc60 con 0x7f934c162340 2024-04-22T06:32:07.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7f934a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f934c1594c0 0x7f934c144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7fdbefcfd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe8157a70 0x7fdbe80730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7fa05d35a640 1 -- 172.21.15.113:0/1700376836 >> v2:172.21.15.145:3300/0 conn(0x7fa058151f90 msgr2=0x7fa05815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7fa05d35a640 1 --2- 172.21.15.113:0/1700376836 >> v2:172.21.15.145:3300/0 conn(0x7fa058151f90 0x7fa05815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7fa05d35a640 1 -- 172.21.15.113:0/1700376836 >> v1:172.21.15.145:6789/0 conn(0x7fa058072bd0 legacy=0x7fa058073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7fa05d35a640 1 -- 172.21.15.113:0/1700376836 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05815bc90 con 0x7fa058070630 2024-04-22T06:32:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7fdbeda99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdbe814da80 0x7fdbe80c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7fdbeda99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdbe814da80 0x7fdbe80c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:48530/0 (socket says 172.21.15.113:48530) 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7f934a59c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f934c1594c0 0x7f934c144850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57242/0 (socket says 172.21.15.113:57242) 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7f934a59c640 1 -- 172.21.15.113:0/3627144451 learned_addr learned my addr 172.21.15.113:0/3627144451 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7f934a59c640 1 -- 172.21.15.113:0/3627144451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f934c162340 msgr2=0x7f934c149910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7f934a59c640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f934c162340 0x7f934c149910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7f934a59c640 1 -- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f934c0c7390 msgr2=0x7f934c1f57a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7f934a59c640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f934c0c7390 0x7f934c1f57a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.731+0000 7f934a59c640 1 -- 172.21.15.113:0/3627144451 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c144d90 con 0x7f934c1594c0 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.732+0000 7f934a59c640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f934c1594c0 0x7f934c144850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93400090b0 tx=0x7f93400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7f93337fe640 1 -- 172.21.15.113:0/3627144451 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340048070 con 0x7f934c1594c0 2024-04-22T06:32:07.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fa05d35a640 1 --2- 172.21.15.113:0/1700376836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058070630 0x7fa05806f880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0480097a0 tx=0x7fa04802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8657d476471e2174 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7f93337fe640 1 -- 172.21.15.113:0/3627144451 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9340004230 con 0x7f934c1594c0 2024-04-22T06:32:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fdbefcfd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbe81586f0 0x7fdbe8148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fdbefcfd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe815ab10 con 0x7fdbe8157a70 2024-04-22T06:32:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fdbefcfd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8157ed0 con 0x7fdbe81586f0 2024-04-22T06:32:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fdbefcfd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe815adf0 con 0x7fdbe814da80 2024-04-22T06:32:07.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fdbed298640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe8157a70 0x7fdbe80730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fdbed298640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe8157a70 0x7fdbe80730c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34030/0 (socket says 172.21.15.113:34030) 2024-04-22T06:32:07.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fdbed298640 1 -- 172.21.15.113:0/1121479174 learned_addr learned my addr 172.21.15.113:0/1121479174 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7f93337fe640 1 -- 172.21.15.113:0/3627144451 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340003610 con 0x7f934c1594c0 2024-04-22T06:32:07.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.733+0000 7fa0577fe640 1 -- 172.21.15.113:0/1700376836 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048034070 con 0x7fa058070630 2024-04-22T06:32:07.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fa0577fe640 1 -- 172.21.15.113:0/1700376836 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa048030800 con 0x7fa058070630 2024-04-22T06:32:07.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fdbee29a640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbe81586f0 0x7fdbe8148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fdbee29a640 1 -- 172.21.15.113:0/1121479174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdbe814da80 msgr2=0x7fdbe80c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fdbee29a640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdbe814da80 0x7fdbe80c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fdbee29a640 1 -- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe8157a70 msgr2=0x7fdbe80730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fdbee29a640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe8157a70 0x7fdbe80730c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fdbee29a640 1 -- 172.21.15.113:0/1121479174 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe80c4330 con 0x7fdbe81586f0 2024-04-22T06:32:07.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fdbee29a640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbe81586f0 0x7fdbe8148420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80cbb50 tx=0x7fdbe40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c0cbda0 con 0x7f934c1594c0 2024-04-22T06:32:07.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c15e990 con 0x7f934c1594c0 2024-04-22T06:32:07.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.735+0000 7fa05edbd640 1 -- 172.21.15.113:0/1700376836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058070630 msgr2=0x7fa05806f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.735+0000 7fa05edbd640 1 --2- 172.21.15.113:0/1700376836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058070630 0x7fa05806f880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0480097a0 tx=0x7fa04802b940 comp rx=0 tx=0).stop 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.734+0000 7fdbde7fc640 1 -- 172.21.15.113:0/1121479174 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4003a20 con 0x7fdbe81586f0 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.735+0000 7fdbde7fc640 1 -- 172.21.15.113:0/1121479174 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe4003bc0 con 0x7fdbe81586f0 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.735+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe8073f60 con 0x7fdbe81586f0 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.736+0000 7fdbde7fc640 1 -- 172.21.15.113:0/1121479174 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4046480 con 0x7fdbe81586f0 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.736+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe80c4880 con 0x7fdbe81586f0 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.736+0000 7fa05edbd640 1 -- 172.21.15.113:0/1700376836 shutdown_connections 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.736+0000 7fa05edbd640 1 --2- 172.21.15.113:0/1700376836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058070630 0x7fa05806f880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.736+0000 7fa05edbd640 1 --2- 172.21.15.113:0/1700376836 >> v2:172.21.15.145:3300/0 conn(0x7fa058151f90 0x7fa05815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.736+0000 7fa05edbd640 1 -- 172.21.15.113:0/1700376836 >> 172.21.15.113:0/1700376836 conn(0x7fa0580ca0d0 msgr2=0x7fa0580ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.737+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe8068e40 con 0x7fdbe81586f0 2024-04-22T06:32:07.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.739+0000 7fa05edbd640 1 -- 172.21.15.113:0/1700376836 shutdown_connections 2024-04-22T06:32:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.736+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c068cc0 con 0x7f934c1594c0 2024-04-22T06:32:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.739+0000 7f93337fe640 1 -- 172.21.15.113:0/3627144451 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f934004b070 con 0x7f934c1594c0 2024-04-22T06:32:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.739+0000 7fdbde7fc640 1 -- 172.21.15.113:0/1121479174 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbe4038020 con 0x7fdbe81586f0 2024-04-22T06:32:07.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.740+0000 7fdbde7fc640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdbcc06c940 0x7fdbcc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.740+0000 7fdbeda99640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdbcc06c940 0x7fdbcc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.741+0000 7f93337fe640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f933806c9c0 0x7f933806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.741+0000 7f934ad9d640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f933806c9c0 0x7f933806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.741+0000 7f93337fe640 1 -- 172.21.15.113:0/3627144451 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f93400ae5f0 con 0x7f934c1594c0 2024-04-22T06:32:07.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.739+0000 7fa05edbd640 1 -- 172.21.15.113:0/1700376836 wait complete. 2024-04-22T06:32:07.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.740+0000 7fa05edbd640 1 Processor -- start 2024-04-22T06:32:07.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fdbeda99640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdbcc06c940 0x7fdbcc06ee00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009f50 tx=0x7fdbe0009540 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7f934ad9d640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f933806c9c0 0x7f933806ee80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f933c006fd0 tx=0x7f933c006b40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.741+0000 7fa05edbd640 1 -- start start 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05edbd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa058070630 0x7fa0581f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05edbd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa058072bd0 0x7fa058147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05edbd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058151f90 0x7fa058148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05edbd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa0580c7fd0 con 0x7fa058072bd0 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05edbd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa058073330 con 0x7fa058070630 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05edbd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa058152370 con 0x7fa058151f90 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05cb59640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa058070630 0x7fa0581f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05cb59640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa058070630 0x7fa0581f4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:57270/0 (socket says 172.21.15.113:57270) 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05cb59640 1 -- 172.21.15.113:0/3762252215 learned_addr learned my addr 172.21.15.113:0/3762252215 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa05d35a640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058151f90 0x7fa058148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.742+0000 7fa057fff640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa058072bd0 0x7fa058147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.743+0000 7f93337fe640 1 -- 172.21.15.113:0/3627144451 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f934c144d90 con 0x7f934c1594c0 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.743+0000 7fa057fff640 1 -- 172.21.15.113:0/3762252215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058151f90 msgr2=0x7fa058148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.743+0000 7fa057fff640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058151f90 0x7fa058148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.743+0000 7fa057fff640 1 -- 172.21.15.113:0/3762252215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa058070630 msgr2=0x7fa0581f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.743+0000 7fa057fff640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa058070630 0x7fa0581f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.743+0000 7fa057fff640 1 -- 172.21.15.113:0/3762252215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa058159b10 con 0x7fa058072bd0 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.744+0000 7fa057fff640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa058072bd0 0x7fa058147e30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c7a0 tx=0x7fa05000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.744+0000 7fa0557fa640 1 -- 172.21.15.113:0/3762252215 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050003b70 con 0x7fa058072bd0 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.744+0000 7fa0557fa640 1 -- 172.21.15.113:0/3762252215 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa050003d10 con 0x7fa058072bd0 2024-04-22T06:32:07.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.744+0000 7fdbde7fc640 1 -- 172.21.15.113:0/1121479174 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdbe4079670 con 0x7fdbe81586f0 2024-04-22T06:32:07.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.745+0000 7fa0557fa640 1 -- 172.21.15.113:0/3762252215 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05000a9f0 con 0x7fa058072bd0 2024-04-22T06:32:07.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.745+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0581fd4f0 con 0x7fa058072bd0 2024-04-22T06:32:07.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.745+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0581fdab0 con 0x7fa058072bd0 2024-04-22T06:32:07.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.748+0000 7fa0557fa640 1 -- 172.21.15.113:0/3762252215 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa05000ab90 con 0x7fa058072bd0 2024-04-22T06:32:07.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.748+0000 7fdbde7fc640 1 -- 172.21.15.113:0/1121479174 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdbe40b7080 con 0x7fdbe81586f0 2024-04-22T06:32:07.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.748+0000 7fa0557fa640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa03806c9c0 0x7fa03806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.748+0000 7fa0557fa640 1 -- 172.21.15.113:0/3762252215 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa05008bb30 con 0x7fa058072bd0 2024-04-22T06:32:07.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.750+0000 7fa05cb59640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa03806c9c0 0x7fa03806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.751+0000 7fa05cb59640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa03806c9c0 0x7fa03806ee80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa040006a90 tx=0x7fa040008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.752+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05814c010 con 0x7fa058072bd0 2024-04-22T06:32:07.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.762+0000 7fa0557fa640 1 -- 172.21.15.113:0/3762252215 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa05814c010 con 0x7fa058072bd0 2024-04-22T06:32:07.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.763+0000 7f36ff9e6640 1 Processor -- start 2024-04-22T06:32:07.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.764+0000 7f3bcd8f2640 1 Processor -- start 2024-04-22T06:32:07.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.763+0000 7f36ff9e6640 1 -- start start 2024-04-22T06:32:07.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.764+0000 7f36ff9e6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f8162a30 0x7f36f8068060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.764+0000 7f36ff9e6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f36f80c2b30 0x7f36f80c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f36fcf81640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f36f8162e10 0x7f36f8163250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45620/0 (socket says 172.21.15.113:45620) 2024-04-22T06:32:07.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f36fcf81640 1 -- 172.21.15.113:0/294105402 learned_addr learned my addr 172.21.15.113:0/294105402 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:07.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f36ff9e6640 1 -- 172.21.15.113:0/294105402 --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f8159c60 con 0x7f36f8162e10 2024-04-22T06:32:07.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f36ff9e6640 1 -- 172.21.15.113:0/294105402 --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f36f80745c0 con 0x7f36f80c2b30 2024-04-22T06:32:07.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f36ff9e6640 1 -- 172.21.15.113:0/294105402 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80685a0 con 0x7f36f8162a30 2024-04-22T06:32:07.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.764+0000 7f3bcd8f2640 1 -- start start 2024-04-22T06:32:07.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f3bcd8f2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc80c2b30 0x7f3bc80c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f3bcd8f2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc8159c60 con 0x7f3bc8162a30 2024-04-22T06:32:07.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f3bcd8f2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc80c3500 con 0x7f3bc8162e10 2024-04-22T06:32:07.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f3bcd8f2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc80745c0 con 0x7f3bc80c2b30 2024-04-22T06:32:07.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.765+0000 7f36fdf83640 1 --2- 172.21.15.113:0/294105402 >> v2:172.21.15.113:3300/0 conn(0x7f36f80c2b30 0x7f36f80c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f3bc6ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3bc8162a30 0x7f3bc8068060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45630/0 (socket says 172.21.15.113:45630) 2024-04-22T06:32:07.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f3bc77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc80c2b30 0x7f3bc80c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f3bc6ffd640 1 -- 172.21.15.113:0/627815006 learned_addr learned my addr 172.21.15.113:0/627815006 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:07.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f3bc77fe640 1 -- 172.21.15.113:0/627815006 >> v1:172.21.15.145:6789/0 conn(0x7f3bc8162e10 legacy=0x7f3bc8163250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T06:32:07.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f3bc77fe640 1 -- 172.21.15.113:0/627815006 >> v1:172.21.15.113:6789/0 conn(0x7f3bc8162a30 legacy=0x7f3bc8068060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.767+0000 7f3bc77fe640 1 -- 172.21.15.113:0/627815006 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc806e390 con 0x7f3bc80c2b30 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f36fd782640 1 --2- 172.21.15.113:0/294105402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f8162a30 0x7f36f8068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f36effff640 1 -- 172.21.15.113:0/294105402 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972380911 0 0) 0x7f36f8159c60 con 0x7f36f8162e10 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f36effff640 1 -- 172.21.15.113:0/294105402 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36e4003520 con 0x7f36f8162e10 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f36fdf83640 1 -- 172.21.15.113:0/294105402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f8162a30 msgr2=0x7f36f8068060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f36fdf83640 1 --2- 172.21.15.113:0/294105402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f8162a30 0x7f36f8068060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f36fdf83640 1 -- 172.21.15.113:0/294105402 >> v1:172.21.15.113:6789/0 conn(0x7f36f8162e10 legacy=0x7f36f8163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.766+0000 7f36fdf83640 1 -- 172.21.15.113:0/294105402 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f80c3500 con 0x7f36f80c2b30 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.767+0000 7f36fd782640 1 --2- 172.21.15.113:0/294105402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f8162a30 0x7f36f8068060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:07.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.767+0000 7f36fdf83640 1 --2- 172.21.15.113:0/294105402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f80c2b30 0x7f36f80c2fc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009d90 tx=0x7f36f002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4faca82862207a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.768+0000 7f36effff640 1 -- 172.21.15.113:0/294105402 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0039070 con 0x7f36f80c2b30 2024-04-22T06:32:07.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.768+0000 7f36effff640 1 -- 172.21.15.113:0/294105402 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f002cd30 con 0x7f36f80c2b30 2024-04-22T06:32:07.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.768+0000 7f36effff640 1 -- 172.21.15.113:0/294105402 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0034660 con 0x7f36f80c2b30 2024-04-22T06:32:07.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.769+0000 7f36ff9e6640 1 -- 172.21.15.113:0/294105402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f80c2b30 msgr2=0x7f36f80c2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.769+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/294105402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f80c2b30 0x7f36f80c2fc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009d90 tx=0x7f36f002bf80 comp rx=0 tx=0).stop 2024-04-22T06:32:07.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.770+0000 7f36ff9e6640 1 -- 172.21.15.113:0/294105402 shutdown_connections 2024-04-22T06:32:07.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.770+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/294105402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f80c2b30 0x7f36f80c2fc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.770+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/294105402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f8162a30 0x7f36f8068060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.770+0000 7f36ff9e6640 1 -- 172.21.15.113:0/294105402 >> 172.21.15.113:0/294105402 conn(0x7f36f806f2f0 msgr2=0x7f36f806f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.770+0000 7f36ff9e6640 1 -- 172.21.15.113:0/294105402 shutdown_connections 2024-04-22T06:32:07.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.771+0000 7f36ff9e6640 1 -- 172.21.15.113:0/294105402 wait complete. 2024-04-22T06:32:07.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.770+0000 7f3bc77fe640 1 --2- 172.21.15.113:0/627815006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc80c2b30 0x7f3bc80c2fc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00097d0 tx=0x7f3bb002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5091b252585f1c97 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.773+0000 7f36ff9e6640 1 Processor -- start 2024-04-22T06:32:07.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.773+0000 7f36ff9e6640 1 -- start start 2024-04-22T06:32:07.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f3bc5ffb640 1 -- 172.21.15.113:0/627815006 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0035020 con 0x7f3bc80c2b30 2024-04-22T06:32:07.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f3bc5ffb640 1 -- 172.21.15.113:0/627815006 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb0031890 con 0x7f3bc80c2b30 2024-04-22T06:32:07.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f3bc5ffb640 1 -- 172.21.15.113:0/627815006 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0031c60 con 0x7f3bc80c2b30 2024-04-22T06:32:07.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/627815006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc80c2b30 msgr2=0x7f3bc80c2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f3bcd8f2640 1 --2- 172.21.15.113:0/627815006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc80c2b30 0x7f3bc80c2fc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00097d0 tx=0x7f3bb002b930 comp rx=0 tx=0).stop 2024-04-22T06:32:07.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f36ff9e6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f80c2b30 0x7f36f81eb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f36ff9e6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f8162a30 0x7f36f81f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f36fcf81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f8162a30 0x7f36f81f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f36fcf81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f8162a30 0x7f36f81f86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34052/0 (socket says 172.21.15.113:34052) 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f36fcf81640 1 -- 172.21.15.113:0/3181403714 learned_addr learned my addr 172.21.15.113:0/3181403714 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f8162e10 0x7f36f81f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.774+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80c2050 con 0x7f36f8162a30 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36f806e670 con 0x7f36f8162e10 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80c2330 con 0x7f36f80c2b30 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36fdf83640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f8162e10 0x7f36f81f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36fcf81640 1 -- 172.21.15.113:0/3181403714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f80c2b30 msgr2=0x7f36f81eb120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36fcf81640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f80c2b30 0x7f36f81eb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36fcf81640 1 -- 172.21.15.113:0/3181403714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f8162e10 msgr2=0x7f36f81f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36fcf81640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f8162e10 0x7f36f81f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36fcf81640 1 -- 172.21.15.113:0/3181403714 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f81eb660 con 0x7f36f8162a30 2024-04-22T06:32:07.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.775+0000 7f36fcf81640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f8162a30 0x7f36f81f86b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c710 tx=0x7f36f400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.776+0000 7f36edffb640 1 -- 172.21.15.113:0/3181403714 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4017070 con 0x7f36f8162a30 2024-04-22T06:32:07.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.776+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f8160f10 con 0x7f36f8162a30 2024-04-22T06:32:07.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.776+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f81f9250 con 0x7f36f8162a30 2024-04-22T06:32:07.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.781+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/627815006 shutdown_connections 2024-04-22T06:32:07.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.781+0000 7f3bcd8f2640 1 --2- 172.21.15.113:0/627815006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc80c2b30 0x7f3bc80c2fc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.781+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/627815006 >> 172.21.15.113:0/627815006 conn(0x7f3bc806f2f0 msgr2=0x7f3bc806f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:07.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.780+0000 7f36edffb640 1 -- 172.21.15.113:0/3181403714 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f4005ab0 con 0x7f36f8162a30 2024-04-22T06:32:07.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.780+0000 7f36edffb640 1 -- 172.21.15.113:0/3181403714 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f400ce20 con 0x7f36f8162a30 2024-04-22T06:32:07.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.780+0000 7f36edffb640 1 -- 172.21.15.113:0/3181403714 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f36f401a070 con 0x7f36f8162a30 2024-04-22T06:32:07.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.781+0000 7f36edffb640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f36dc06c9f0 0x7f36dc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.781+0000 7f36edffb640 1 -- 172.21.15.113:0/3181403714 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f36f408b3e0 con 0x7f36f8162a30 2024-04-22T06:32:07.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.782+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d8005290 con 0x7f36f8162a30 2024-04-22T06:32:07.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.782+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/627815006 shutdown_connections 2024-04-22T06:32:07.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.782+0000 7f36fd782640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f36dc06c9f0 0x7f36dc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.782+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/627815006 wait complete. 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.784+0000 7f3bcd8f2640 1 Processor -- start 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.784+0000 7f3bcd8f2640 1 -- start start 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.785+0000 7f3bcd8f2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bc80c2b30 0x7f3bc8149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.785+0000 7f3bcd8f2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bc8162a30 0x7f3bc81f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.786+0000 7f3bcd8f2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc8162e10 0x7f3bc80c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.786+0000 7f3bcd8f2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80c2330 con 0x7f3bc80c2b30 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.786+0000 7f3bcd8f2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80c2050 con 0x7f3bc8162a30 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.786+0000 7f3bcd8f2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc80c2610 con 0x7f3bc8162e10 2024-04-22T06:32:07.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.786+0000 7f3bc6ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bc80c2b30 0x7f3bc8149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.786+0000 7f36fd782640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f36dc06c9f0 0x7f36dc06eeb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36e800b810 tx=0x7f36e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.786+0000 7f3bc6ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bc80c2b30 0x7f3bc8149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34066/0 (socket says 172.21.15.113:34066) 2024-04-22T06:32:07.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.786+0000 7f3bc6ffd640 1 -- 172.21.15.113:0/663641626 learned_addr learned my addr 172.21.15.113:0/663641626 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:07.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.787+0000 7f3bc67fc640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bc8162a30 0x7f3bc81f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.787+0000 7f3bc6ffd640 1 -- 172.21.15.113:0/663641626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc8162e10 msgr2=0x7f3bc80c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.787+0000 7f3bc6ffd640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc8162e10 0x7f3bc80c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.787+0000 7f3bc6ffd640 1 -- 172.21.15.113:0/663641626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bc8162a30 msgr2=0x7f3bc81f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:07.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.787+0000 7f3bc6ffd640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bc8162a30 0x7f3bc81f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:07.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.787+0000 7f3bc6ffd640 1 -- 172.21.15.113:0/663641626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc81625f0 con 0x7f3bc80c2b30 2024-04-22T06:32:07.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.787+0000 7f3bc6ffd640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bc80c2b30 0x7f3bc8149870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c480 tx=0x7f3bc000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.792+0000 7f36edffb640 1 -- 172.21.15.113:0/3181403714 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36f40594e0 con 0x7f36f8162a30 2024-04-22T06:32:07.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.793+0000 7f3bbffff640 1 -- 172.21.15.113:0/663641626 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0017070 con 0x7f3bc80c2b30 2024-04-22T06:32:07.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.793+0000 7f3bbffff640 1 -- 172.21.15.113:0/663641626 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc0005ce0 con 0x7f3bc80c2b30 2024-04-22T06:32:07.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.793+0000 7f3bbffff640 1 -- 172.21.15.113:0/663641626 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00072f0 con 0x7f3bc80c2b30 2024-04-22T06:32:07.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.796+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc8160870 con 0x7f3bc80c2b30 2024-04-22T06:32:07.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.796+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc8160e30 con 0x7f3bc80c2b30 2024-04-22T06:32:07.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.800+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc8068e40 con 0x7f3bc80c2b30 2024-04-22T06:32:07.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.806+0000 7f3bbffff640 1 -- 172.21.15.113:0/663641626 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3bc001a070 con 0x7f3bc80c2b30 2024-04-22T06:32:07.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.807+0000 7f3bbffff640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3ba806c9c0 0x7f3ba806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:07.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.808+0000 7f3bbffff640 1 -- 172.21.15.113:0/663641626 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3bc008b5e0 con 0x7f3bc80c2b30 2024-04-22T06:32:07.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.812+0000 7f3bc67fc640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3ba806c9c0 0x7f3ba806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:07.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.813+0000 7f3bc67fc640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3ba806c9c0 0x7f3ba806ee80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3bc806fcd0 tx=0x7f3bb80072f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:07.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:07.818+0000 7f3bbffff640 1 -- 172.21.15.113:0/663641626 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3bc00590f0 con 0x7f3bc80c2b30 2024-04-22T06:32:08.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.154+0000 7fcdc265c640 1 -- 172.21.15.113:0/2718974279 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcd9c005580 con 0x7fcdbc0c29e0 2024-04-22T06:32:08.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.162+0000 7fcdb8ff9640 1 -- 172.21.15.113:0/2718974279 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcdb00172c0 con 0x7fcdbc0c29e0 2024-04-22T06:32:08.165 INFO:teuthology.orchestra.run.smithi113.stdout:55834574857 2024-04-22T06:32:08.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.177+0000 7fcda27fc640 1 -- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcda806c9f0 msgr2=0x7fcda806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.177+0000 7fcda27fc640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcda806c9f0 0x7fcda806eeb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdac036000 tx=0x7fcdac030000 comp rx=0 tx=0).stop 2024-04-22T06:32:08.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.177+0000 7fcda27fc640 1 -- 172.21.15.113:0/2718974279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdbc0c29e0 msgr2=0x7fcdbc1f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.177+0000 7fcda27fc640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdbc0c29e0 0x7fcdbc1f57f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000b3f0 tx=0x7fcdb000b8b0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4acc005850 con 0x7f4ae4157b50 2024-04-22T06:32:08.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7fcda27fc640 1 -- 172.21.15.113:0/2718974279 shutdown_connections 2024-04-22T06:32:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7fcda27fc640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdbc0c29e0 0x7fcdbc1f57f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7fcda27fc640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcda806c9f0 0x7fcda806eeb0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdac036000 tx=0x7fcdac030000 comp rx=0 tx=0).stop 2024-04-22T06:32:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7fcda27fc640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcdbc0cb0d0 0x7fcdbc1623e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7fcda27fc640 1 --2- 172.21.15.113:0/2718974279 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdbc0cac70 0x7fcdbc1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7fcda27fc640 1 -- 172.21.15.113:0/2718974279 >> 172.21.15.113:0/2718974279 conn(0x7fcdbc06d610 msgr2=0x7fcdbc159130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7fcda27fc640 1 -- 172.21.15.113:0/2718974279 shutdown_connections 2024-04-22T06:32:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7fcda27fc640 1 -- 172.21.15.113:0/2718974279 wait complete. 2024-04-22T06:32:08.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.178+0000 7f4adaffd640 1 -- 172.21.15.113:0/2859940589 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4adc05a710 con 0x7f4ae4157b50 2024-04-22T06:32:08.185 INFO:teuthology.orchestra.run.smithi113.stdout:55834574859 2024-04-22T06:32:08.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4ac806c9c0 msgr2=0x7f4ac806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4ac806c9c0 0x7f4ac806ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ae41f2300 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2024-04-22T06:32:08.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae4157b50 msgr2=0x7f4ae41f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae4157b50 0x7f4ae41f50e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00caf0 tx=0x7f4adc00cef0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 shutdown_connections 2024-04-22T06:32:08.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ae4157b50 0x7f4ae41f50e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ae4151370 0x7f4ae4156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4ac806c9c0 0x7f4ac806ee80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 --2- 172.21.15.113:0/2859940589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ae40cadc0 0x7f4ae414e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.189+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 >> 172.21.15.113:0/2859940589 conn(0x7f4ae406d610 msgr2=0x7f4ae414f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:08.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.197+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 shutdown_connections 2024-04-22T06:32:08.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.197+0000 7f4aec375640 1 -- 172.21.15.113:0/2859940589 wait complete. 2024-04-22T06:32:08.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-22T06:32:08.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.2 2024-04-22T06:32:08.216 INFO:teuthology.orchestra.run.smithi113.stdout:55834574859 2024-04-22T06:32:08.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.217+0000 7f5c38ff9640 1 -- 172.21.15.113:0/2865312349 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5c4c068e40 con 0x7f5c4c0cd130 2024-04-22T06:32:08.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.218+0000 7f5c3affd640 1 -- 172.21.15.113:0/2865312349 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c4407bd70 con 0x7f5c4c0cd130 2024-04-22T06:32:08.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.220+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f934c0c7ed0 con 0x7f934c1594c0 2024-04-22T06:32:08.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.221+0000 7f5c38ff9640 1 -- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c3406cb30 msgr2=0x7f5c3406eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.221+0000 7f5c38ff9640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c3406cb30 0x7f5c3406eff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c001520 tx=0x7f5c3c007a50 comp rx=0 tx=0).stop 2024-04-22T06:32:08.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.221+0000 7f5c38ff9640 1 -- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cd130 msgr2=0x7f5c4c15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.221+0000 7f5c38ff9640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cd130 0x7f5c4c15a0f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c4403e040 tx=0x7f5c44004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:08.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.221+0000 7f93337fe640 1 -- 172.21.15.113:0/3627144451 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9340033030 con 0x7f934c1594c0 2024-04-22T06:32:08.220 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:08.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.222+0000 7f5c38ff9640 1 -- 172.21.15.113:0/2865312349 shutdown_connections 2024-04-22T06:32:08.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.222+0000 7f5c38ff9640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5c3406cb30 0x7f5c3406eff0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.222+0000 7f5c38ff9640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5c4c0cd130 0x7f5c4c15a0f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.222+0000 7f5c38ff9640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5c4c151370 0x7f5c4c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.222+0000 7f5c38ff9640 1 --2- 172.21.15.113:0/2865312349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c4c0cc3f0 0x7f5c4c14d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.222+0000 7f5c38ff9640 1 -- 172.21.15.113:0/2865312349 >> 172.21.15.113:0/2865312349 conn(0x7f5c4c06d610 msgr2=0x7f5c4c14e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:08.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.222+0000 7f5c38ff9640 1 -- 172.21.15.113:0/2865312349 shutdown_connections 2024-04-22T06:32:08.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.222+0000 7f5c38ff9640 1 -- 172.21.15.113:0/2865312349 wait complete. 2024-04-22T06:32:08.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f933806c9c0 msgr2=0x7f933806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f933806c9c0 0x7f933806ee80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f933c006fd0 tx=0x7f933c006b40 comp rx=0 tx=0).stop 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f934c1594c0 msgr2=0x7f934c144850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f934c1594c0 0x7f934c144850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93400090b0 tx=0x7f93400046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 shutdown_connections 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f934c162340 0x7f934c149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f934c1594c0 0x7f934c144850 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93400090b0 tx=0x7f93400046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f933806c9c0 0x7f933806ee80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 --2- 172.21.15.113:0/3627144451 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f934c0c7390 0x7f934c1f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 >> 172.21.15.113:0/3627144451 conn(0x7f934c06eb30 msgr2=0x7f934c0c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 shutdown_connections 2024-04-22T06:32:08.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.230+0000 7f93508c7640 1 -- 172.21.15.113:0/3627144451 wait complete. 2024-04-22T06:32:08.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.234+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdbe8147ad0 con 0x7fdbe81586f0 2024-04-22T06:32:08.233 INFO:teuthology.orchestra.run.smithi113.stdout:55834574857 2024-04-22T06:32:08.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.234+0000 7fdbde7fc640 1 -- 172.21.15.113:0/1121479174 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdbe407bcd0 con 0x7fdbe81586f0 2024-04-22T06:32:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.237+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdbcc06c940 msgr2=0x7fdbcc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.237+0000 7fdbefcfd640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdbcc06c940 0x7fdbcc06ee00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009f50 tx=0x7fdbe0009540 comp rx=0 tx=0).stop 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.237+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbe81586f0 msgr2=0x7fdbe8148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.237+0000 7fdbefcfd640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbe81586f0 0x7fdbe8148420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80cbb50 tx=0x7fdbe40046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.238+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 shutdown_connections 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.238+0000 7fdbefcfd640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdbe81586f0 0x7fdbe8148420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.238+0000 7fdbefcfd640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdbcc06c940 0x7fdbcc06ee00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.238+0000 7fdbefcfd640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe8157a70 0x7fdbe80730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.238+0000 7fdbefcfd640 1 --2- 172.21.15.113:0/1121479174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdbe814da80 0x7fdbe80c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.238+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 >> 172.21.15.113:0/1121479174 conn(0x7fdbe806d610 msgr2=0x7fdbe814b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.238+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 shutdown_connections 2024-04-22T06:32:08.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.238+0000 7fdbefcfd640 1 -- 172.21.15.113:0/1121479174 wait complete. 2024-04-22T06:32:08.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2024-04-22T06:32:08.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.241+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa05814fda0 con 0x7fa058072bd0 2024-04-22T06:32:08.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.242+0000 7fa0557fa640 1 -- 172.21.15.113:0/3762252215 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa05814fda0 con 0x7fa058072bd0 2024-04-22T06:32:08.240 INFO:teuthology.orchestra.run.smithi113.stdout:55834574857 2024-04-22T06:32:08.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.244+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa03806c9c0 msgr2=0x7fa03806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.244+0000 7fa05edbd640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa03806c9c0 0x7fa03806ee80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa040006a90 tx=0x7fa040008040 comp rx=0 tx=0).stop 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.244+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa058072bd0 msgr2=0x7fa058147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.244+0000 7fa05edbd640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa058072bd0 0x7fa058147e30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c7a0 tx=0x7fa05000cc60 comp rx=0 tx=0).stop 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.245+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 shutdown_connections 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.245+0000 7fa05edbd640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa058151f90 0x7fa058148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.245+0000 7fa05edbd640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa03806c9c0 0x7fa03806ee80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.245+0000 7fa05edbd640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa058072bd0 0x7fa058147e30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.245+0000 7fa05edbd640 1 --2- 172.21.15.113:0/3762252215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa058070630 0x7fa0581f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.245+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 >> 172.21.15.113:0/3762252215 conn(0x7fa0580ca0d0 msgr2=0x7fa058151200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.245+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 shutdown_connections 2024-04-22T06:32:08.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.245+0000 7fa05edbd640 1 -- 172.21.15.113:0/3762252215 wait complete. 2024-04-22T06:32:08.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-04-22T06:32:08.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-04-22T06:32:08.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-04-22T06:32:08.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.288+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f36d8005580 con 0x7f36f8162a30 2024-04-22T06:32:08.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.289+0000 7f36edffb640 1 -- 172.21.15.113:0/3181403714 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f36f4058de0 con 0x7f36f8162a30 2024-04-22T06:32:08.287 INFO:teuthology.orchestra.run.smithi113.stdout:55834574857 2024-04-22T06:32:08.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.291+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f36dc06c9f0 msgr2=0x7f36dc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.291+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f36dc06c9f0 0x7f36dc06eeb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36e800b810 tx=0x7f36e8008040 comp rx=0 tx=0).stop 2024-04-22T06:32:08.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.291+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f8162a30 msgr2=0x7f36f81f86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.291+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f8162a30 0x7f36f81f86b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c710 tx=0x7f36f400cbd0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.292+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 shutdown_connections 2024-04-22T06:32:08.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.292+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f8162e10 0x7f36f81f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.292+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f36dc06c9f0 0x7f36dc06eeb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.292+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36f8162a30 0x7f36f81f86b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.292+0000 7f36ff9e6640 1 --2- 172.21.15.113:0/3181403714 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f36f80c2b30 0x7f36f81eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.292+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 >> 172.21.15.113:0/3181403714 conn(0x7f36f806f2f0 msgr2=0x7f36f8163250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:08.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.292+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 shutdown_connections 2024-04-22T06:32:08.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.292+0000 7f36ff9e6640 1 -- 172.21.15.113:0/3181403714 wait complete. 2024-04-22T06:32:08.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.298+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3bc8150890 con 0x7f3bc80c2b30 2024-04-22T06:32:08.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.299+0000 7f3bbffff640 1 -- 172.21.15.113:0/663641626 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3bc005d3f0 con 0x7f3bc80c2b30 2024-04-22T06:32:08.297 INFO:teuthology.orchestra.run.smithi113.stdout:55834574859 2024-04-22T06:32:08.299 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3ba806c9c0 msgr2=0x7f3ba806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3ba806c9c0 0x7f3ba806ee80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3bc806fcd0 tx=0x7f3bb80072f0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bc80c2b30 msgr2=0x7f3bc8149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bc80c2b30 0x7f3bc8149870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c480 tx=0x7f3bc000c940 comp rx=0 tx=0).stop 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 shutdown_connections 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3bc8162e10 0x7f3bc80c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bc8162a30 0x7f3bc81f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3ba806c9c0 0x7f3ba806ee80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 --2- 172.21.15.113:0/663641626 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bc80c2b30 0x7f3bc8149870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 >> 172.21.15.113:0/663641626 conn(0x7f3bc806f2f0 msgr2=0x7f3bc80cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:08.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 shutdown_connections 2024-04-22T06:32:08.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:08.301+0000 7f3bcd8f2640 1 -- 172.21.15.113:0/663641626 wait complete. 2024-04-22T06:32:08.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-04-22T06:32:08.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.6 2024-04-22T06:32:09.211 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T06:32:09.211 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T06:32:09.240 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T06:32:09.250 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T06:32:09.251 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T06:32:09.260 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T06:32:09.305 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T06:32:09.312 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T06:32:09.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.327+0000 7ff98582e640 1 Processor -- start 2024-04-22T06:32:09.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.327+0000 7ff98582e640 1 -- start start 2024-04-22T06:32:09.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.328+0000 7ff98582e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980159710 0x7ff9800ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.328+0000 7ff98582e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9801603e0 con 0x7ff9800cadc0 2024-04-22T06:32:09.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.328+0000 7ff98582e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff98015f860 con 0x7ff980163750 2024-04-22T06:32:09.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.328+0000 7ff98582e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff980162bb0 con 0x7ff980159710 2024-04-22T06:32:09.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980159710 0x7ff9800ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97e7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff9800cadc0 0x7ff980163040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37020/0 (socket says 172.21.15.113:37020) 2024-04-22T06:32:09.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97e7fc640 1 -- 172.21.15.113:0/2213272203 learned_addr learned my addr 172.21.15.113:0/2213272203 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064555708 0 0) 0x7ff9801603e0 con 0x7ff9800cadc0 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff968003520 con 0x7ff9800cadc0 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 858107580 0 0) 0x7ff968003520 con 0x7ff9800cadc0 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980159710 msgr2=0x7ff9800ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980159710 0x7ff9800ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 >> v1:172.21.15.145:6789/0 conn(0x7ff980163750 legacy=0x7ff9800cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98015fb40 con 0x7ff9800cadc0 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7ff974001670 con 0x7ff9800cadc0 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 >> v1:172.21.15.113:6789/0 conn(0x7ff9800cadc0 legacy=0x7ff980163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9680039e0 0x7ff968003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff968004800 0x7ff968004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9680051c0 0x7ff96800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.329+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff980162bb0 con 0x7ff968004800 2024-04-22T06:32:09.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.330+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff96801d080 con 0x7ff9680051c0 2024-04-22T06:32:09.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.330+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff96801d280 con 0x7ff9680039e0 2024-04-22T06:32:09.331 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.330+0000 7ff97e7fc640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff968004800 0x7ff968004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.330+0000 7ff97e7fc640 1 -- 172.21.15.113:0/2213272203 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9680039e0 msgr2=0x7ff968003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.331+0000 7ff97e7fc640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9680039e0 0x7ff968003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.331+0000 7ff97e7fc640 1 -- 172.21.15.113:0/2213272203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9680051c0 msgr2=0x7ff96800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.331+0000 7ff97e7fc640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9680051c0 0x7ff96800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.331+0000 7ff97e7fc640 1 -- 172.21.15.113:0/2213272203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98015fb40 con 0x7ff968004800 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.332+0000 7ff97e7fc640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff968004800 0x7ff968004c80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff97400c240 tx=0x7ff968005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3259546c4406a3cf server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.332+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974007d30 con 0x7ff968004800 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.332+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974030070 con 0x7ff968004800 2024-04-22T06:32:09.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.332+0000 7ff97dffb640 1 -- 172.21.15.113:0/2213272203 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97402cdf0 con 0x7ff968004800 2024-04-22T06:32:09.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.333+0000 7ff98582e640 1 -- 172.21.15.113:0/2213272203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff968004800 msgr2=0x7ff968004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.333+0000 7ff98582e640 1 --2- 172.21.15.113:0/2213272203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff968004800 0x7ff968004c80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff97400c240 tx=0x7ff968005830 comp rx=0 tx=0).stop 2024-04-22T06:32:09.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.333+0000 7ff97f7fe640 1 -- 172.21.15.113:0/2213272203 reap_dead start 2024-04-22T06:32:09.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.333+0000 7ff98582e640 1 -- 172.21.15.113:0/2213272203 shutdown_connections 2024-04-22T06:32:09.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.333+0000 7ff98582e640 1 -- 172.21.15.113:0/2213272203 >> 172.21.15.113:0/2213272203 conn(0x7ff98006d610 msgr2=0x7ff980074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.333+0000 7ff98582e640 1 -- 172.21.15.113:0/2213272203 shutdown_connections 2024-04-22T06:32:09.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.333+0000 7ff98582e640 1 -- 172.21.15.113:0/2213272203 wait complete. 2024-04-22T06:32:09.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.335+0000 7ff98582e640 1 Processor -- start 2024-04-22T06:32:09.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.336+0000 7ff98582e640 1 -- start start 2024-04-22T06:32:09.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.337+0000 7ff98582e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff980157570 0x7ff980153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.336 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.337+0000 7ff98582e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980073ee0 0x7ff980154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.337+0000 7ff98582e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff980157950 0x7ff9801efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.337+0000 7ff97effd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff980157570 0x7ff980153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.337+0000 7ff97effd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff980157570 0x7ff980153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:34370/0 (socket says 172.21.15.113:34370) 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.337+0000 7ff97e7fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980073ee0 0x7ff980154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.337+0000 7ff97e7fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980073ee0 0x7ff980154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:48328/0 (socket says 172.21.15.113:48328) 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.338+0000 7ff97f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff980157950 0x7ff9801efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.338+0000 7ff97f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff980157950 0x7ff9801efe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39964/0 (socket says 172.21.15.113:39964) 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.338+0000 7ff97effd640 1 -- 172.21.15.113:0/1688587912 learned_addr learned my addr 172.21.15.113:0/1688587912 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.338+0000 7ff98582e640 1 -- 172.21.15.113:0/1688587912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff980159af0 con 0x7ff980157950 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.338+0000 7ff98582e640 1 -- 172.21.15.113:0/1688587912 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff980160100 con 0x7ff980157570 2024-04-22T06:32:09.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.338+0000 7ff98582e640 1 -- 172.21.15.113:0/1688587912 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff9801eca00 con 0x7ff980073ee0 2024-04-22T06:32:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.339+0000 7ff97f7fe640 1 -- 172.21.15.113:0/1688587912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980073ee0 msgr2=0x7ff980154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.339+0000 7ff97f7fe640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980073ee0 0x7ff980154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.339+0000 7ff97f7fe640 1 -- 172.21.15.113:0/1688587912 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff980157570 msgr2=0x7ff980153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.339+0000 7ff97f7fe640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff980157570 0x7ff980153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.339+0000 7ff97f7fe640 1 -- 172.21.15.113:0/1688587912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9801ecc70 con 0x7ff980157950 2024-04-22T06:32:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.340+0000 7ff97f7fe640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff980157950 0x7ff9801efe60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff9680039b0 tx=0x7ff97800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.340+0000 7ff967fff640 1 -- 172.21.15.113:0/1688587912 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978017070 con 0x7ff980157950 2024-04-22T06:32:09.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.341+0000 7ff98582e640 1 -- 172.21.15.113:0/1688587912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9801ecf50 con 0x7ff980157950 2024-04-22T06:32:09.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.343+0000 7ff98582e640 1 -- 172.21.15.113:0/1688587912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9801ed510 con 0x7ff980157950 2024-04-22T06:32:09.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.345+0000 7ff967fff640 1 -- 172.21.15.113:0/1688587912 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff978005d40 con 0x7ff980157950 2024-04-22T06:32:09.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.345+0000 7ff965ffb640 1 -- 172.21.15.113:0/1688587912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff960005290 con 0x7ff980157950 2024-04-22T06:32:09.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.346+0000 7f9d45425640 1 Processor -- start 2024-04-22T06:32:09.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.346+0000 7f9d45425640 1 -- start start 2024-04-22T06:32:09.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.348+0000 7f9d45425640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9d40151370 0x7f9d40157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.348+0000 7f9d45425640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc860 0x7f9d40071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.348+0000 7f9d45425640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d400ccd30 con 0x7f9d400cc3f0 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.348+0000 7f9d45425640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9d4015a6c0 con 0x7f9d40151370 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.348+0000 7f9d45425640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4015a9a0 con 0x7f9d400cc860 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.348+0000 7f9d3e7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9d400cc3f0 0x7f9d400ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37028/0 (socket says 172.21.15.113:37028) 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.348+0000 7f9d3e7fc640 1 -- 172.21.15.113:0/339978410 learned_addr learned my addr 172.21.15.113:0/339978410 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.349+0000 7f9d3f7fe640 1 --2- 172.21.15.113:0/339978410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc860 0x7f9d40071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.350+0000 7f9d3f7fe640 1 -- 172.21.15.113:0/339978410 >> v2:172.21.15.113:3300/0 conn(0x7f9d40151370 msgr2=0x7f9d40157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.350+0000 7f9d3f7fe640 1 --2- 172.21.15.113:0/339978410 >> v2:172.21.15.113:3300/0 conn(0x7f9d40151370 0x7f9d40157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.350+0000 7f9d3f7fe640 1 -- 172.21.15.113:0/339978410 >> v1:172.21.15.113:6789/0 conn(0x7f9d400cc3f0 legacy=0x7f9d400ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.350+0000 7f9d3f7fe640 1 -- 172.21.15.113:0/339978410 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4015ac80 con 0x7f9d400cc860 2024-04-22T06:32:09.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.351+0000 7f9d3f7fe640 1 --2- 172.21.15.113:0/339978410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc860 0x7f9d40071710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800be90 tx=0x7f9d3802dfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e72f27a3f729bc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.351+0000 7f9d3dffb640 1 -- 172.21.15.113:0/339978410 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38034070 con 0x7f9d400cc860 2024-04-22T06:32:09.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.351+0000 7f9d3dffb640 1 -- 172.21.15.113:0/339978410 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3802ed60 con 0x7f9d400cc860 2024-04-22T06:32:09.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.346+0000 7ff967fff640 1 -- 172.21.15.113:0/1688587912 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97800a830 con 0x7ff980157950 2024-04-22T06:32:09.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.346+0000 7ff967fff640 1 -- 172.21.15.113:0/1688587912 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff97800aa90 con 0x7ff980157950 2024-04-22T06:32:09.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.347+0000 7ff967fff640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff96c06c9f0 0x7ff96c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.347+0000 7ff967fff640 1 -- 172.21.15.113:0/1688587912 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff97808ae10 con 0x7ff980157950 2024-04-22T06:32:09.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.352+0000 7f9d45425640 1 -- 172.21.15.113:0/339978410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc860 msgr2=0x7f9d40071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.352+0000 7f9d45425640 1 --2- 172.21.15.113:0/339978410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc860 0x7f9d40071710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800be90 tx=0x7f9d3802dfb0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.352+0000 7f9d45425640 1 -- 172.21.15.113:0/339978410 shutdown_connections 2024-04-22T06:32:09.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.353+0000 7f9d45425640 1 --2- 172.21.15.113:0/339978410 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc860 0x7f9d40071710 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.353+0000 7f9d45425640 1 --2- 172.21.15.113:0/339978410 >> v2:172.21.15.113:3300/0 conn(0x7f9d40151370 0x7f9d40157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.353+0000 7f9d45425640 1 -- 172.21.15.113:0/339978410 >> 172.21.15.113:0/339978410 conn(0x7f9d4006d610 msgr2=0x7f9d40074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.353+0000 7f9d45425640 1 -- 172.21.15.113:0/339978410 shutdown_connections 2024-04-22T06:32:09.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.353+0000 7f9d45425640 1 -- 172.21.15.113:0/339978410 wait complete. 2024-04-22T06:32:09.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.355+0000 7f9d45425640 1 Processor -- start 2024-04-22T06:32:09.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.355+0000 7f9d45425640 1 -- start start 2024-04-22T06:32:09.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.356+0000 7f9d45425640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc3f0 0x7f9d401ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.356+0000 7f9d45425640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d400cc860 0x7f9d400c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.356+0000 7f9d45425640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d40151370 0x7f9d40071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.357+0000 7f9d45425640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40151750 con 0x7f9d40151370 2024-04-22T06:32:09.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.357+0000 7f9d45425640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4015b240 con 0x7f9d400cc860 2024-04-22T06:32:09.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.357+0000 7f9d45425640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d400caf90 con 0x7f9d400cc3f0 2024-04-22T06:32:09.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.359+0000 7f9d3effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc3f0 0x7f9d401ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.359+0000 7f9d3effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc3f0 0x7f9d401ed660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:48334/0 (socket says 172.21.15.113:48334) 2024-04-22T06:32:09.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.359+0000 7f9d3effd640 1 -- 172.21.15.113:0/964071119 learned_addr learned my addr 172.21.15.113:0/964071119 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.359+0000 7f9d3e7fc640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d400cc860 0x7f9d400c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.359+0000 7ff97effd640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff96c06c9f0 0x7ff96c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.359+0000 7f9d3f7fe640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d40151370 0x7f9d40071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.360+0000 7f9d3effd640 1 -- 172.21.15.113:0/964071119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d400cc860 msgr2=0x7f9d400c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.360+0000 7f9d3effd640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d400cc860 0x7f9d400c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.360+0000 7f9d3effd640 1 -- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d40151370 msgr2=0x7f9d40071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.360+0000 7ff97effd640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff96c06c9f0 0x7ff96c06eeb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff970006fd0 tx=0x7ff970008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.360+0000 7f9d3effd640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d40151370 0x7f9d40071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.360+0000 7f9d3effd640 1 -- 172.21.15.113:0/964071119 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d40147240 con 0x7f9d400cc3f0 2024-04-22T06:32:09.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.361+0000 7f9d3effd640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc3f0 0x7f9d401ed660 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000b410 tx=0x7f9d3000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.361+0000 7ff967fff640 1 -- 172.21.15.113:0/1688587912 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff978058980 con 0x7ff980157950 2024-04-22T06:32:09.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.373+0000 7f9d277fe640 1 -- 172.21.15.113:0/964071119 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30015020 con 0x7f9d400cc3f0 2024-04-22T06:32:09.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.373+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d40147520 con 0x7f9d400cc3f0 2024-04-22T06:32:09.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.373+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d400715e0 con 0x7f9d400cc3f0 2024-04-22T06:32:09.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.373+0000 7f9d277fe640 1 -- 172.21.15.113:0/964071119 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30011850 con 0x7f9d400cc3f0 2024-04-22T06:32:09.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.373+0000 7f9d277fe640 1 -- 172.21.15.113:0/964071119 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30011c40 con 0x7f9d400cc3f0 2024-04-22T06:32:09.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.385+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d20005290 con 0x7f9d400cc3f0 2024-04-22T06:32:09.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.392+0000 7f9d277fe640 1 -- 172.21.15.113:0/964071119 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d30018020 con 0x7f9d400cc3f0 2024-04-22T06:32:09.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.392+0000 7f9d277fe640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d2c06c9c0 0x7f9d2c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.392+0000 7f9d277fe640 1 -- 172.21.15.113:0/964071119 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9d3008bc80 con 0x7f9d400cc3f0 2024-04-22T06:32:09.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.393+0000 7f9d3e7fc640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d2c06c9c0 0x7f9d2c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.394+0000 7f9d3e7fc640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d2c06c9c0 0x7f9d2c06ee80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d40147a90 tx=0x7f9d34005e90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.406+0000 7f9d277fe640 1 -- 172.21.15.113:0/964071119 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d30092080 con 0x7f9d400cc3f0 2024-04-22T06:32:09.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.425+0000 7f3b82baf640 1 Processor -- start 2024-04-22T06:32:09.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.424+0000 7f38d9a70640 1 Processor -- start 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.424+0000 7f38d9a70640 1 -- start start 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.425+0000 7f38d9a70640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38d40ca020 0x7f38d40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.426+0000 7f38d9a70640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f38d40ca400 0x7f38d4158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.426+0000 7f38d9a70640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d40ca9d0 con 0x7f38d4072b30 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.426+0000 7f38d9a70640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f38d4162920 con 0x7f38d40ca400 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.426+0000 7f38d9a70640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f38d4162be0 con 0x7f38d40ca020 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.426+0000 7f38d3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f38d40ca400 0x7f38d4158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.426+0000 7f38d926f640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f38d4072b30 0x7f38d415f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:58194/0 (socket says 172.21.15.113:58194) 2024-04-22T06:32:09.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.426+0000 7f38d926f640 1 -- 172.21.15.113:0/759802564 learned_addr learned my addr 172.21.15.113:0/759802564 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:09.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.426+0000 7f3b82baf640 1 -- start start 2024-04-22T06:32:09.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f3b82baf640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b7c0cc7c0 0x7f3b7c0c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f3b82baf640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3b7c0c56c0 0x7f3b7c0d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f3b82baf640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c0c5c60 con 0x7f3b7c155150 2024-04-22T06:32:09.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f3b82baf640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7c0c6840 con 0x7f3b7c0cc7c0 2024-04-22T06:32:09.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f3b82baf640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7c0c7210 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f3b813ac640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b7c0cc7c0 0x7f3b7c0c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f3b813ac640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b7c0cc7c0 0x7f3b7c0c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:39998/0 (socket says 172.21.15.113:39998) 2024-04-22T06:32:09.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f3b813ac640 1 -- 172.21.15.113:0/2306973372 learned_addr learned my addr 172.21.15.113:0/2306973372 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f3b823ae640 1 --2- 172.21.15.113:0/2306973372 >> v2:172.21.15.145:3300/0 conn(0x7f3b7c0c56c0 0x7f3b7c0d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f38d3fff640 1 -- 172.21.15.113:0/759802564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38d40ca020 msgr2=0x7f38d40700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f38d3fff640 1 --2- 172.21.15.113:0/759802564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38d40ca020 0x7f38d40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f38d3fff640 1 -- 172.21.15.113:0/759802564 >> v1:172.21.15.145:6789/0 conn(0x7f38d4072b30 legacy=0x7f38d415f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f38d3fff640 1 -- 172.21.15.113:0/759802564 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d4162ec0 con 0x7f38d40ca400 2024-04-22T06:32:09.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f38d3fff640 1 --2- 172.21.15.113:0/759802564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d40ca400 0x7f38d4158f90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009a00 tx=0x7f38c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d293d84c868a013 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.429+0000 7f38d37fe640 1 -- 172.21.15.113:0/759802564 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8035020 con 0x7f38d40ca400 2024-04-22T06:32:09.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.429+0000 7f38d37fe640 1 -- 172.21.15.113:0/759802564 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c802d040 con 0x7f38d40ca400 2024-04-22T06:32:09.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f38d9a70640 1 -- 172.21.15.113:0/759802564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d40ca400 msgr2=0x7f38d4158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f38d9a70640 1 --2- 172.21.15.113:0/759802564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d40ca400 0x7f38d4158f90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009a00 tx=0x7f38c802b980 comp rx=0 tx=0).stop 2024-04-22T06:32:09.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.429+0000 7f3b813ac640 1 -- 172.21.15.113:0/2306973372 >> v2:172.21.15.145:3300/0 conn(0x7f3b7c0c56c0 msgr2=0x7f3b7c0d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.429+0000 7f3b813ac640 1 --2- 172.21.15.113:0/2306973372 >> v2:172.21.15.145:3300/0 conn(0x7f3b7c0c56c0 0x7f3b7c0d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.429+0000 7f3b813ac640 1 -- 172.21.15.113:0/2306973372 >> v1:172.21.15.145:6789/0 conn(0x7f3b7c155150 legacy=0x7f3b7c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f38d9a70640 1 -- 172.21.15.113:0/759802564 shutdown_connections 2024-04-22T06:32:09.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f38d9a70640 1 --2- 172.21.15.113:0/759802564 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d40ca400 0x7f38d4158f90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f38d9a70640 1 --2- 172.21.15.113:0/759802564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38d40ca020 0x7f38d40700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f38d9a70640 1 -- 172.21.15.113:0/759802564 >> 172.21.15.113:0/759802564 conn(0x7f38d406b920 msgr2=0x7f38d406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.429+0000 7f3b813ac640 1 -- 172.21.15.113:0/2306973372 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c0cb8e0 con 0x7f3b7c0cc7c0 2024-04-22T06:32:09.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f3b813ac640 1 --2- 172.21.15.113:0/2306973372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0cc7c0 0x7f3b7c0c6cd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c06c5c0 tx=0x7f3b7402bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d60f7099c73f3de server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f932e2c1640 1 Processor -- start 2024-04-22T06:32:09.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.427+0000 7f932e2c1640 1 -- start start 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f932e2c1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 0x7f932806e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f932e2c1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f93280c3450 0x7f93280c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f932e2c1640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9328158040 con 0x7f93280c21d0 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f932e2c1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f93280c2720 con 0x7f93280c3450 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f932e2c1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9328158320 con 0x7f9328151980 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f932c85e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f93280c3450 0x7f93280c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f932c85e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f93280c3450 0x7f93280c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40002/0 (socket says 172.21.15.113:40002) 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f932c85e640 1 -- 172.21.15.113:0/3694511233 learned_addr learned my addr 172.21.15.113:0/3694511233 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.428+0000 7f9327fff640 1 --2- 172.21.15.113:0/3694511233 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 0x7f932806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.429+0000 7f9326ffd640 1 -- 172.21.15.113:0/3694511233 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972459768 0 0) 0x7f9328158040 con 0x7f93280c21d0 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.429+0000 7f9326ffd640 1 -- 172.21.15.113:0/3694511233 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9310003520 con 0x7f93280c21d0 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f932c85e640 1 -- 172.21.15.113:0/3694511233 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 msgr2=0x7f932806e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f932c85e640 1 --2- 172.21.15.113:0/3694511233 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 0x7f932806e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f932c85e640 1 -- 172.21.15.113:0/3694511233 >> v1:172.21.15.145:6789/0 conn(0x7f93280c21d0 legacy=0x7f932806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.430+0000 7f932c85e640 1 -- 172.21.15.113:0/3694511233 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93280c2970 con 0x7f93280c3450 2024-04-22T06:32:09.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.431+0000 7f3b80bab640 1 -- 172.21.15.113:0/2306973372 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7402cb50 con 0x7f3b7c0cc7c0 2024-04-22T06:32:09.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.431+0000 7f3b80bab640 1 -- 172.21.15.113:0/2306973372 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7402ccf0 con 0x7f3b7c0cc7c0 2024-04-22T06:32:09.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.431+0000 7f3b80bab640 1 -- 172.21.15.113:0/2306973372 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b740345f0 con 0x7f3b7c0cc7c0 2024-04-22T06:32:09.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.432+0000 7f38d9a70640 1 -- 172.21.15.113:0/759802564 shutdown_connections 2024-04-22T06:32:09.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f3b82baf640 1 -- 172.21.15.113:0/2306973372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0cc7c0 msgr2=0x7f3b7c0c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f3b82baf640 1 --2- 172.21.15.113:0/2306973372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0cc7c0 0x7f3b7c0c6cd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c06c5c0 tx=0x7f3b7402bfb0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.432+0000 7f932c85e640 1 --2- 172.21.15.113:0/3694511233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f93280c38c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9320009e50 tx=0x7f932002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c0576d74579f60 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.432+0000 7f9326ffd640 1 -- 172.21.15.113:0/3694511233 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318001670 con 0x7f93280c3450 2024-04-22T06:32:09.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.432+0000 7f9326ffd640 1 -- 172.21.15.113:0/3694511233 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f932002c6a0 con 0x7f93280c3450 2024-04-22T06:32:09.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.432+0000 7f9326ffd640 1 -- 172.21.15.113:0/3694511233 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932002ca50 con 0x7f93280c3450 2024-04-22T06:32:09.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f3b82baf640 1 -- 172.21.15.113:0/2306973372 shutdown_connections 2024-04-22T06:32:09.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f3b82baf640 1 --2- 172.21.15.113:0/2306973372 >> v2:172.21.15.145:3300/0 conn(0x7f3b7c0c56c0 0x7f3b7c0d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f3b82baf640 1 --2- 172.21.15.113:0/2306973372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0cc7c0 0x7f3b7c0c6cd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f3b82baf640 1 -- 172.21.15.113:0/2306973372 >> 172.21.15.113:0/2306973372 conn(0x7f3b7c074d50 msgr2=0x7f3b7c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f3b82baf640 1 -- 172.21.15.113:0/2306973372 shutdown_connections 2024-04-22T06:32:09.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f932e2c1640 1 -- 172.21.15.113:0/3694511233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 msgr2=0x7f93280c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f932e2c1640 1 --2- 172.21.15.113:0/3694511233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f93280c38c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9320009e50 tx=0x7f932002bd80 comp rx=0 tx=0).stop 2024-04-22T06:32:09.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.434+0000 7f932e2c1640 1 -- 172.21.15.113:0/3694511233 shutdown_connections 2024-04-22T06:32:09.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.434+0000 7f932e2c1640 1 --2- 172.21.15.113:0/3694511233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f93280c38c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.434+0000 7f932e2c1640 1 --2- 172.21.15.113:0/3694511233 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 0x7f932806e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.434+0000 7f932e2c1640 1 -- 172.21.15.113:0/3694511233 >> 172.21.15.113:0/3694511233 conn(0x7f932806f2f0 msgr2=0x7f932806f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.433+0000 7f3b82baf640 1 -- 172.21.15.113:0/2306973372 wait complete. 2024-04-22T06:32:09.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.435+0000 7f3b82baf640 1 Processor -- start 2024-04-22T06:32:09.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.435+0000 7f932e2c1640 1 -- 172.21.15.113:0/3694511233 shutdown_connections 2024-04-22T06:32:09.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f3b82baf640 1 -- start start 2024-04-22T06:32:09.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.432+0000 7f38d9a70640 1 -- 172.21.15.113:0/759802564 wait complete. 2024-04-22T06:32:09.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.434+0000 7f38d9a70640 1 Processor -- start 2024-04-22T06:32:09.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.434+0000 7f38d9a70640 1 -- start start 2024-04-22T06:32:09.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.435+0000 7f38d9a70640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d4072b30 0x7f38d420e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.435+0000 7f38d9a70640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38d40ca020 0x7f38d40c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.435+0000 7f38d9a70640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38d40ca400 0x7f38d415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.437+0000 7f3b82baf640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0c56c0 0x7f3b7c1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.435+0000 7f38d9a70640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f38d40705e0 con 0x7f38d4072b30 2024-04-22T06:32:09.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.435+0000 7f38d9a70640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f38d4163480 con 0x7f38d40ca020 2024-04-22T06:32:09.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.435+0000 7f38d9a70640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f38d4070760 con 0x7f38d40ca400 2024-04-22T06:32:09.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d4072b30 0x7f38d420e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d4072b30 0x7f38d420e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40004/0 (socket says 172.21.15.113:40004) 2024-04-22T06:32:09.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 -- 172.21.15.113:0/3430299854 learned_addr learned my addr 172.21.15.113:0/3430299854 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 -- 172.21.15.113:0/3430299854 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38d40ca400 msgr2=0x7f38d415e8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:09.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38d40ca400 0x7f38d415e8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.437+0000 7f3b81bad640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0c56c0 0x7f3b7c1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 -- 172.21.15.113:0/3430299854 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38d40ca020 msgr2=0x7f38d40c68a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:09.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.437+0000 7f3b81bad640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0c56c0 0x7f3b7c1557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40018/0 (socket says 172.21.15.113:40018) 2024-04-22T06:32:09.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.437+0000 7f3b81bad640 1 -- 172.21.15.113:0/1527596205 learned_addr learned my addr 172.21.15.113:0/1527596205 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.437+0000 7f3b82baf640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7c0cc7c0 0x7f3b7c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38d40ca020 0x7f38d40c68a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 -- 172.21.15.113:0/3430299854 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d4152290 con 0x7f38d4072b30 2024-04-22T06:32:09.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.438+0000 7f3b82baf640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b7c155150 0x7f3b7c14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f38d8a6e640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d4072b30 0x7f38d420e840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00bd60 tx=0x7f38cc009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.438+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c0c64d0 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.438+0000 7f38d17fa640 1 -- 172.21.15.113:0/3430299854 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc019070 con 0x7f38d4072b30 2024-04-22T06:32:09.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.438+0000 7f38d17fa640 1 -- 172.21.15.113:0/3430299854 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc00cc80 con 0x7f38d4072b30 2024-04-22T06:32:09.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.438+0000 7f38d17fa640 1 -- 172.21.15.113:0/3430299854 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc014680 con 0x7f38d4072b30 2024-04-22T06:32:09.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.438+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d4152570 con 0x7f38d4072b30 2024-04-22T06:32:09.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.438+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d4152b30 con 0x7f38d4072b30 2024-04-22T06:32:09.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.436+0000 7f932e2c1640 1 -- 172.21.15.113:0/3694511233 wait complete. 2024-04-22T06:32:09.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.439+0000 7f3b823ae640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b7c155150 0x7f3b7c14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.439+0000 7f3b813ac640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7c0cc7c0 0x7f3b7c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.439+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c0c61f0 con 0x7f3b7c155150 2024-04-22T06:32:09.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.439+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c155530 con 0x7f3b7c0cc7c0 2024-04-22T06:32:09.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.440+0000 7f3b81bad640 1 -- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7c0cc7c0 msgr2=0x7f3b7c14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.440+0000 7f3b81bad640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7c0cc7c0 0x7f3b7c14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.440+0000 7f3b81bad640 1 -- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b7c155150 msgr2=0x7f3b7c14a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.440+0000 7f3b81bad640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b7c155150 0x7f3b7c14a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.440+0000 7f3b81bad640 1 -- 172.21.15.113:0/1527596205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c14ce70 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.440+0000 7f3b823ae640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b7c155150 0x7f3b7c14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.440+0000 7f3b81bad640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0c56c0 0x7f3b7c1557a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800c780 tx=0x7f3b7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.441+0000 7f3b727fc640 1 -- 172.21.15.113:0/1527596205 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b780052d0 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.441+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c14d150 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.441+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c14d710 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.444+0000 7f3b727fc640 1 -- 172.21.15.113:0/1527596205 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b78005470 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.444+0000 7f3b727fc640 1 -- 172.21.15.113:0/1527596205 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800a860 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f3b727fc640 1 -- 172.21.15.113:0/1527596205 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b7800aa40 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.446+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d4069310 con 0x7f38d4072b30 2024-04-22T06:32:09.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.446+0000 7f3b727fc640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3b6006c950 0x7f3b6006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.438+0000 7f932e2c1640 1 Processor -- start 2024-04-22T06:32:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.443+0000 7f932e2c1640 1 -- start start 2024-04-22T06:32:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.444+0000 7f932e2c1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93280c21d0 0x7f932814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.444+0000 7f932e2c1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f932814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.444+0000 7f932e2c1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 0x7f932814c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.444+0000 7f932e2c1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f932806ddd0 con 0x7f93280c3450 2024-04-22T06:32:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.444+0000 7f932e2c1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f93280c2f30 con 0x7f93280c21d0 2024-04-22T06:32:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.444+0000 7f932e2c1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f932806df50 con 0x7f9328151980 2024-04-22T06:32:09.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.446+0000 7f3b813ac640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3b6006c950 0x7f3b6006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f93277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f932814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f93277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f932814ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40020/0 (socket says 172.21.15.113:40020) 2024-04-22T06:32:09.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f93277fe640 1 -- 172.21.15.113:0/3425956523 learned_addr learned my addr 172.21.15.113:0/3425956523 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f93277fe640 1 -- 172.21.15.113:0/3425956523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 msgr2=0x7f932814c390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:09.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f93277fe640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 0x7f932814c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f93277fe640 1 -- 172.21.15.113:0/3425956523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93280c21d0 msgr2=0x7f932814e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:09.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f93277fe640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93280c21d0 0x7f932814e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.445+0000 7f93277fe640 1 -- 172.21.15.113:0/3425956523 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9328159570 con 0x7f93280c3450 2024-04-22T06:32:09.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.446+0000 7f93277fe640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f932814ecc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f931800ca70 tx=0x7f931800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.447+0000 7f9324ff9640 1 -- 172.21.15.113:0/3425956523 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318017070 con 0x7f93280c3450 2024-04-22T06:32:09.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.447+0000 7f3b813ac640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3b6006c950 0x7f3b6006ee10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b74035000 tx=0x7f3b74030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.448+0000 7f3b727fc640 1 -- 172.21.15.113:0/1527596205 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3b7808bc90 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.448+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b64005290 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.448+0000 7f9324ff9640 1 -- 172.21.15.113:0/3425956523 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9318005270 con 0x7f93280c3450 2024-04-22T06:32:09.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.448+0000 7f9324ff9640 1 -- 172.21.15.113:0/3425956523 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931800a960 con 0x7f93280c3450 2024-04-22T06:32:09.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.449+0000 7f38d17fa640 1 -- 172.21.15.113:0/3430299854 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38cc01c070 con 0x7f38d4072b30 2024-04-22T06:32:09.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.449+0000 7f38d17fa640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f38c006c9c0 0x7f38c006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.449+0000 7f38d17fa640 1 -- 172.21.15.113:0/3430299854 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f38cc08bc60 con 0x7f38d4072b30 2024-04-22T06:32:09.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.450+0000 7f38d3fff640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f38c006c9c0 0x7f38c006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.450+0000 7f932e2c1640 1 -- 172.21.15.113:0/3425956523 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932814a080 con 0x7f93280c3450 2024-04-22T06:32:09.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.450+0000 7f932e2c1640 1 -- 172.21.15.113:0/3425956523 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f932814a620 con 0x7f93280c3450 2024-04-22T06:32:09.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.450+0000 7f38d3fff640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f38c006c9c0 0x7f38c006ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f38c8036000 tx=0x7f38c8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.454+0000 7f932e2c1640 1 -- 172.21.15.113:0/3425956523 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9308005290 con 0x7f93280c3450 2024-04-22T06:32:09.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.459+0000 7f38d17fa640 1 -- 172.21.15.113:0/3430299854 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38cc059650 con 0x7f38d4072b30 2024-04-22T06:32:09.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.469+0000 7f3b727fc640 1 -- 172.21.15.113:0/1527596205 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b78019300 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.472+0000 7f9324ff9640 1 -- 172.21.15.113:0/3425956523 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f931801a070 con 0x7f93280c3450 2024-04-22T06:32:09.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.472+0000 7f9324ff9640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f931406c9c0 0x7f931406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.472+0000 7f9324ff9640 1 -- 172.21.15.113:0/3425956523 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f931808b940 con 0x7f93280c3450 2024-04-22T06:32:09.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.473+0000 7f448f967640 1 Processor -- start 2024-04-22T06:32:09.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.473+0000 7f9327fff640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f931406c9c0 0x7f931406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.474+0000 7f9327fff640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f931406c9c0 0x7f931406ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f931c00a790 tx=0x7f931c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.474+0000 7f448f967640 1 -- start start 2024-04-22T06:32:09.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.475+0000 7f448f967640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44800de7c0 0x7f4480005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.475+0000 7f448f967640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4480006600 con 0x7f44800dcbc0 2024-04-22T06:32:09.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.475+0000 7f448f967640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44800068e0 con 0x7f44800d6b60 2024-04-22T06:32:09.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.475+0000 7f448f967640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f44800074f0 con 0x7f44800de7c0 2024-04-22T06:32:09.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.475+0000 7f448cf02640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f44800dcbc0 0x7f44800de0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37036/0 (socket says 172.21.15.113:37036) 2024-04-22T06:32:09.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.475+0000 7f448cf02640 1 -- 172.21.15.113:0/270370488 learned_addr learned my addr 172.21.15.113:0/270370488 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:09.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.475+0000 7f448d703640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f44800d6b60 0x7f448004d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:58222/0 (socket says 172.21.15.113:58222) 2024-04-22T06:32:09.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.479+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226940150 0 0) 0x7f4480006600 con 0x7f44800dcbc0 2024-04-22T06:32:09.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.479+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4474003520 con 0x7f44800dcbc0 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.480+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2808292587 0 0) 0x7f4474003520 con 0x7f44800dcbc0 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.480+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44800de7c0 msgr2=0x7f4480005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.480+0000 7f447ffff640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44800de7c0 0x7f4480005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.480+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 >> v1:172.21.15.145:6789/0 conn(0x7f44800d6b60 legacy=0x7f448004d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.480+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4480006bc0 con 0x7f44800dcbc0 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.480+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f4488074ad0 con 0x7f44800dcbc0 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.481+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 >> v1:172.21.15.113:6789/0 conn(0x7f44800dcbc0 legacy=0x7f44800de0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.481+0000 7f447ffff640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44740039e0 0x7f4474003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.481+0000 7f447ffff640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4474004800 0x7f4474004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.481+0000 7f447ffff640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44740051c0 0x7f447400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.481+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f447400bfb0 con 0x7f44740051c0 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.481+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f447400c160 con 0x7f4474004800 2024-04-22T06:32:09.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.482+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f447400c360 con 0x7f44740039e0 2024-04-22T06:32:09.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.482+0000 7f448df04640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44740051c0 0x7f447400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.483+0000 7f448df04640 1 -- 172.21.15.113:0/270370488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44740039e0 msgr2=0x7f4474003dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T06:32:09.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.483+0000 7f448df04640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44740039e0 0x7f4474003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.483+0000 7f448df04640 1 -- 172.21.15.113:0/270370488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4474004800 msgr2=0x7f4474004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T06:32:09.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.483+0000 7f448df04640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4474004800 0x7f4474004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.483+0000 7f448df04640 1 -- 172.21.15.113:0/270370488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4474003520 con 0x7f44740051c0 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.484+0000 7f9324ff9640 1 -- 172.21.15.113:0/3425956523 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9328159570 con 0x7f93280c3450 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.484+0000 7f448df04640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44740051c0 0x7f447400b9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f44800deba0 tx=0x7f4474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c20a17e9450336 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.485+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478037070 con 0x7f44740051c0 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.485+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4478032600 con 0x7f44740051c0 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.486+0000 7f448f967640 1 -- 172.21.15.113:0/270370488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44740051c0 msgr2=0x7f447400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.486+0000 7f447ffff640 1 -- 172.21.15.113:0/270370488 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478037070 con 0x7f44740051c0 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.486+0000 7f448f967640 1 --2- 172.21.15.113:0/270370488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f44740051c0 0x7f447400b9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f44800deba0 tx=0x7f4474005830 comp rx=0 tx=0).stop 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.486+0000 7f448df04640 1 -- 172.21.15.113:0/270370488 reap_dead start 2024-04-22T06:32:09.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.486+0000 7f448f967640 1 -- 172.21.15.113:0/270370488 shutdown_connections 2024-04-22T06:32:09.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.486+0000 7f448f967640 1 -- 172.21.15.113:0/270370488 >> 172.21.15.113:0/270370488 conn(0x7f448004ee60 msgr2=0x7f448004f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.495+0000 7f448f967640 1 -- 172.21.15.113:0/270370488 shutdown_connections 2024-04-22T06:32:09.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.495+0000 7f448f967640 1 -- 172.21.15.113:0/270370488 wait complete. 2024-04-22T06:32:09.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.496+0000 7f993941f640 1 Processor -- start 2024-04-22T06:32:09.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.497+0000 7f448f967640 1 Processor -- start 2024-04-22T06:32:09.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.497+0000 7f448f967640 1 -- start start 2024-04-22T06:32:09.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.496+0000 7f993941f640 1 -- start start 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.497+0000 7f993941f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9934151440 0x7f99340c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.497+0000 7f993941f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9934156fe0 con 0x7f99340c7750 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.497+0000 7f993941f640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99341572c0 con 0x7f99340c9930 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.497+0000 7f993941f640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f99341575a0 con 0x7f9934151440 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.498+0000 7f9938c1e640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f99340c9930 0x7f99340c3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:58230/0 (socket says 172.21.15.113:58230) 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.498+0000 7f9938c1e640 1 -- 172.21.15.113:0/2254068494 learned_addr learned my addr 172.21.15.113:0/2254068494 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.498+0000 7f9933fff640 1 --2- 172.21.15.113:0/2254068494 >> v2:172.21.15.145:3300/0 conn(0x7f9934151440 0x7f99340c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.498+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254344069 0 0) 0x7f9934156fe0 con 0x7f99340c7750 2024-04-22T06:32:09.497 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.498+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f991c003520 con 0x7f99340c7750 2024-04-22T06:32:09.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1634442643 0 0) 0x7f991c003520 con 0x7f99340c7750 2024-04-22T06:32:09.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f544725c640 1 Processor -- start 2024-04-22T06:32:09.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 >> v2:172.21.15.145:3300/0 conn(0x7f9934151440 msgr2=0x7f99340c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f9932ffd640 1 --2- 172.21.15.113:0/2254068494 >> v2:172.21.15.145:3300/0 conn(0x7f9934151440 0x7f99340c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 >> v1:172.21.15.145:6789/0 conn(0x7f99340c9930 legacy=0x7f99340c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9934157880 con 0x7f99340c7750 2024-04-22T06:32:09.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f448f967640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4480007ec0 0x7f44800cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f448f967640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4480034e00 0x7f44800cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f448f967640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44800082a0 0x7f4480008e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f448f967640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f44800d6f40 con 0x7f4480007ec0 2024-04-22T06:32:09.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f448f967640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4480007180 con 0x7f44800082a0 2024-04-22T06:32:09.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.499+0000 7f448f967640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f44800d70c0 con 0x7f4480034e00 2024-04-22T06:32:09.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448d703640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4480007ec0 0x7f44800cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448d703640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4480007ec0 0x7f44800cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40040/0 (socket says 172.21.15.113:40040) 2024-04-22T06:32:09.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448d703640 1 -- 172.21.15.113:0/2498890215 learned_addr learned my addr 172.21.15.113:0/2498890215 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448df04640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44800082a0 0x7f4480008e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448cf02640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4480034e00 0x7f44800cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f9928001670 con 0x7f99340c7750 2024-04-22T06:32:09.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 >> v1:172.21.15.113:6789/0 conn(0x7f99340c7750 legacy=0x7f99340c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448cf02640 1 -- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44800082a0 msgr2=0x7f4480008e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448cf02640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44800082a0 0x7f4480008e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448cf02640 1 -- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4480007ec0 msgr2=0x7f44800cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448cf02640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4480007ec0 0x7f44800cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448cf02640 1 -- 172.21.15.113:0/2498890215 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44800caf10 con 0x7f4480034e00 2024-04-22T06:32:09.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f9932ffd640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f991c003a80 0x7f991c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f9932ffd640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f991c004800 0x7f991c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f448cf02640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4480034e00 0x7f44800cc260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4488050f50 tx=0x7f448806cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f9933fff640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f991c003a80 0x7f991c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.500+0000 7f99337fe640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f991c004800 0x7f991c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.501+0000 7f9932ffd640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f991c0052e0 0x7f991c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.501+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f99341575a0 con 0x7f991c004800 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.501+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f991c00c1a0 con 0x7f991c0052e0 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.501+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f991c00c3a0 con 0x7f991c003a80 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.501+0000 7f9938c1e640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f991c0052e0 0x7f991c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.501+0000 7f9933fff640 1 -- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f991c0052e0 msgr2=0x7f991c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.501+0000 7f9933fff640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f991c0052e0 0x7f991c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.501+0000 7f9933fff640 1 -- 172.21.15.113:0/2254068494 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f991c004800 msgr2=0x7f991c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.503+0000 7f9933fff640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f991c004800 0x7f991c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.503+0000 7f9933fff640 1 -- 172.21.15.113:0/2254068494 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c003520 con 0x7f991c003a80 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.503+0000 7f99337fe640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f991c004800 0x7f991c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:09.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f447dffb640 1 -- 172.21.15.113:0/2498890215 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488091070 con 0x7f4480034e00 2024-04-22T06:32:09.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f9938c1e640 1 -- 172.21.15.113:0/2254068494 reap_dead start 2024-04-22T06:32:09.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f9933fff640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f991c003a80 0x7f991c003e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f992c009ed0 tx=0x7f991c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd921044aa8f24a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44800cb1b0 con 0x7f4480034e00 2024-04-22T06:32:09.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44800366d0 con 0x7f4480034e00 2024-04-22T06:32:09.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f447dffb640 1 -- 172.21.15.113:0/2498890215 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4488069d90 con 0x7f4480034e00 2024-04-22T06:32:09.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f447dffb640 1 -- 172.21.15.113:0/2498890215 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488074260 con 0x7f4480034e00 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.502+0000 7f544725c640 1 -- start start 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.503+0000 7f544725c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54400c8e10 0x7f544015e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.503+0000 7f544725c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f54400c8070 0x7f544015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.503+0000 7f544725c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544006c850 con 0x7f54401553a0 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.503+0000 7f544725c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f544006cb30 con 0x7f54400c8070 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.503+0000 7f544725c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f544006ce10 con 0x7f54400c8e10 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f5444ff8640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f54401553a0 0x7f54400c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:58232/0 (socket says 172.21.15.113:58232) 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f5444ff8640 1 -- 172.21.15.113:0/2389555367 learned_addr learned my addr 172.21.15.113:0/2389555367 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f54457f9640 1 --2- 172.21.15.113:0/2389555367 >> v2:172.21.15.145:3300/0 conn(0x7f54400c8070 0x7f544015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f54457f9640 1 -- 172.21.15.113:0/2389555367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54400c8e10 msgr2=0x7f544015e670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:09.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f54457f9640 1 --2- 172.21.15.113:0/2389555367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54400c8e10 0x7f544015e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f54457f9640 1 -- 172.21.15.113:0/2389555367 >> v1:172.21.15.145:6789/0 conn(0x7f54401553a0 legacy=0x7f54400c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f543f7fe640 1 -- 172.21.15.113:0/2389555367 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662090133 0 0) 0x7f544006c850 con 0x7f54401553a0 2024-04-22T06:32:09.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.504+0000 7f54457f9640 1 -- 172.21.15.113:0/2389555367 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544006d0f0 con 0x7f54400c8070 2024-04-22T06:32:09.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.505+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c00e040 con 0x7f991c003a80 2024-04-22T06:32:09.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.505+0000 7f9932ffd640 1 -- 172.21.15.113:0/2254068494 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992c035600 con 0x7f991c003a80 2024-04-22T06:32:09.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.506+0000 7f993941f640 1 -- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f991c003a80 msgr2=0x7f991c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.506+0000 7f993941f640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f991c003a80 0x7f991c003e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f992c009ed0 tx=0x7f991c005830 comp rx=0 tx=0).stop 2024-04-22T06:32:09.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.506+0000 7f993941f640 1 -- 172.21.15.113:0/2254068494 shutdown_connections 2024-04-22T06:32:09.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.506+0000 7f993941f640 1 --2- 172.21.15.113:0/2254068494 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f991c003a80 0x7f991c003e60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.506+0000 7f993941f640 1 -- 172.21.15.113:0/2254068494 >> 172.21.15.113:0/2254068494 conn(0x7f993406eb30 msgr2=0x7f993406ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.507+0000 7f993941f640 1 -- 172.21.15.113:0/2254068494 shutdown_connections 2024-04-22T06:32:09.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.508+0000 7f54457f9640 1 --2- 172.21.15.113:0/2389555367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 0x7f544015ebb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5438009d90 tx=0x7f543802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea8ae750e089d82 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.507+0000 7f447dffb640 1 -- 172.21.15.113:0/2498890215 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4488094070 con 0x7f4480034e00 2024-04-22T06:32:09.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.508+0000 7f447dffb640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f446c06c9c0 0x7f446c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.508+0000 7f448d703640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f446c06c9c0 0x7f446c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.509+0000 7f448d703640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f446c06c9c0 0x7f446c06ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4484007fd0 tx=0x7f4484007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.509+0000 7f447dffb640 1 -- 172.21.15.113:0/2498890215 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4488107eb0 con 0x7f4480034e00 2024-04-22T06:32:09.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4468005290 con 0x7f4480034e00 2024-04-22T06:32:09.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f543f7fe640 1 -- 172.21.15.113:0/2389555367 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438039070 con 0x7f54400c8070 2024-04-22T06:32:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f543f7fe640 1 -- 172.21.15.113:0/2389555367 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543802cd00 con 0x7f54400c8070 2024-04-22T06:32:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.507+0000 7f993941f640 1 -- 172.21.15.113:0/2254068494 wait complete. 2024-04-22T06:32:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.508+0000 7f993941f640 1 Processor -- start 2024-04-22T06:32:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.509+0000 7f993941f640 1 -- start start 2024-04-22T06:32:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f993941f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99340cb600 0x7f99341df100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f993941f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99340cb9e0 0x7f99341531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f993941f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99341dfae0 0x7f99341536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f993941f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f993406f7d0 con 0x7f99340cb600 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f993941f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f993406f650 con 0x7f99340cb9e0 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f993941f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f99340c7d00 con 0x7f99341dfae0 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f9933fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99340cb600 0x7f99341df100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f9933fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99340cb600 0x7f99341df100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40060/0 (socket says 172.21.15.113:40060) 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.510+0000 7f9933fff640 1 -- 172.21.15.113:0/744929395 learned_addr learned my addr 172.21.15.113:0/744929395 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f9933fff640 1 -- 172.21.15.113:0/744929395 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99341dfae0 msgr2=0x7f99341536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f9933fff640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99341dfae0 0x7f99341536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f9933fff640 1 -- 172.21.15.113:0/744929395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99340cb9e0 msgr2=0x7f99341531a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f9933fff640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99340cb9e0 0x7f99341531a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f9933fff640 1 -- 172.21.15.113:0/744929395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99341de490 con 0x7f99340cb600 2024-04-22T06:32:09.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f544725c640 1 -- 172.21.15.113:0/2389555367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 msgr2=0x7f544015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f544725c640 1 --2- 172.21.15.113:0/2389555367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 0x7f544015ebb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5438009d90 tx=0x7f543802bf50 comp rx=0 tx=0).stop 2024-04-22T06:32:09.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f544725c640 1 -- 172.21.15.113:0/2389555367 shutdown_connections 2024-04-22T06:32:09.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f544725c640 1 --2- 172.21.15.113:0/2389555367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 0x7f544015ebb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f544725c640 1 --2- 172.21.15.113:0/2389555367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54400c8e10 0x7f544015e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f544725c640 1 -- 172.21.15.113:0/2389555367 >> 172.21.15.113:0/2389555367 conn(0x7f5440073010 msgr2=0x7f5440073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f544725c640 1 -- 172.21.15.113:0/2389555367 shutdown_connections 2024-04-22T06:32:09.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f544725c640 1 -- 172.21.15.113:0/2389555367 wait complete. 2024-04-22T06:32:09.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.511+0000 7f9933fff640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99340cb600 0x7f99341df100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f992c02ebb0 tx=0x7f992c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.512+0000 7f9930ff9640 1 -- 172.21.15.113:0/744929395 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c042020 con 0x7f99340cb600 2024-04-22T06:32:09.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.512+0000 7f9930ff9640 1 -- 172.21.15.113:0/744929395 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992c034950 con 0x7f99340cb600 2024-04-22T06:32:09.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.512+0000 7f9930ff9640 1 -- 172.21.15.113:0/744929395 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c034d00 con 0x7f99340cb600 2024-04-22T06:32:09.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.514+0000 7f544725c640 1 Processor -- start 2024-04-22T06:32:09.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.512+0000 7f993941f640 1 -- 172.21.15.113:0/744929395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99340ccfa0 con 0x7f99340cb600 2024-04-22T06:32:09.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.515+0000 7f544725c640 1 -- start start 2024-04-22T06:32:09.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.512+0000 7f993941f640 1 -- 172.21.15.113:0/744929395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99341529a0 con 0x7f99340cb600 2024-04-22T06:32:09.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.514+0000 7f9930ff9640 1 -- 172.21.15.113:0/744929395 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f992c045020 con 0x7f99340cb600 2024-04-22T06:32:09.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.516+0000 7f544725c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 0x7f54400cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.516+0000 7f544725c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54400c8e10 0x7f54400cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.516+0000 7f544725c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54401553a0 0x7f54400cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.516+0000 7f544725c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f544015bb80 con 0x7f54400c8e10 2024-04-22T06:32:09.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.516+0000 7f544725c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5440155780 con 0x7f54400c8070 2024-04-22T06:32:09.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.516+0000 7f544725c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f544015bd00 con 0x7f54401553a0 2024-04-22T06:32:09.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.515+0000 7f447dffb640 1 -- 172.21.15.113:0/2498890215 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f44880d58a0 con 0x7f4480034e00 2024-04-22T06:32:09.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.517+0000 7f5444ff8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 0x7f54400cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.517+0000 7f543ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54400c8e10 0x7f54400cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.517+0000 7f543ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54400c8e10 0x7f54400cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40074/0 (socket says 172.21.15.113:40074) 2024-04-22T06:32:09.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.517+0000 7f543ffff640 1 -- 172.21.15.113:0/1397638275 learned_addr learned my addr 172.21.15.113:0/1397638275 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:09.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.517+0000 7f54457f9640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54401553a0 0x7f54400cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.518+0000 7f54457f9640 1 -- 172.21.15.113:0/1397638275 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 msgr2=0x7f54400cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.518+0000 7f54457f9640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 0x7f54400cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.518+0000 7f54457f9640 1 -- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54400c8e10 msgr2=0x7f54400cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.518+0000 7f54457f9640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54400c8e10 0x7f54400cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.518+0000 7f54457f9640 1 -- 172.21.15.113:0/1397638275 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54401f4a90 con 0x7f54401553a0 2024-04-22T06:32:09.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.518+0000 7f543ffff640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54400c8e10 0x7f54400cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:09.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.518+0000 7f54457f9640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54401553a0 0x7f54400cbdf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5438033000 tx=0x7f5438004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.519+0000 7f991a7fc640 1 -- 172.21.15.113:0/744929395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9914005290 con 0x7f99340cb600 2024-04-22T06:32:09.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.519+0000 7f9930ff9640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f992006c9f0 0x7f992006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.519+0000 7f99337fe640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f992006c9f0 0x7f992006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.519+0000 7f9930ff9640 1 -- 172.21.15.113:0/744929395 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f992c0aee80 con 0x7f99340cb600 2024-04-22T06:32:09.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.520+0000 7f99337fe640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f992006c9f0 0x7f992006eeb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9934154920 tx=0x7f9928001870 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.520+0000 7f543d7fa640 1 -- 172.21.15.113:0/1397638275 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438044020 con 0x7f54401553a0 2024-04-22T06:32:09.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.520+0000 7f543d7fa640 1 -- 172.21.15.113:0/1397638275 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543803f730 con 0x7f54401553a0 2024-04-22T06:32:09.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.520+0000 7f543d7fa640 1 -- 172.21.15.113:0/1397638275 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438039040 con 0x7f54401553a0 2024-04-22T06:32:09.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.522+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54401f4d50 con 0x7f54401553a0 2024-04-22T06:32:09.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.522+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401f5310 con 0x7f54401553a0 2024-04-22T06:32:09.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.529+0000 7f9930ff9640 1 -- 172.21.15.113:0/744929395 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f992c0b2030 con 0x7f99340cb600 2024-04-22T06:32:09.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.529+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5440068e40 con 0x7f54401553a0 2024-04-22T06:32:09.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.531+0000 7f543d7fa640 1 -- 172.21.15.113:0/1397638275 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5438005d10 con 0x7f54401553a0 2024-04-22T06:32:09.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.531+0000 7f543d7fa640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f542406c940 0x7f542406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:09.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.531+0000 7f543d7fa640 1 -- 172.21.15.113:0/1397638275 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f54380ae720 con 0x7f54401553a0 2024-04-22T06:32:09.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.532+0000 7f5444ff8640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f542406c940 0x7f542406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:09.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.532+0000 7f5444ff8640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f542406c940 0x7f542406ee00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5434007f70 tx=0x7f5434007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:09.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.536+0000 7f543d7fa640 1 -- 172.21.15.113:0/1397638275 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f543804e070 con 0x7f54401553a0 2024-04-22T06:32:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.779+0000 7ff965ffb640 1 -- 172.21.15.113:0/1688587912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff960005850 con 0x7ff980157950 2024-04-22T06:32:09.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.780+0000 7ff967fff640 1 -- 172.21.15.113:0/1688587912 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff97805cc80 con 0x7ff980157950 2024-04-22T06:32:09.795 INFO:teuthology.orchestra.run.smithi113.stdout:55834574859 2024-04-22T06:32:09.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.800+0000 7ff965ffb640 1 -- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff96c06c9f0 msgr2=0x7ff96c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.800+0000 7ff965ffb640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff96c06c9f0 0x7ff96c06eeb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff970006fd0 tx=0x7ff970008040 comp rx=0 tx=0).stop 2024-04-22T06:32:09.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.800+0000 7ff965ffb640 1 -- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff980157950 msgr2=0x7ff9801efe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.800+0000 7ff965ffb640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff980157950 0x7ff9801efe60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff9680039b0 tx=0x7ff97800ccd0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.801+0000 7ff965ffb640 1 -- 172.21.15.113:0/1688587912 shutdown_connections 2024-04-22T06:32:09.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.801+0000 7ff965ffb640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff96c06c9f0 0x7ff96c06eeb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.801+0000 7ff965ffb640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff980157950 0x7ff9801efe60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.801+0000 7ff965ffb640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff980073ee0 0x7ff980154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.801+0000 7ff965ffb640 1 --2- 172.21.15.113:0/1688587912 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff980157570 0x7ff980153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.801+0000 7ff965ffb640 1 -- 172.21.15.113:0/1688587912 >> 172.21.15.113:0/1688587912 conn(0x7ff98006d610 msgr2=0x7ff9800c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.801+0000 7ff965ffb640 1 -- 172.21.15.113:0/1688587912 shutdown_connections 2024-04-22T06:32:09.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.801+0000 7ff965ffb640 1 -- 172.21.15.113:0/1688587912 wait complete. 2024-04-22T06:32:09.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.2 2024-04-22T06:32:09.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.861+0000 7f932e2c1640 1 -- 172.21.15.113:0/3425956523 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9308005850 con 0x7f93280c3450 2024-04-22T06:32:09.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.862+0000 7f9324ff9640 1 -- 172.21.15.113:0/3425956523 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93180593c0 con 0x7f93280c3450 2024-04-22T06:32:09.860 INFO:teuthology.orchestra.run.smithi113.stdout:55834574859 2024-04-22T06:32:09.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.865+0000 7f930e7fc640 1 -- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f931406c9c0 msgr2=0x7f931406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.865+0000 7f930e7fc640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f931406c9c0 0x7f931406ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f931c00a790 tx=0x7f931c008040 comp rx=0 tx=0).stop 2024-04-22T06:32:09.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.865+0000 7f930e7fc640 1 -- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 msgr2=0x7f932814ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.865+0000 7f930e7fc640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f932814ecc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f931800ca70 tx=0x7f931800cf30 comp rx=0 tx=0).stop 2024-04-22T06:32:09.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.865+0000 7f930e7fc640 1 -- 172.21.15.113:0/3425956523 shutdown_connections 2024-04-22T06:32:09.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.865+0000 7f930e7fc640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9328151980 0x7f932814c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.866+0000 7f930e7fc640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f931406c9c0 0x7f931406ee80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.866+0000 7f930e7fc640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93280c3450 0x7f932814ecc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.866+0000 7f930e7fc640 1 --2- 172.21.15.113:0/3425956523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93280c21d0 0x7f932814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.866+0000 7f930e7fc640 1 -- 172.21.15.113:0/3425956523 >> 172.21.15.113:0/3425956523 conn(0x7f932806f2f0 msgr2=0x7f932806f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.866+0000 7f930e7fc640 1 -- 172.21.15.113:0/3425956523 shutdown_connections 2024-04-22T06:32:09.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.866+0000 7f930e7fc640 1 -- 172.21.15.113:0/3425956523 wait complete. 2024-04-22T06:32:09.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.878+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9d20005580 con 0x7f9d400cc3f0 2024-04-22T06:32:09.877 INFO:teuthology.orchestra.run.smithi113.stdout:55834574857 2024-04-22T06:32:09.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.879+0000 7f9d277fe640 1 -- 172.21.15.113:0/964071119 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d3001f020 con 0x7f9d400cc3f0 2024-04-22T06:32:09.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.881+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3b64005580 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d2c06c9c0 msgr2=0x7f9d2c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d2c06c9c0 0x7f9d2c06ee80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d40147a90 tx=0x7f9d34005e90 comp rx=0 tx=0).stop 2024-04-22T06:32:09.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc3f0 msgr2=0x7f9d401ed660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc3f0 0x7f9d401ed660 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000b410 tx=0x7f9d3000b8d0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 shutdown_connections 2024-04-22T06:32:09.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f3b727fc640 1 -- 172.21.15.113:0/1527596205 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b78059cd0 con 0x7f3b7c0c56c0 2024-04-22T06:32:09.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d2c06c9c0 0x7f9d2c06ee80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d40151370 0x7f9d40071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d400cc860 0x7f9d400c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 --2- 172.21.15.113:0/964071119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d400cc3f0 0x7f9d401ed660 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 >> 172.21.15.113:0/964071119 conn(0x7f9d4006d610 msgr2=0x7f9d4014ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.882 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:09.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.882+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 shutdown_connections 2024-04-22T06:32:09.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.883+0000 7f9d45425640 1 -- 172.21.15.113:0/964071119 wait complete. 2024-04-22T06:32:09.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3b6006c950 msgr2=0x7f3b6006ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3b6006c950 0x7f3b6006ee10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b74035000 tx=0x7f3b74030000 comp rx=0 tx=0).stop 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0c56c0 msgr2=0x7f3b7c1557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0c56c0 0x7f3b7c1557a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800c780 tx=0x7f3b7800cc40 comp rx=0 tx=0).stop 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 shutdown_connections 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b7c155150 0x7f3b7c14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b7c0cc7c0 0x7f3b7c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3b6006c950 0x7f3b6006ee10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 --2- 172.21.15.113:0/1527596205 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b7c0c56c0 0x7f3b7c1557a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.885+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 >> 172.21.15.113:0/1527596205 conn(0x7f3b7c074d50 msgr2=0x7f3b7c0ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.886+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 shutdown_connections 2024-04-22T06:32:09.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.886+0000 7f3b82baf640 1 -- 172.21.15.113:0/1527596205 wait complete. 2024-04-22T06:32:09.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-22T06:32:09.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-04-22T06:32:09.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.916+0000 7f991a7fc640 1 -- 172.21.15.113:0/744929395 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9914005580 con 0x7f99340cb600 2024-04-22T06:32:09.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.916+0000 7f9930ff9640 1 -- 172.21.15.113:0/744929395 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f992c081e20 con 0x7f99340cb600 2024-04-22T06:32:09.914 INFO:teuthology.orchestra.run.smithi113.stdout:55834574857 2024-04-22T06:32:09.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 -- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f992006c9f0 msgr2=0x7f992006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f992006c9f0 0x7f992006eeb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9934154920 tx=0x7f9928001870 comp rx=0 tx=0).stop 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 -- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99340cb600 msgr2=0x7f99341df100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99340cb600 0x7f99341df100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f992c02ebb0 tx=0x7f992c004ab0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 -- 172.21.15.113:0/744929395 shutdown_connections 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f99341dfae0 0x7f99341536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99340cb9e0 0x7f99341531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f992006c9f0 0x7f992006eeb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 --2- 172.21.15.113:0/744929395 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99340cb600 0x7f99341df100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 -- 172.21.15.113:0/744929395 >> 172.21.15.113:0/744929395 conn(0x7f993406eb30 msgr2=0x7f99340c5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 -- 172.21.15.113:0/744929395 shutdown_connections 2024-04-22T06:32:09.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.919+0000 7f991a7fc640 1 -- 172.21.15.113:0/744929395 wait complete. 2024-04-22T06:32:09.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.920+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4468005580 con 0x7f4480034e00 2024-04-22T06:32:09.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.920+0000 7f447dffb640 1 -- 172.21.15.113:0/2498890215 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44880d9ba0 con 0x7f4480034e00 2024-04-22T06:32:09.919 INFO:teuthology.orchestra.run.smithi113.stdout:55834574857 2024-04-22T06:32:09.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.922+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f38d41585e0 con 0x7f38d4072b30 2024-04-22T06:32:09.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.922+0000 7f38d17fa640 1 -- 172.21.15.113:0/3430299854 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38cc05d950 con 0x7f38d4072b30 2024-04-22T06:32:09.921 INFO:teuthology.orchestra.run.smithi113.stdout:55834574857 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f446c06c9c0 msgr2=0x7f446c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f446c06c9c0 0x7f446c06ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4484007fd0 tx=0x7f4484007e80 comp rx=0 tx=0).stop 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4480034e00 msgr2=0x7f44800cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4480034e00 0x7f44800cc260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4488050f50 tx=0x7f448806cd00 comp rx=0 tx=0).stop 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 shutdown_connections 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44800082a0 0x7f4480008e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4480034e00 0x7f44800cc260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f446c06c9c0 0x7f446c06ee80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 --2- 172.21.15.113:0/2498890215 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4480007ec0 0x7f44800cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 >> 172.21.15.113:0/2498890215 conn(0x7f448004ee60 msgr2=0x7f44800cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 shutdown_connections 2024-04-22T06:32:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.923+0000 7f448f967640 1 -- 172.21.15.113:0/2498890215 wait complete. 2024-04-22T06:32:09.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f38c006c9c0 msgr2=0x7f38c006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f38c006c9c0 0x7f38c006ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f38c8036000 tx=0x7f38c8008030 comp rx=0 tx=0).stop 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d4072b30 msgr2=0x7f38d420e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d4072b30 0x7f38d420e840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00bd60 tx=0x7f38cc009ef0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 shutdown_connections 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38d40ca400 0x7f38d415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38d40ca020 0x7f38d40c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f38c006c9c0 0x7f38c006ee80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 --2- 172.21.15.113:0/3430299854 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38d4072b30 0x7f38d420e840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 >> 172.21.15.113:0/3430299854 conn(0x7f38d406b920 msgr2=0x7f38d41567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 shutdown_connections 2024-04-22T06:32:09.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:09.926+0000 7f38d9a70640 1 -- 172.21.15.113:0/3430299854 wait complete. 2024-04-22T06:32:09.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-04-22T06:32:09.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-04-22T06:32:09.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-04-22T06:32:10.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.005+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f54400c8830 con 0x7f54401553a0 2024-04-22T06:32:10.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.006+0000 7f543d7fa640 1 -- 172.21.15.113:0/1397638275 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f543807c2a0 con 0x7f54401553a0 2024-04-22T06:32:10.004 INFO:teuthology.orchestra.run.smithi113.stdout:55834574860 2024-04-22T06:32:10.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f542406c940 msgr2=0x7f542406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:10.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f542406c940 0x7f542406ee00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5434007f70 tx=0x7f5434007f00 comp rx=0 tx=0).stop 2024-04-22T06:32:10.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54401553a0 msgr2=0x7f54400cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54401553a0 0x7f54400cbdf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5438033000 tx=0x7f5438004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 shutdown_connections 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f54401553a0 0x7f54400cbdf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f542406c940 0x7f542406ee00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54400c8e10 0x7f54400cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 --2- 172.21.15.113:0/1397638275 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54400c8070 0x7f54400cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 >> 172.21.15.113:0/1397638275 conn(0x7f5440073010 msgr2=0x7f5440159630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 shutdown_connections 2024-04-22T06:32:10.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.008+0000 7f544725c640 1 -- 172.21.15.113:0/1397638275 wait complete. 2024-04-22T06:32:10.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2024-04-22T06:32:10.017 DEBUG:teuthology.parallel:result is None 2024-04-22T06:32:10.829 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T06:32:10.884 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T06:32:10.899 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T06:32:10.901 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T06:32:10.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.931+0000 7fe02eb52640 1 Processor -- start 2024-04-22T06:32:10.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.931+0000 7fe02eb52640 1 -- start start 2024-04-22T06:32:10.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe02eb52640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe028153150 0x7fe02806f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe02eb52640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe02815cdb0 0x7fe0280c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe02eb52640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe028075c50 con 0x7fe028075830 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe02eb52640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fe0280caef0 con 0x7fe028153150 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe02eb52640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fe0280753a0 con 0x7fe02815cdb0 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe027fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe028075830 0x7fe0280c6b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37044/0 (socket says 172.21.15.113:37044) 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe02c8ee640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe028153150 0x7fe02806f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe027fff640 1 -- 172.21.15.113:0/2476827009 learned_addr learned my addr 172.21.15.113:0/2476827009 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.932+0000 7fe02d0ef640 1 --2- 172.21.15.113:0/2476827009 >> v2:172.21.15.145:3300/0 conn(0x7fe02815cdb0 0x7fe0280c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.933+0000 7fe0277fe640 1 -- 172.21.15.113:0/2476827009 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2727469864 0 0) 0x7fe028075c50 con 0x7fe028075830 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.933+0000 7fe0277fe640 1 -- 172.21.15.113:0/2476827009 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe018003520 con 0x7fe028075830 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.933+0000 7fe02d0ef640 1 -- 172.21.15.113:0/2476827009 >> v2:172.21.15.113:3300/0 conn(0x7fe028153150 msgr2=0x7fe02806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:10.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.933+0000 7fe02d0ef640 1 --2- 172.21.15.113:0/2476827009 >> v2:172.21.15.113:3300/0 conn(0x7fe028153150 0x7fe02806f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.933+0000 7fe02d0ef640 1 -- 172.21.15.113:0/2476827009 >> v1:172.21.15.113:6789/0 conn(0x7fe028075830 legacy=0x7fe0280c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:10.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.933+0000 7fe02d0ef640 1 -- 172.21.15.113:0/2476827009 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0280c73f0 con 0x7fe02815cdb0 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.934+0000 7fe02d0ef640 1 --2- 172.21.15.113:0/2476827009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe02815cdb0 0x7fe0280c4ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe02806ef90 tx=0x7fe02002bd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec58c0ccbc54252e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.934+0000 7fe0277fe640 1 -- 172.21.15.113:0/2476827009 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020039070 con 0x7fe02815cdb0 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.934+0000 7fe0277fe640 1 -- 172.21.15.113:0/2476827009 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02002c870 con 0x7fe02815cdb0 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.934+0000 7fe0277fe640 1 -- 172.21.15.113:0/2476827009 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014001670 con 0x7fe02815cdb0 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.935+0000 7fe02eb52640 1 -- 172.21.15.113:0/2476827009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe02815cdb0 msgr2=0x7fe0280c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.935+0000 7fe02eb52640 1 --2- 172.21.15.113:0/2476827009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe02815cdb0 0x7fe0280c4ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe02806ef90 tx=0x7fe02002bd40 comp rx=0 tx=0).stop 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.935+0000 7fe02eb52640 1 -- 172.21.15.113:0/2476827009 shutdown_connections 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.935+0000 7fe02eb52640 1 --2- 172.21.15.113:0/2476827009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe02815cdb0 0x7fe0280c4ad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.935+0000 7fe02eb52640 1 --2- 172.21.15.113:0/2476827009 >> v2:172.21.15.113:3300/0 conn(0x7fe028153150 0x7fe02806f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.935+0000 7fe02eb52640 1 -- 172.21.15.113:0/2476827009 >> 172.21.15.113:0/2476827009 conn(0x7fe0280ca0d0 msgr2=0x7fe0280ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:10.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.935+0000 7fe02eb52640 1 -- 172.21.15.113:0/2476827009 shutdown_connections 2024-04-22T06:32:10.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.935+0000 7fe02eb52640 1 -- 172.21.15.113:0/2476827009 wait complete. 2024-04-22T06:32:10.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.937+0000 7fe02eb52640 1 Processor -- start 2024-04-22T06:32:10.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.937+0000 7fe02eb52640 1 -- start start 2024-04-22T06:32:10.935 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T06:32:10.936 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T06:32:10.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.938+0000 7fe02eb52640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe028075830 0x7fe0281513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:10.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.938+0000 7fe02eb52640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe028153150 0x7fe028155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:10.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.938+0000 7fe02eb52640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe02815cdb0 0x7fe02814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:10.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.938+0000 7fe02eb52640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe028074d50 con 0x7fe02815cdb0 2024-04-22T06:32:10.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.938+0000 7fe02eb52640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe0280c79b0 con 0x7fe028153150 2024-04-22T06:32:10.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.938+0000 7fe02eb52640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe028075030 con 0x7fe028075830 2024-04-22T06:32:10.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe02d0ef640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe02815cdb0 0x7fe02814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:10.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe02d0ef640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe02815cdb0 0x7fe02814bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40092/0 (socket says 172.21.15.113:40092) 2024-04-22T06:32:10.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe027fff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe028153150 0x7fe028155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:10.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe02d0ef640 1 -- 172.21.15.113:0/1386404329 learned_addr learned my addr 172.21.15.113:0/1386404329 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe02c8ee640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe028075830 0x7fe0281513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe027fff640 1 -- 172.21.15.113:0/1386404329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe028075830 msgr2=0x7fe0281513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe027fff640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe028075830 0x7fe0281513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe027fff640 1 -- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe02815cdb0 msgr2=0x7fe02814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe027fff640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe02815cdb0 0x7fe02814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.939+0000 7fe027fff640 1 -- 172.21.15.113:0/1386404329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe028153c60 con 0x7fe028153150 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.940+0000 7fe02d0ef640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe02815cdb0 0x7fe02814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.940+0000 7fe027fff640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe028153150 0x7fe028155a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0140011e0 tx=0x7fe01400cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.940+0000 7fe0257fa640 1 -- 172.21.15.113:0/1386404329 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140074e0 con 0x7fe028153150 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.940+0000 7fe0257fa640 1 -- 172.21.15.113:0/1386404329 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe014015030 con 0x7fe028153150 2024-04-22T06:32:10.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.940+0000 7fe0257fa640 1 -- 172.21.15.113:0/1386404329 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014004a20 con 0x7fe028153150 2024-04-22T06:32:10.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.940+0000 7fe02eb52640 1 -- 172.21.15.113:0/1386404329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02814e4f0 con 0x7fe028153150 2024-04-22T06:32:10.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.940+0000 7fe02eb52640 1 -- 172.21.15.113:0/1386404329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe028154f40 con 0x7fe028153150 2024-04-22T06:32:10.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.942+0000 7fe02eb52640 1 -- 172.21.15.113:0/1386404329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02814ea10 con 0x7fe028153150 2024-04-22T06:32:10.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.942+0000 7fe0257fa640 1 -- 172.21.15.113:0/1386404329 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe014004bc0 con 0x7fe028153150 2024-04-22T06:32:10.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.943+0000 7fe0257fa640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe00c06c8f0 0x7fe00c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:10.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.943+0000 7fe02c8ee640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe00c06c8f0 0x7fe00c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:10.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.943+0000 7fe0257fa640 1 -- 172.21.15.113:0/1386404329 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe01408b530 con 0x7fe028153150 2024-04-22T06:32:10.942 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T06:32:10.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.944+0000 7fe02c8ee640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe00c06c8f0 0x7fe00c06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009b40 tx=0x7fe01c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:10.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:10.947+0000 7fe0257fa640 1 -- 172.21.15.113:0/1386404329 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe02814ea10 con 0x7fe028153150 2024-04-22T06:32:11.027 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.029+0000 7f4d071c4640 1 Processor -- start 2024-04-22T06:32:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.029+0000 7f4d071c4640 1 -- start start 2024-04-22T06:32:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.030+0000 7f4d071c4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d00151440 0x7f4d000c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.030+0000 7f4d071c4640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4d000c7750 0x7f4d0015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.030+0000 7f4d071c4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d00156fe0 con 0x7f4d000c9220 2024-04-22T06:32:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.030+0000 7f4d071c4640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f4d001572c0 con 0x7f4d000c7750 2024-04-22T06:32:11.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.030+0000 7f4d071c4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4d001575a0 con 0x7f4d00151440 2024-04-22T06:32:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.031+0000 7f4d059c1640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4d000c7750 0x7f4d0015ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.031+0000 7f4d069c3640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f4d000c9220 0x7f4d000c3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:58244/0 (socket says 172.21.15.113:58244) 2024-04-22T06:32:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.031+0000 7f4d069c3640 1 -- 172.21.15.113:0/1059994176 learned_addr learned my addr 172.21.15.113:0/1059994176 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:11.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.031+0000 7f4d061c2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d00151440 0x7f4d000c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.032+0000 7f4d061c2640 1 -- 172.21.15.113:0/1059994176 >> v2:172.21.15.145:3300/0 conn(0x7f4d000c7750 msgr2=0x7f4d0015ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.032+0000 7f4d061c2640 1 --2- 172.21.15.113:0/1059994176 >> v2:172.21.15.145:3300/0 conn(0x7f4d000c7750 0x7f4d0015ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.032+0000 7f4d061c2640 1 -- 172.21.15.113:0/1059994176 >> v1:172.21.15.145:6789/0 conn(0x7f4d000c9220 legacy=0x7f4d000c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.032+0000 7f4d061c2640 1 -- 172.21.15.113:0/1059994176 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d00157880 con 0x7f4d00151440 2024-04-22T06:32:11.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.033+0000 7f4d061c2640 1 --2- 172.21.15.113:0/1059994176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d00151440 0x7f4d000c7d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40087a0 tx=0x7f4cf402ddb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc1b0064d1052e0c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.034+0000 7f4d051c0640 1 -- 172.21.15.113:0/1059994176 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4034070 con 0x7f4d00151440 2024-04-22T06:32:11.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.034+0000 7f4d051c0640 1 -- 172.21.15.113:0/1059994176 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf402eae0 con 0x7f4d00151440 2024-04-22T06:32:11.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.035+0000 7f4d071c4640 1 -- 172.21.15.113:0/1059994176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d00151440 msgr2=0x7f4d000c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.035+0000 7f4d071c4640 1 --2- 172.21.15.113:0/1059994176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d00151440 0x7f4d000c7d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40087a0 tx=0x7f4cf402ddb0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.035+0000 7f4d071c4640 1 -- 172.21.15.113:0/1059994176 shutdown_connections 2024-04-22T06:32:11.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.035+0000 7f4d071c4640 1 --2- 172.21.15.113:0/1059994176 >> v2:172.21.15.145:3300/0 conn(0x7f4d000c7750 0x7f4d0015ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.035+0000 7f4d071c4640 1 --2- 172.21.15.113:0/1059994176 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d00151440 0x7f4d000c7d00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.035+0000 7f4d071c4640 1 -- 172.21.15.113:0/1059994176 >> 172.21.15.113:0/1059994176 conn(0x7f4d0006eb30 msgr2=0x7f4d0006ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.036+0000 7f4d071c4640 1 -- 172.21.15.113:0/1059994176 shutdown_connections 2024-04-22T06:32:11.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.036+0000 7f4d071c4640 1 -- 172.21.15.113:0/1059994176 wait complete. 2024-04-22T06:32:11.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.038+0000 7f4d071c4640 1 Processor -- start 2024-04-22T06:32:11.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.038+0000 7f4d071c4640 1 -- start start 2024-04-22T06:32:11.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.039+0000 7f4d071c4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d000c7750 0x7f4d001431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.039+0000 7f4d071c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d000c9220 0x7f4d001e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.039+0000 7f4d071c4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d000ca200 0x7f4d001e1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.039+0000 7f4d071c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0006f7d0 con 0x7f4d000c9220 2024-04-22T06:32:11.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.039+0000 7f4d071c4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0006f650 con 0x7f4d000ca200 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.039+0000 7f4d071c4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4d000c4520 con 0x7f4d000c7750 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.039+0000 7f4d069c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d000ca200 0x7f4d001e1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.039+0000 7f4d069c3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d000ca200 0x7f4d001e1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:34480/0 (socket says 172.21.15.113:34480) 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.040+0000 7f4d069c3640 1 -- 172.21.15.113:0/2894178369 learned_addr learned my addr 172.21.15.113:0/2894178369 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.040+0000 7f4d069c3640 1 -- 172.21.15.113:0/2894178369 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d000c7750 msgr2=0x7f4d001431d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.040+0000 7f4d069c3640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d000c7750 0x7f4d001431d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.040+0000 7f4d069c3640 1 -- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d000c9220 msgr2=0x7f4d001e1760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.040+0000 7f4d069c3640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d000c9220 0x7f4d001e1760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.040+0000 7f4d069c3640 1 -- 172.21.15.113:0/2894178369 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d001e1140 con 0x7f4d000ca200 2024-04-22T06:32:11.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.041+0000 7f4d069c3640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d000ca200 0x7f4d001e1ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800c7b0 tx=0x7f4cf800cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.041+0000 7f4cfeffd640 1 -- 172.21.15.113:0/2894178369 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8018070 con 0x7f4d000ca200 2024-04-22T06:32:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.041+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d00155b70 con 0x7f4d000ca200 2024-04-22T06:32:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.041+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d00156600 con 0x7f4d000ca200 2024-04-22T06:32:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.043+0000 7f4cfeffd640 1 -- 172.21.15.113:0/2894178369 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf80072d0 con 0x7f4d000ca200 2024-04-22T06:32:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.044+0000 7f4cfeffd640 1 -- 172.21.15.113:0/2894178369 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80047e0 con 0x7f4d000ca200 2024-04-22T06:32:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.044+0000 7f4cfeffd640 1 -- 172.21.15.113:0/2894178369 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4cf801b070 con 0x7f4d000ca200 2024-04-22T06:32:11.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.045+0000 7f4cfeffd640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4cec06ca20 0x7f4cec06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.045+0000 7f4d061c2640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4cec06ca20 0x7f4cec06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.045+0000 7f4cfeffd640 1 -- 172.21.15.113:0/2894178369 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4cf808b320 con 0x7f4d000ca200 2024-04-22T06:32:11.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.046+0000 7f4d061c2640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4cec06ca20 0x7f4cec06eee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4039000 tx=0x7f4cf4034000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.046+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d00068cc0 con 0x7f4d000ca200 2024-04-22T06:32:11.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.052+0000 7f4cfeffd640 1 -- 172.21.15.113:0/2894178369 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d001e1140 con 0x7f4d000ca200 2024-04-22T06:32:11.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.091+0000 7f30b5499640 1 Processor -- start 2024-04-22T06:32:11.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.091+0000 7f30b5499640 1 -- start start 2024-04-22T06:32:11.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.092+0000 7f30b5499640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f30b0159730 0x7f30b00ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30b5499640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30b00cadc0 0x7f30b0162e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30b5499640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b01633a0 0x7f30b00cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30b5499640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f30b015f680 con 0x7f30b00cadc0 2024-04-22T06:32:11.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30b5499640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f30b015f920 con 0x7f30b0159730 2024-04-22T06:32:11.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30b5499640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f30b015fc00 con 0x7f30b01633a0 2024-04-22T06:32:11.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30ae7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30b00cadc0 0x7f30b0162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b01633a0 0x7f30b00cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30ae7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30b00cadc0 0x7f30b0162e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40094/0 (socket says 172.21.15.113:40094) 2024-04-22T06:32:11.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.093+0000 7f30ae7fc640 1 -- 172.21.15.113:0/721401072 learned_addr learned my addr 172.21.15.113:0/721401072 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.094+0000 7f30ae7fc640 1 -- 172.21.15.113:0/721401072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b01633a0 msgr2=0x7f30b00cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.094+0000 7f30ae7fc640 1 --2- 172.21.15.113:0/721401072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b01633a0 0x7f30b00cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.094+0000 7f30ae7fc640 1 -- 172.21.15.113:0/721401072 >> v2:172.21.15.145:3300/0 conn(0x7f30b0159730 msgr2=0x7f30b00ca880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:32:11.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.094+0000 7f30ae7fc640 1 --2- 172.21.15.113:0/721401072 >> v2:172.21.15.145:3300/0 conn(0x7f30b0159730 0x7f30b00ca880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.094+0000 7f30ae7fc640 1 -- 172.21.15.113:0/721401072 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b015fee0 con 0x7f30b00cadc0 2024-04-22T06:32:11.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.096+0000 7f30ae7fc640 1 --2- 172.21.15.113:0/721401072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 0x7f30b0162e60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f30b00758d0 tx=0x7f30a002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8088d5bdacf010aa server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.096+0000 7f30adffb640 1 -- 172.21.15.113:0/721401072 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0034070 con 0x7f30b00cadc0 2024-04-22T06:32:11.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.096+0000 7f30adffb640 1 -- 172.21.15.113:0/721401072 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0030800 con 0x7f30b00cadc0 2024-04-22T06:32:11.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f30b5499640 1 -- 172.21.15.113:0/721401072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 msgr2=0x7f30b0162e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f30b5499640 1 --2- 172.21.15.113:0/721401072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 0x7f30b0162e60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f30b00758d0 tx=0x7f30a002b940 comp rx=0 tx=0).stop 2024-04-22T06:32:11.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.095+0000 7f1737c11640 1 Processor -- start 2024-04-22T06:32:11.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.096+0000 7f1737c11640 1 -- start start 2024-04-22T06:32:11.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f1737c11640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f17301621e0 0x7f17300c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f1737c11640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17300c3e40 0x7f17300c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f1737c11640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17300c9bb0 con 0x7f17300c93d0 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f1737c11640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f17301689d0 con 0x7f17301621e0 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f1737c11640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f17300cce00 con 0x7f17300c3e40 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f17361ae640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f17300c93d0 0x7f1730167e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37060/0 (socket says 172.21.15.113:37060) 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f17361ae640 1 -- 172.21.15.113:0/3637405527 learned_addr learned my addr 172.21.15.113:0/3637405527 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.097+0000 7f17351ac640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17300c3e40 0x7f17300c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77296595 0 0) 0x7f17300c9bb0 con 0x7f17300c93d0 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f17359ad640 1 --2- 172.21.15.113:0/3637405527 >> v2:172.21.15.145:3300/0 conn(0x7f17301621e0 0x7f17300c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f171c003440 con 0x7f17300c93d0 2024-04-22T06:32:11.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f30b5499640 1 -- 172.21.15.113:0/721401072 shutdown_connections 2024-04-22T06:32:11.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f30b5499640 1 --2- 172.21.15.113:0/721401072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b01633a0 0x7f30b00cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f30b5499640 1 --2- 172.21.15.113:0/721401072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 0x7f30b0162e60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f30b5499640 1 --2- 172.21.15.113:0/721401072 >> v2:172.21.15.145:3300/0 conn(0x7f30b0159730 0x7f30b00ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f30b5499640 1 -- 172.21.15.113:0/721401072 >> 172.21.15.113:0/721401072 conn(0x7f30b006d610 msgr2=0x7f30b0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.098+0000 7f30b5499640 1 -- 172.21.15.113:0/721401072 shutdown_connections 2024-04-22T06:32:11.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3102184109 0 0) 0x7f171c003440 con 0x7f17300c93d0 2024-04-22T06:32:11.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17300c3e40 msgr2=0x7f17300c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17300c3e40 0x7f17300c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 >> v2:172.21.15.145:3300/0 conn(0x7f17301621e0 msgr2=0x7f17300c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 --2- 172.21.15.113:0/3637405527 >> v2:172.21.15.145:3300/0 conn(0x7f17301621e0 0x7f17300c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17301625c0 con 0x7f17300c93d0 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f17280019f0 con 0x7f17300c93d0 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 >> v1:172.21.15.113:6789/0 conn(0x7f17300c93d0 legacy=0x7f1730167e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f171c004ab0 0x7f171c004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f171c0036c0 0x7f171c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0040d0 0x7f171c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f17301689d0 con 0x7f171c0036c0 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f17300cce00 con 0x7f171c0040d0 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f171c00bf10 con 0x7f171c004ab0 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17361ae640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0040d0 0x7f171c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f17359ad640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f171c004ab0 0x7f171c004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.100+0000 7f17351ac640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f171c0036c0 0x7f171c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.100+0000 7f7131bd0640 1 Processor -- start 2024-04-22T06:32:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.100+0000 7f7131bd0640 1 -- start start 2024-04-22T06:32:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.101+0000 7f7131bd0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71240d9240 0x7f7124039e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f7131bd0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f71240e0480 0x7f712404ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f7131bd0640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712403a4a0 con 0x7f71240dfa90 2024-04-22T06:32:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f7131bd0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7124050500 con 0x7f71240e0480 2024-04-22T06:32:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f7131bd0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f712404ef20 con 0x7f71240d9240 2024-04-22T06:32:11.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.100+0000 7f17351ac640 1 -- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f171c004ab0 msgr2=0x7f171c004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.099+0000 7f30b5499640 1 -- 172.21.15.113:0/721401072 wait complete. 2024-04-22T06:32:11.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.101+0000 7f30b5499640 1 Processor -- start 2024-04-22T06:32:11.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.101+0000 7f30b5499640 1 -- start start 2024-04-22T06:32:11.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f712bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f71240e0480 0x7f712404ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30b5499640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 0x7f30b0142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30b5499640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b0159730 0x7f30b01537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30b5499640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01633a0 0x7f30b0153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.100+0000 7f17351ac640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f171c004ab0 0x7f171c004ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.100+0000 7f17351ac640 1 -- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0040d0 msgr2=0x7f171c00b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.100+0000 7f17351ac640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0040d0 0x7f171c00b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f712bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f71240e0480 0x7f712404ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40116/0 (socket says 172.21.15.113:40116) 2024-04-22T06:32:11.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f712bfff640 1 -- 172.21.15.113:0/618633622 learned_addr learned my addr 172.21.15.113:0/618633622 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30b5499640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f30b00cbf80 con 0x7f30b00cadc0 2024-04-22T06:32:11.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30b5499640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01637a0 con 0x7f30b01633a0 2024-04-22T06:32:11.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30b5499640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f30b0159b10 con 0x7f30b0159730 2024-04-22T06:32:11.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.100+0000 7f17351ac640 1 -- 172.21.15.113:0/3637405527 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17301625c0 con 0x7f171c0036c0 2024-04-22T06:32:11.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f17351ac640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f171c0036c0 0x7f171c003b40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f17300c5d60 tx=0x7f171c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e329d85213ce38da server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c035070 con 0x7f171c0036c0 2024-04-22T06:32:11.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01633a0 0x7f30b0153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01633a0 0x7f30b0153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:34506/0 (socket says 172.21.15.113:34506) 2024-04-22T06:32:11.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f30af7fe640 1 -- 172.21.15.113:0/2423958900 learned_addr learned my addr 172.21.15.113:0/2423958900 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f17349ab640 1 -- 172.21.15.113:0/3637405527 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c00ae50 con 0x7f171c0036c0 2024-04-22T06:32:11.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f30ae7fc640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b0159730 0x7f30b01537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f30af7fe640 1 -- 172.21.15.113:0/2423958900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b0159730 msgr2=0x7f30b01537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f30af7fe640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b0159730 0x7f30b01537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f30af7fe640 1 -- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 msgr2=0x7f30b0142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f30aeffd640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 0x7f30b0142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f712bfff640 1 -- 172.21.15.113:0/618633622 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71240d9240 msgr2=0x7f7124039e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f712bfff640 1 --2- 172.21.15.113:0/618633622 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71240d9240 0x7f7124039e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f712bfff640 1 -- 172.21.15.113:0/618633622 >> v1:172.21.15.145:6789/0 conn(0x7f71240dfa90 legacy=0x7f71240071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.102+0000 7f712bfff640 1 -- 172.21.15.113:0/618633622 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712404f200 con 0x7f71240e0480 2024-04-22T06:32:11.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f30af7fe640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 0x7f30b0142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f30af7fe640 1 -- 172.21.15.113:0/2423958900 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b01609b0 con 0x7f30b01633a0 2024-04-22T06:32:11.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f1737c11640 1 -- 172.21.15.113:0/3637405527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f171c0036c0 msgr2=0x7f171c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f1737c11640 1 --2- 172.21.15.113:0/3637405527 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f171c0036c0 0x7f171c003b40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f17300c5d60 tx=0x7f171c004740 comp rx=0 tx=0).stop 2024-04-22T06:32:11.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f17361ae640 1 -- 172.21.15.113:0/3637405527 reap_dead start 2024-04-22T06:32:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f1737c11640 1 -- 172.21.15.113:0/3637405527 shutdown_connections 2024-04-22T06:32:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f1737c11640 1 -- 172.21.15.113:0/3637405527 >> 172.21.15.113:0/3637405527 conn(0x7f173006d610 msgr2=0x7f1730074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.103+0000 7f30aeffd640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 0x7f30b0142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f30af7fe640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01633a0 0x7f30b0153ce0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30a800cda0 tx=0x7f30a800a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f712bfff640 1 --2- 172.21.15.113:0/618633622 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71240e0480 0x7f712404ffc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7118009ad0 tx=0x7f711802bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205e8dbebdde1911 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f30977fe640 1 -- 172.21.15.113:0/2423958900 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8003b90 con 0x7f30b01633a0 2024-04-22T06:32:11.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f1737c11640 1 -- 172.21.15.113:0/3637405527 shutdown_connections 2024-04-22T06:32:11.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b0160c90 con 0x7f30b01633a0 2024-04-22T06:32:11.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f1737c11640 1 -- 172.21.15.113:0/3637405527 wait complete. 2024-04-22T06:32:11.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f712b7fe640 1 -- 172.21.15.113:0/618633622 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7118039070 con 0x7f71240e0480 2024-04-22T06:32:11.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f712b7fe640 1 -- 172.21.15.113:0/618633622 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711802c810 con 0x7f71240e0480 2024-04-22T06:32:11.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f712b7fe640 1 -- 172.21.15.113:0/618633622 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711802cbe0 con 0x7f71240e0480 2024-04-22T06:32:11.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f2c60858640 1 Processor -- start 2024-04-22T06:32:11.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.105+0000 7faa598b3640 1 Processor -- start 2024-04-22T06:32:11.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.104+0000 7f2c60858640 1 -- start start 2024-04-22T06:32:11.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.105+0000 7f7131bd0640 1 -- 172.21.15.113:0/618633622 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71240e0480 msgr2=0x7f712404ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.105+0000 7f7131bd0640 1 --2- 172.21.15.113:0/618633622 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71240e0480 0x7f712404ffc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7118009ad0 tx=0x7f711802bc70 comp rx=0 tx=0).stop 2024-04-22T06:32:11.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f7131bd0640 1 -- 172.21.15.113:0/618633622 shutdown_connections 2024-04-22T06:32:11.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f7131bd0640 1 --2- 172.21.15.113:0/618633622 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71240e0480 0x7f712404ffc0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7118009ad0 tx=0x7f711802bc70 comp rx=0 tx=0).stop 2024-04-22T06:32:11.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f7131bd0640 1 --2- 172.21.15.113:0/618633622 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71240d9240 0x7f7124039e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f7131bd0640 1 -- 172.21.15.113:0/618633622 >> 172.21.15.113:0/618633622 conn(0x7f712400e150 msgr2=0x7f712400e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f7131bd0640 1 -- 172.21.15.113:0/618633622 shutdown_connections 2024-04-22T06:32:11.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f2c5b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2c5c1594c0 0x7f2c5c0c7500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37070/0 (socket says 172.21.15.113:37070) 2024-04-22T06:32:11.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f2c5b7fe640 1 -- 172.21.15.113:0/282274015 learned_addr learned my addr 172.21.15.113:0/282274015 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:11.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.105+0000 7faa598b3640 1 -- start start 2024-04-22T06:32:11.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f1737c11640 1 Processor -- start 2024-04-22T06:32:11.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f2c60858640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15ffc0 0x7f2c5c0c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f2c60858640 1 --2- 172.21.15.113:0/282274015 >> v2:172.21.15.145:3300/0 conn(0x7f2c5c0c3e40 0x7f2c5c0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f2c60858640 1 -- 172.21.15.113:0/282274015 --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5c0c9c90 con 0x7f2c5c1594c0 2024-04-22T06:32:11.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f2c60858640 1 -- 172.21.15.113:0/282274015 --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f2c5c0c7c10 con 0x7f2c5c0c3e40 2024-04-22T06:32:11.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7faa588b1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7faa4c006f30 0x7faa4c007310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37074/0 (socket says 172.21.15.113:37074) 2024-04-22T06:32:11.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7faa588b1640 1 -- 172.21.15.113:0/3008200008 learned_addr learned my addr 172.21.15.113:0/3008200008 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:11.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f2c60858640 1 -- 172.21.15.113:0/282274015 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5c0c8910 con 0x7f2c5c15ffc0 2024-04-22T06:32:11.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7faa598b3640 1 --2- 172.21.15.113:0/3008200008 >> v2:172.21.15.113:3300/0 conn(0x7faa4c0e6920 0x7faa4c0e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182370292 0 0) 0x7f2c5c0c9c90 con 0x7f2c5c1594c0 2024-04-22T06:32:11.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c44003520 con 0x7f2c5c1594c0 2024-04-22T06:32:11.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7faa598b3640 1 --2- 172.21.15.113:0/3008200008 >> v2:172.21.15.145:3300/0 conn(0x7faa4c04c170 0x7faa4c04c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7faa53fff640 1 --2- 172.21.15.113:0/3008200008 >> v2:172.21.15.113:3300/0 conn(0x7faa4c0e6920 0x7faa4c0e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5affd640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15ffc0 0x7f2c5c0c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2162850071 0 0) 0x7f2c44003520 con 0x7f2c5c1594c0 2024-04-22T06:32:11.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f1737c11640 1 -- start start 2024-04-22T06:32:11.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f1737c11640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0036c0 0x7f17302010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f1737c11640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1730072ee0 0x7f17301583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f1737c11640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1730157370 0x7f173008c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7faa598b3640 1 -- 172.21.15.113:0/3008200008 --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4c04b9b0 con 0x7faa4c006f30 2024-04-22T06:32:11.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.106+0000 7f7131bd0640 1 -- 172.21.15.113:0/618633622 wait complete. 2024-04-22T06:32:11.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7faa590b2640 1 --2- 172.21.15.113:0/3008200008 >> v2:172.21.15.145:3300/0 conn(0x7faa4c04c170 0x7faa4c04c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f1737c11640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f17300cc040 con 0x7f1730072ee0 2024-04-22T06:32:11.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f1737c11640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f17300cbd60 con 0x7f171c0036c0 2024-04-22T06:32:11.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f1737c11640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f17300cc320 con 0x7f1730157370 2024-04-22T06:32:11.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7faa598b3640 1 -- 172.21.15.113:0/3008200008 --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7faa4c04bce0 con 0x7faa4c0e6920 2024-04-22T06:32:11.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7faa598b3640 1 -- 172.21.15.113:0/3008200008 --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7faa4c007a20 con 0x7faa4c04c170 2024-04-22T06:32:11.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f7131bd0640 1 Processor -- start 2024-04-22T06:32:11.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f17351ac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1730072ee0 0x7f17301583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15ffc0 msgr2=0x7f2c5c0c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15ffc0 0x7f2c5c0c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 >> v2:172.21.15.145:3300/0 conn(0x7f2c5c0c3e40 msgr2=0x7f2c5c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 --2- 172.21.15.113:0/282274015 >> v2:172.21.15.145:3300/0 conn(0x7f2c5c0c3e40 0x7f2c5c0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c0c8bf0 con 0x7f2c5c1594c0 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f2c4c001670 con 0x7f2c5c1594c0 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 >> v1:172.21.15.113:6789/0 conn(0x7f2c5c1594c0 legacy=0x7f2c5c0c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15ffc0 0x7f2c440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004030 0x7f2c44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c44004d40 0x7f2c440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0c7c10 con 0x7f2c44004d40 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0c8910 con 0x7f2c44004030 2024-04-22T06:32:11.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.107+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4400bc90 con 0x7f2c5c15ffc0 2024-04-22T06:32:11.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f17351ac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1730072ee0 0x7f17301583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40150/0 (socket says 172.21.15.113:40150) 2024-04-22T06:32:11.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f17359ad640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0036c0 0x7f17302010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f17351ac640 1 -- 172.21.15.113:0/200026244 learned_addr learned my addr 172.21.15.113:0/200026244 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7faa590b2640 1 -- 172.21.15.113:0/3008200008 >> v2:172.21.15.113:3300/0 conn(0x7faa4c0e6920 msgr2=0x7faa4c0e33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7faa590b2640 1 --2- 172.21.15.113:0/3008200008 >> v2:172.21.15.113:3300/0 conn(0x7faa4c0e6920 0x7faa4c0e33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7faa590b2640 1 -- 172.21.15.113:0/3008200008 >> v1:172.21.15.113:6789/0 conn(0x7faa4c006f30 legacy=0x7faa4c007310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7faa590b2640 1 -- 172.21.15.113:0/3008200008 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c04cae0 con 0x7faa4c04c170 2024-04-22T06:32:11.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b0161250 con 0x7f30b01633a0 2024-04-22T06:32:11.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f17351ac640 1 -- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1730157370 msgr2=0x7f173008c740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:11.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f30977fe640 1 -- 172.21.15.113:0/2423958900 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a8003d30 con 0x7f30b01633a0 2024-04-22T06:32:11.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f7131bd0640 1 -- start start 2024-04-22T06:32:11.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f30977fe640 1 -- 172.21.15.113:0/2423958900 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8004240 con 0x7f30b01633a0 2024-04-22T06:32:11.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7131bd0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71240d9240 0x7f712404a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7131bd0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71240dfa90 0x7f71240d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7131bd0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f712404aff0 0x7f7124048330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7131bd0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f712404faa0 con 0x7f712404aff0 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7131bd0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f712404f7c0 con 0x7f71240d9240 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7131bd0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f71240dff20 con 0x7f71240dfa90 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7130bce640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71240d9240 0x7f712404a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7130bce640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71240d9240 0x7f712404a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:34548/0 (socket says 172.21.15.113:34548) 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f7130bce640 1 -- 172.21.15.113:0/2014147599 learned_addr learned my addr 172.21.15.113:0/2014147599 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.110+0000 7f7130bce640 1 -- 172.21.15.113:0/2014147599 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71240dfa90 msgr2=0x7f71240d47a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.110+0000 7f7130bce640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71240dfa90 0x7f71240d47a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.110+0000 7f7130bce640 1 -- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f712404aff0 msgr2=0x7f7124048330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.110+0000 7f7130bce640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f712404aff0 0x7f7124048330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.110+0000 7f7130bce640 1 -- 172.21.15.113:0/2014147599 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7124181bf0 con 0x7f71240d9240 2024-04-22T06:32:11.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.110+0000 7f7130bce640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71240d9240 0x7f712404a4a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f712c07c7a0 tx=0x7f712c069e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7faa590b2640 1 --2- 172.21.15.113:0/3008200008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c04c170 0x7faa4c04c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa5406ab50 tx=0x7faa540a7f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b10de2ff4942de2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7faa537fe640 1 -- 172.21.15.113:0/3008200008 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa540b5070 con 0x7faa4c04c170 2024-04-22T06:32:11.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7faa537fe640 1 -- 172.21.15.113:0/3008200008 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa540a8e30 con 0x7faa4c04c170 2024-04-22T06:32:11.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7faa537fe640 1 -- 172.21.15.113:0/3008200008 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa540b0660 con 0x7faa4c04c170 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f2c5bfff640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c44004d40 0x7f2c440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.108+0000 7f2c5affd640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004030 0x7f2c44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f2c5bfff640 1 -- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15ffc0 msgr2=0x7f2c440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f2c5bfff640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15ffc0 0x7f2c440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f2c5bfff640 1 -- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004030 msgr2=0x7f2c44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f2c5bfff640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004030 0x7f2c44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f2c5bfff640 1 -- 172.21.15.113:0/282274015 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c44003520 con 0x7f2c44004d40 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f2c5affd640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004030 0x7f2c44004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7faa598b3640 1 -- 172.21.15.113:0/3008200008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c04c170 msgr2=0x7faa4c04c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7faa598b3640 1 --2- 172.21.15.113:0/3008200008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c04c170 0x7faa4c04c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa5406ab50 tx=0x7faa540a7f80 comp rx=0 tx=0).stop 2024-04-22T06:32:11.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.109+0000 7f17361ae640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1730157370 0x7f173008c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f17351ac640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1730157370 0x7f173008c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f17351ac640 1 -- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0036c0 msgr2=0x7f17302010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f17351ac640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0036c0 0x7f17302010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f17351ac640 1 -- 172.21.15.113:0/200026244 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1730156da0 con 0x7f1730072ee0 2024-04-22T06:32:11.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7faa598b3640 1 -- 172.21.15.113:0/3008200008 shutdown_connections 2024-04-22T06:32:11.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7faa598b3640 1 --2- 172.21.15.113:0/3008200008 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c04c170 0x7faa4c04c5a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7faa598b3640 1 --2- 172.21.15.113:0/3008200008 >> v2:172.21.15.113:3300/0 conn(0x7faa4c0e6920 0x7faa4c0e33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7faa598b3640 1 -- 172.21.15.113:0/3008200008 >> 172.21.15.113:0/3008200008 conn(0x7faa4c0061a0 msgr2=0x7faa4c0065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f17359ad640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0036c0 0x7f17302010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:11.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f17361ae640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1730157370 0x7f173008c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:11.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7faa598b3640 1 -- 172.21.15.113:0/3008200008 shutdown_connections 2024-04-22T06:32:11.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f71297fa640 1 -- 172.21.15.113:0/2014147599 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c091020 con 0x7f71240d9240 2024-04-22T06:32:11.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f17351ac640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1730072ee0 0x7f17301583a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f172c02ddf0 tx=0x7f172c008180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7faa598b3640 1 -- 172.21.15.113:0/3008200008 wait complete. 2024-04-22T06:32:11.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f2c5bfff640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c44004d40 0x7f2c440051c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009e60 tx=0x7f2c44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af11399a6b7d5ce server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f7131bd0640 1 -- 172.21.15.113:0/2014147599 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712404ab30 con 0x7f71240d9240 2024-04-22T06:32:11.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f7131bd0640 1 -- 172.21.15.113:0/2014147599 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7124182190 con 0x7f71240d9240 2024-04-22T06:32:11.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.112+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54039070 con 0x7f2c44004d40 2024-04-22T06:32:11.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.112+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c54006e50 con 0x7f2c44004d40 2024-04-22T06:32:11.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.112+0000 7f2c5a7fc640 1 -- 172.21.15.113:0/282274015 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54009a30 con 0x7f2c44004d40 2024-04-22T06:32:11.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.112+0000 7f71297fa640 1 -- 172.21.15.113:0/2014147599 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712c074260 con 0x7f71240d9240 2024-04-22T06:32:11.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.112+0000 7f71297fa640 1 -- 172.21.15.113:0/2014147599 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c06b920 con 0x7f71240d9240 2024-04-22T06:32:11.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f7116ffd640 1 -- 172.21.15.113:0/2014147599 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7104005290 con 0x7f71240d9240 2024-04-22T06:32:11.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f30977fe640 1 -- 172.21.15.113:0/2423958900 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30a80043e0 con 0x7f30b01633a0 2024-04-22T06:32:11.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f30977fe640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f309c06c9c0 0x7f309c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.111+0000 7f30977fe640 1 -- 172.21.15.113:0/2423958900 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f30a808ca70 con 0x7f30b01633a0 2024-04-22T06:32:11.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7faa598b3640 1 Processor -- start 2024-04-22T06:32:11.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f30aeffd640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f309c06c9c0 0x7f309c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f2c60858640 1 -- 172.21.15.113:0/282274015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c44004d40 msgr2=0x7f2c440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f2c60858640 1 --2- 172.21.15.113:0/282274015 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c44004d40 0x7f2c440051c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009e60 tx=0x7f2c44005830 comp rx=0 tx=0).stop 2024-04-22T06:32:11.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f2c5bfff640 1 -- 172.21.15.113:0/282274015 reap_dead start 2024-04-22T06:32:11.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f2c60858640 1 -- 172.21.15.113:0/282274015 shutdown_connections 2024-04-22T06:32:11.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f2c60858640 1 -- 172.21.15.113:0/282274015 >> 172.21.15.113:0/282274015 conn(0x7f2c5c06eb20 msgr2=0x7f2c5c06ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f17267fc640 1 -- 172.21.15.113:0/200026244 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c04a070 con 0x7f1730072ee0 2024-04-22T06:32:11.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f2c60858640 1 -- 172.21.15.113:0/282274015 shutdown_connections 2024-04-22T06:32:11.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f30aeffd640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f309c06c9c0 0x7f309c06ee80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30a400a8b0 tx=0x7f30a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7f17267fc640 1 -- 172.21.15.113:0/200026244 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c03a450 con 0x7f1730072ee0 2024-04-22T06:32:11.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f17267fc640 1 -- 172.21.15.113:0/200026244 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c0086b0 con 0x7f1730072ee0 2024-04-22T06:32:11.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1730201990 con 0x7f1730072ee0 2024-04-22T06:32:11.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.113+0000 7faa598b3640 1 -- start start 2024-04-22T06:32:11.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b0068e40 con 0x7f30b01633a0 2024-04-22T06:32:11.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f71297fa640 1 -- 172.21.15.113:0/2014147599 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f712c096400 con 0x7f71240d9240 2024-04-22T06:32:11.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f71297fa640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f711006c970 0x7f711006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f71297fa640 1 -- 172.21.15.113:0/2014147599 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f712c1074e0 con 0x7f71240d9240 2024-04-22T06:32:11.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f712bfff640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f711006c970 0x7f711006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7faa598b3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa4c006f30 0x7faa4c0dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa598b3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa4c04c170 0x7faa4c0ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa598b3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c0e6920 0x7faa4c0de240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa598b3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c0e3fb0 con 0x7faa4c04c170 2024-04-22T06:32:11.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa598b3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c0e3cd0 con 0x7faa4c0e6920 2024-04-22T06:32:11.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa598b3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7faa4c0e4290 con 0x7faa4c006f30 2024-04-22T06:32:11.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa53fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa4c04c170 0x7faa4c0ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa53fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa4c04c170 0x7faa4c0ddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40156/0 (socket says 172.21.15.113:40156) 2024-04-22T06:32:11.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa53fff640 1 -- 172.21.15.113:0/4209675666 learned_addr learned my addr 172.21.15.113:0/4209675666 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa588b1640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa4c006f30 0x7faa4c0dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1730157080 con 0x7f1730072ee0 2024-04-22T06:32:11.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.114+0000 7f2c60858640 1 -- 172.21.15.113:0/282274015 wait complete. 2024-04-22T06:32:11.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa590b2640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c0e6920 0x7faa4c0de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa53fff640 1 -- 172.21.15.113:0/4209675666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa4c006f30 msgr2=0x7faa4c0dfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa53fff640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa4c006f30 0x7faa4c0dfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa53fff640 1 -- 172.21.15.113:0/4209675666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c0e6920 msgr2=0x7faa4c0de240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa53fff640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c0e6920 0x7faa4c0de240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.115+0000 7faa53fff640 1 -- 172.21.15.113:0/4209675666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c04d950 con 0x7faa4c04c170 2024-04-22T06:32:11.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7faa53fff640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa4c04c170 0x7faa4c0ddd00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa4000e9e0 tx=0x7faa4000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7f712bfff640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f711006c970 0x7f711006ee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7118036000 tx=0x7f7118030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17300c91b0 con 0x7f1730072ee0 2024-04-22T06:32:11.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7faa517fa640 1 -- 172.21.15.113:0/4209675666 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40017070 con 0x7faa4c04c170 2024-04-22T06:32:11.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7f2c60858640 1 Processor -- start 2024-04-22T06:32:11.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.117+0000 7f17267fc640 1 -- 172.21.15.113:0/200026244 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f172c04d020 con 0x7f1730072ee0 2024-04-22T06:32:11.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.117+0000 7f2c60858640 1 -- start start 2024-04-22T06:32:11.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7faa517fa640 1 -- 172.21.15.113:0/4209675666 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4000c9d0 con 0x7faa4c04c170 2024-04-22T06:32:11.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7faa517fa640 1 -- 172.21.15.113:0/4209675666 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4000cdc0 con 0x7faa4c04c170 2024-04-22T06:32:11.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4c00b3e0 con 0x7faa4c04c170 2024-04-22T06:32:11.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.116+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4c00a900 con 0x7faa4c04c170 2024-04-22T06:32:11.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.117+0000 7f17267fc640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f171406c9c0 0x7f171406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.117+0000 7f17267fc640 1 -- 172.21.15.113:0/200026244 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f172c0ad490 con 0x7f1730072ee0 2024-04-22T06:32:11.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.117+0000 7f17359ad640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f171406c9c0 0x7f171406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c60858640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004d40 0x7f2c5c1f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c60858640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c5c1f67a0 0x7f2c5c1f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c60858640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15f250 0x7f2c5c154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f17359ad640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f171406c9c0 0x7f171406ee80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1720006fd0 tx=0x7f1720011040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4c0057e0 con 0x7faa4c04c170 2024-04-22T06:32:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c5b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004d40 0x7f2c5c1f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c5affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c5c1f67a0 0x7f2c5c1f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c5b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004d40 0x7f2c5c1f88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:34568/0 (socket says 172.21.15.113:34568) 2024-04-22T06:32:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c5affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c5c1f67a0 0x7f2c5c1f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40166/0 (socket says 172.21.15.113:40166) 2024-04-22T06:32:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c5b7fe640 1 -- 172.21.15.113:0/538831013 learned_addr learned my addr 172.21.15.113:0/538831013 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0c9490 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0c91b0 con 0x7f2c44004d40 2024-04-22T06:32:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.118+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5c0c9770 con 0x7f2c5c15f250 2024-04-22T06:32:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f71297fa640 1 -- 172.21.15.113:0/2014147599 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f712c09b060 con 0x7f71240d9240 2024-04-22T06:32:11.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f2c5bfff640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15f250 0x7f2c5c154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7faa517fa640 1 -- 172.21.15.113:0/4209675666 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa4001a070 con 0x7faa4c04c170 2024-04-22T06:32:11.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f2c5affd640 1 -- 172.21.15.113:0/538831013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15f250 msgr2=0x7f2c5c154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f2c5affd640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15f250 0x7f2c5c154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f2c5affd640 1 -- 172.21.15.113:0/538831013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004d40 msgr2=0x7f2c5c1f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f2c5affd640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004d40 0x7f2c5c1f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f2c5affd640 1 -- 172.21.15.113:0/538831013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c1f6280 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f2c5b7fe640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004d40 0x7f2c5c1f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:11.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7f2c5affd640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c5c1f67a0 0x7f2c5c1f5d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2c50003fd0 tx=0x7f2c5000f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.119+0000 7faa517fa640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faa3806c920 0x7faa3806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.120+0000 7faa588b1640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faa3806c920 0x7faa3806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.120+0000 7faa588b1640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faa3806c920 0x7faa3806ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa48000f60 tx=0x7faa48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.123+0000 7f30977fe640 1 -- 172.21.15.113:0/2423958900 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f30a801d340 con 0x7f30b01633a0 2024-04-22T06:32:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.127+0000 7faa517fa640 1 -- 172.21.15.113:0/4209675666 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faa4008a1a0 con 0x7faa4c04c170 2024-04-22T06:32:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.127+0000 7f17267fc640 1 -- 172.21.15.113:0/200026244 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f172c07b560 con 0x7f1730072ee0 2024-04-22T06:32:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.127+0000 7f2c43fff640 1 -- 172.21.15.113:0/538831013 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50018020 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.127+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c1f8fe0 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.127+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c1f95a0 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.129+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5c068cc0 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.136+0000 7f2c43fff640 1 -- 172.21.15.113:0/538831013 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c50014870 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.138+0000 7faa517fa640 1 -- 172.21.15.113:0/4209675666 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa400598c0 con 0x7faa4c04c170 2024-04-22T06:32:11.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.142+0000 7f2c43fff640 1 -- 172.21.15.113:0/538831013 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50014c40 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.142+0000 7f2c43fff640 1 -- 172.21.15.113:0/538831013 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c5001b020 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.142+0000 7f2c43fff640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c4806c8d0 0x7f2c4806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.142+0000 7f2c43fff640 1 -- 172.21.15.113:0/538831013 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2c5008c890 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.146+0000 7f2c5b7fe640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c4806c8d0 0x7f2c4806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.147+0000 7f2c5b7fe640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c4806c8d0 0x7f2c4806ed90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c007140 tx=0x7f2c4c001b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.150+0000 7f2c43fff640 1 -- 172.21.15.113:0/538831013 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c50022020 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.349+0000 7fe02eb52640 1 -- 172.21.15.113:0/1386404329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe02806e2a0 con 0x7fe028153150 2024-04-22T06:32:11.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.350+0000 7fe0257fa640 1 -- 172.21.15.113:0/1386404329 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe01400f070 con 0x7fe028153150 2024-04-22T06:32:11.349 INFO:teuthology.orchestra.run.smithi113.stdout:55834574860 2024-04-22T06:32:11.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.353+0000 7fe012ffd640 1 -- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe00c06c8f0 msgr2=0x7fe00c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.353+0000 7fe012ffd640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe00c06c8f0 0x7fe00c06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009b40 tx=0x7fe01c009190 comp rx=0 tx=0).stop 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.353+0000 7fe012ffd640 1 -- 172.21.15.113:0/1386404329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe028153150 msgr2=0x7fe028155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.353+0000 7fe012ffd640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe028153150 0x7fe028155a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0140011e0 tx=0x7fe01400cc50 comp rx=0 tx=0).stop 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.354+0000 7fe012ffd640 1 -- 172.21.15.113:0/1386404329 shutdown_connections 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.354+0000 7fe012ffd640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe00c06c8f0 0x7fe00c06edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.354+0000 7fe012ffd640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe02815cdb0 0x7fe02814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.354+0000 7fe012ffd640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe028153150 0x7fe028155a90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.354+0000 7fe012ffd640 1 --2- 172.21.15.113:0/1386404329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe028075830 0x7fe0281513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.354+0000 7fe012ffd640 1 -- 172.21.15.113:0/1386404329 >> 172.21.15.113:0/1386404329 conn(0x7fe0280ca0d0 msgr2=0x7fe0281574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.354+0000 7fe012ffd640 1 -- 172.21.15.113:0/1386404329 shutdown_connections 2024-04-22T06:32:11.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.354+0000 7fe012ffd640 1 -- 172.21.15.113:0/1386404329 wait complete. 2024-04-22T06:32:11.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2024-04-22T06:32:11.369 DEBUG:teuthology.parallel:result is None 2024-04-22T06:32:11.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.407+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4d000c8300 con 0x7f4d000ca200 2024-04-22T06:32:11.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.407+0000 7f4cfeffd640 1 -- 172.21.15.113:0/2894178369 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4cf8058e30 con 0x7f4d000ca200 2024-04-22T06:32:11.406 INFO:teuthology.orchestra.run.smithi113.stdout:55834574860 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.409+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4cec06ca20 msgr2=0x7f4cec06eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.409+0000 7f4d071c4640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4cec06ca20 0x7f4cec06eee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4039000 tx=0x7f4cf4034000 comp rx=0 tx=0).stop 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.409+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d000ca200 msgr2=0x7f4d001e1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.409+0000 7f4d071c4640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d000ca200 0x7f4d001e1ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800c7b0 tx=0x7f4cf800cc70 comp rx=0 tx=0).stop 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.410+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 shutdown_connections 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.410+0000 7f4d071c4640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d000ca200 0x7f4d001e1ca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.410+0000 7f4d071c4640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4cec06ca20 0x7f4cec06eee0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.410+0000 7f4d071c4640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4d000c9220 0x7f4d001e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.410+0000 7f4d071c4640 1 --2- 172.21.15.113:0/2894178369 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4d000c7750 0x7f4d001431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.410+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 >> 172.21.15.113:0/2894178369 conn(0x7f4d0006eb30 msgr2=0x7f4d000c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.410+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 shutdown_connections 2024-04-22T06:32:11.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.410+0000 7f4d071c4640 1 -- 172.21.15.113:0/2894178369 wait complete. 2024-04-22T06:32:11.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2024-04-22T06:32:11.419 DEBUG:teuthology.parallel:result is None 2024-04-22T06:32:11.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.484+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f30b0157770 con 0x7f30b01633a0 2024-04-22T06:32:11.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.484+0000 7f30977fe640 1 -- 172.21.15.113:0/2423958900 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30a805aab0 con 0x7f30b01633a0 2024-04-22T06:32:11.483 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:11.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.487+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f309c06c9c0 msgr2=0x7f309c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.487+0000 7f30b5499640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f309c06c9c0 0x7f309c06ee80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30a400a8b0 tx=0x7f30a4008040 comp rx=0 tx=0).stop 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.487+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01633a0 msgr2=0x7f30b0153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.487+0000 7f30b5499640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01633a0 0x7f30b0153ce0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30a800cda0 tx=0x7f30a800a660 comp rx=0 tx=0).stop 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.488+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 shutdown_connections 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.488+0000 7f30b5499640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01633a0 0x7f30b0153ce0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.488+0000 7f30b5499640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30b0159730 0x7f30b01537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.488+0000 7f30b5499640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f309c06c9c0 0x7f309c06ee80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.488+0000 7f30b5499640 1 --2- 172.21.15.113:0/2423958900 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30b00cadc0 0x7f30b0142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.488+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 >> 172.21.15.113:0/2423958900 conn(0x7f30b006d610 msgr2=0x7f30b0158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.488+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 shutdown_connections 2024-04-22T06:32:11.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.488+0000 7f30b5499640 1 -- 172.21.15.113:0/2423958900 wait complete. 2024-04-22T06:32:11.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-22T06:32:11.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.503+0000 7f7116ffd640 1 -- 172.21.15.113:0/2014147599 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7104005580 con 0x7f71240d9240 2024-04-22T06:32:11.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.504+0000 7f71297fa640 1 -- 172.21.15.113:0/2014147599 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f712c0d5640 con 0x7f71240d9240 2024-04-22T06:32:11.503 DEBUG:teuthology.parallel:result is None 2024-04-22T06:32:11.503 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:11.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.507+0000 7f7116ffd640 1 -- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f711006c970 msgr2=0x7f711006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.507+0000 7f7116ffd640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f711006c970 0x7f711006ee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7118036000 tx=0x7f7118030000 comp rx=0 tx=0).stop 2024-04-22T06:32:11.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.507+0000 7f7116ffd640 1 -- 172.21.15.113:0/2014147599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71240d9240 msgr2=0x7f712404a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.507+0000 7f7116ffd640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71240d9240 0x7f712404a4a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f712c07c7a0 tx=0x7f712c069e70 comp rx=0 tx=0).stop 2024-04-22T06:32:11.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.508+0000 7f7116ffd640 1 -- 172.21.15.113:0/2014147599 shutdown_connections 2024-04-22T06:32:11.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.508+0000 7f7116ffd640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f711006c970 0x7f711006ee30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.508+0000 7f7116ffd640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f712404aff0 0x7f7124048330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.508+0000 7f7116ffd640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f71240dfa90 0x7f71240d47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.508+0000 7f7116ffd640 1 --2- 172.21.15.113:0/2014147599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71240d9240 0x7f712404a4a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.508+0000 7f7116ffd640 1 -- 172.21.15.113:0/2014147599 >> 172.21.15.113:0/2014147599 conn(0x7f712400e150 msgr2=0x7f71240e0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.508+0000 7f7116ffd640 1 -- 172.21.15.113:0/2014147599 shutdown_connections 2024-04-22T06:32:11.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.508+0000 7f7116ffd640 1 -- 172.21.15.113:0/2014147599 wait complete. 2024-04-22T06:32:11.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-22T06:32:11.521 DEBUG:teuthology.parallel:result is None 2024-04-22T06:32:11.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.536+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2c5c06de20 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.536+0000 7f2c43fff640 1 -- 172.21.15.113:0/538831013 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c5005a310 con 0x7f2c5c1f67a0 2024-04-22T06:32:11.535 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c4806c8d0 msgr2=0x7f2c4806ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c4806c8d0 0x7f2c4806ed90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c007140 tx=0x7f2c4c001b70 comp rx=0 tx=0).stop 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c5c1f67a0 msgr2=0x7f2c5c1f5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c5c1f67a0 0x7f2c5c1f5d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2c50003fd0 tx=0x7f2c5000f970 comp rx=0 tx=0).stop 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 shutdown_connections 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2c5c15f250 0x7f2c5c154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2c4806c8d0 0x7f2c4806ed90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2c5c1f67a0 0x7f2c5c1f5d40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 --2- 172.21.15.113:0/538831013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c44004d40 0x7f2c5c1f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 >> 172.21.15.113:0/538831013 conn(0x7f2c5c06eb20 msgr2=0x7f2c5c0c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 shutdown_connections 2024-04-22T06:32:11.538 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.538+0000 7f2c60858640 1 -- 172.21.15.113:0/538831013 wait complete. 2024-04-22T06:32:11.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.542+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f17300cb3c0 con 0x7f1730072ee0 2024-04-22T06:32:11.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.542+0000 7f17267fc640 1 -- 172.21.15.113:0/200026244 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f172c07ae60 con 0x7f1730072ee0 2024-04-22T06:32:11.540 INFO:teuthology.orchestra.run.smithi113.stdout:55834574859 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f171406c9c0 msgr2=0x7f171406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f171406c9c0 0x7f171406ee80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1720006fd0 tx=0x7f1720011040 comp rx=0 tx=0).stop 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1730072ee0 msgr2=0x7f17301583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1730072ee0 0x7f17301583a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f172c02ddf0 tx=0x7f172c008180 comp rx=0 tx=0).stop 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 shutdown_connections 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1730157370 0x7f173008c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f171406c9c0 0x7f171406ee80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1730072ee0 0x7f17301583a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 --2- 172.21.15.113:0/200026244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f171c0036c0 0x7f17302010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 >> 172.21.15.113:0/200026244 conn(0x7f173006d610 msgr2=0x7f173015ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 shutdown_connections 2024-04-22T06:32:11.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.544+0000 7f1737c11640 1 -- 172.21.15.113:0/200026244 wait complete. 2024-04-22T06:32:11.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.549+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7faa4c05de80 con 0x7faa4c04c170 2024-04-22T06:32:11.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.549+0000 7faa517fa640 1 -- 172.21.15.113:0/4209675666 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa4005dbc0 con 0x7faa4c04c170 2024-04-22T06:32:11.547 INFO:teuthology.orchestra.run.smithi113.stdout:55834574858 2024-04-22T06:32:11.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-22T06:32:11.548 DEBUG:teuthology.parallel:result is None 2024-04-22T06:32:11.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faa3806c920 msgr2=0x7faa3806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faa3806c920 0x7faa3806ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa48000f60 tx=0x7faa48009040 comp rx=0 tx=0).stop 2024-04-22T06:32:11.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa4c04c170 msgr2=0x7faa4c0ddd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa4c04c170 0x7faa4c0ddd00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa4000e9e0 tx=0x7faa4000eea0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 shutdown_connections 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa4c0e6920 0x7faa4c0de240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faa3806c920 0x7faa3806ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faa4c04c170 0x7faa4c0ddd00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 --2- 172.21.15.113:0/4209675666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa4c006f30 0x7faa4c0dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 >> 172.21.15.113:0/4209675666 conn(0x7faa4c0061a0 msgr2=0x7faa4c053dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 shutdown_connections 2024-04-22T06:32:11.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.552+0000 7faa598b3640 1 -- 172.21.15.113:0/4209675666 wait complete. 2024-04-22T06:32:11.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-22T06:32:11.555 DEBUG:teuthology.parallel:result is None 2024-04-22T06:32:11.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-22T06:32:11.565 DEBUG:teuthology.parallel:result is None 2024-04-22T06:32:11.565 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T06:32:11.565 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:32:11.615 INFO:tasks.ceph.mds.c.smithi113.stderr:2024-04-22T06:32:11.617+0000 7f042e2e7640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-22T06:32:11.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.704+0000 7fe2fa0e0640 1 Processor -- start 2024-04-22T06:32:11.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.704+0000 7fe2fa0e0640 1 -- start start 2024-04-22T06:32:11.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2fa0e0640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe2f40cb440 0x7fe2f40caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2fa0e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f415cdd0 0x7fe2f40cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2fa0e0640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f40c9bb0 con 0x7fe2f40c9fa0 2024-04-22T06:32:11.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2fa0e0640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f40c5a70 con 0x7fe2f40cb440 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2fa0e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f40c5cc0 con 0x7fe2f415cdd0 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2f37fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe2f40cb440 0x7fe2f40caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2f3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f415cdd0 0x7fe2f40cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2f2ffd640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fe2f40c9fa0 0x7fe2f415c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:58256/0 (socket says 172.21.15.113:58256) 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2f2ffd640 1 -- 172.21.15.113:0/1567804597 learned_addr learned my addr 172.21.15.113:0/1567804597 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.705+0000 7fe2f37fe640 1 --2- 172.21.15.113:0/1567804597 >> v2:172.21.15.145:3300/0 conn(0x7fe2f40cb440 0x7fe2f40caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:34580/0 (socket says 172.21.15.113:34580) 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.706+0000 7fe2f3fff640 1 -- 172.21.15.113:0/1567804597 >> v2:172.21.15.145:3300/0 conn(0x7fe2f40cb440 msgr2=0x7fe2f40caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.706+0000 7fe2f3fff640 1 --2- 172.21.15.113:0/1567804597 >> v2:172.21.15.145:3300/0 conn(0x7fe2f40cb440 0x7fe2f40caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.706+0000 7fe2f3fff640 1 -- 172.21.15.113:0/1567804597 >> v1:172.21.15.145:6789/0 conn(0x7fe2f40c9fa0 legacy=0x7fe2f415c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.706+0000 7fe2f3fff640 1 -- 172.21.15.113:0/1567804597 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f40c5fa0 con 0x7fe2f415cdd0 2024-04-22T06:32:11.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.706+0000 7fe2f37fe640 1 --2- 172.21.15.113:0/1567804597 >> v2:172.21.15.145:3300/0 conn(0x7fe2f40cb440 0x7fe2f40caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2f3fff640 1 --2- 172.21.15.113:0/1567804597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f415cdd0 0x7fe2f40cb820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009d90 tx=0x7fe2ec02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bf2d743b85c1f1b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2f27fc640 1 -- 172.21.15.113:0/1567804597 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec039070 con 0x7fe2f415cdd0 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2f27fc640 1 -- 172.21.15.113:0/1567804597 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec02cc50 con 0x7fe2f415cdd0 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2f27fc640 1 -- 172.21.15.113:0/1567804597 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec034440 con 0x7fe2f415cdd0 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/1567804597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f415cdd0 msgr2=0x7fe2f40cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/1567804597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f415cdd0 0x7fe2f40cb820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009d90 tx=0x7fe2ec02bea0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/1567804597 shutdown_connections 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/1567804597 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f415cdd0 0x7fe2f40cb820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/1567804597 >> v2:172.21.15.145:3300/0 conn(0x7fe2f40cb440 0x7fe2f40caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/1567804597 >> 172.21.15.113:0/1567804597 conn(0x7fe2f4074f30 msgr2=0x7fe2f4075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/1567804597 shutdown_connections 2024-04-22T06:32:11.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.707+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/1567804597 wait complete. 2024-04-22T06:32:11.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.709+0000 7fe2fa0e0640 1 Processor -- start 2024-04-22T06:32:11.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.709+0000 7fe2fa0e0640 1 -- start start 2024-04-22T06:32:11.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.709+0000 7fe2fa0e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f40c9fa0 0x7fe2f41e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.709+0000 7fe2fa0e0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f40cb440 0x7fe2f4149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.709+0000 7fe2fa0e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2f415cdd0 0x7fe2f4149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.709+0000 7fe2fa0e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f40c9850 con 0x7fe2f415cdd0 2024-04-22T06:32:11.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.709+0000 7fe2fa0e0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f40ca720 con 0x7fe2f40cb440 2024-04-22T06:32:11.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.709+0000 7fe2fa0e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f4153360 con 0x7fe2f40c9fa0 2024-04-22T06:32:11.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2f415cdd0 0x7fe2f4149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2f415cdd0 0x7fe2f4149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40178/0 (socket says 172.21.15.113:40178) 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 -- 172.21.15.113:0/2836738698 learned_addr learned my addr 172.21.15.113:0/2836738698 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f2ffd640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f40cb440 0x7fe2f4149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f37fe640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f40c9fa0 0x7fe2f41e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 -- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f40c9fa0 msgr2=0x7fe2f41e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f40c9fa0 0x7fe2f41e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 -- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f40cb440 msgr2=0x7fe2f4149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f40cb440 0x7fe2f4149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 -- 172.21.15.113:0/2836738698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f414b810 con 0x7fe2f415cdd0 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f2ffd640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f40cb440 0x7fe2f4149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2f3fff640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2f415cdd0 0x7fe2f4149590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec02c4b0 tx=0x7fe2ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2dbfff640 1 -- 172.21.15.113:0/2836738698 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec039050 con 0x7fe2f415cdd0 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2dbfff640 1 -- 172.21.15.113:0/2836738698 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec045070 con 0x7fe2f415cdd0 2024-04-22T06:32:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f414a120 con 0x7fe2f415cdd0 2024-04-22T06:32:11.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2dbfff640 1 -- 172.21.15.113:0/2836738698 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec009450 con 0x7fe2f415cdd0 2024-04-22T06:32:11.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.710+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f414bfb0 con 0x7fe2f415cdd0 2024-04-22T06:32:11.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.711+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f4068e40 con 0x7fe2f415cdd0 2024-04-22T06:32:11.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.712+0000 7fe2dbfff640 1 -- 172.21.15.113:0/2836738698 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2ec03e610 con 0x7fe2f415cdd0 2024-04-22T06:32:11.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.713+0000 7fe2dbfff640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe2e006c920 0x7fe2e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:11.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.713+0000 7fe2f37fe640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe2e006c920 0x7fe2e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:11.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.713+0000 7fe2dbfff640 1 -- 172.21.15.113:0/2836738698 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe2ec0ae2c0 con 0x7fe2f415cdd0 2024-04-22T06:32:11.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.713+0000 7fe2f37fe640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe2e006c920 0x7fe2e006ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009560 tx=0x7fe2e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:11.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.717+0000 7fe2dbfff640 1 -- 172.21.15.113:0/2836738698 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe2ec04e020 con 0x7fe2f415cdd0 2024-04-22T06:32:11.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.895+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2f414cdc0 con 0x7fe2e006c920 2024-04-22T06:32:11.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.902+0000 7fe2dbfff640 1 -- 172.21.15.113:0/2836738698 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332660 (secure 0 0 0) 0x7fe2f414cdc0 con 0x7fe2e006c920 2024-04-22T06:32:11.905 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:11.907 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:32:11.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe2e006c920 msgr2=0x7fe2e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe2e006c920 0x7fe2e006ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009560 tx=0x7fe2e8008040 comp rx=0 tx=0).stop 2024-04-22T06:32:11.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2f415cdd0 msgr2=0x7fe2f4149590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:11.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2f415cdd0 0x7fe2f4149590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec02c4b0 tx=0x7fe2ec004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:11.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 shutdown_connections 2024-04-22T06:32:11.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe2e006c920 0x7fe2e006ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2f415cdd0 0x7fe2f4149590 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2f40cb440 0x7fe2f4149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 --2- 172.21.15.113:0/2836738698 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe2f40c9fa0 0x7fe2f41e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:11.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 >> 172.21.15.113:0/2836738698 conn(0x7fe2f4074f30 msgr2=0x7fe2f4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:11.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.906+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 shutdown_connections 2024-04-22T06:32:11.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:11.907+0000 7fe2fa0e0640 1 -- 172.21.15.113:0/2836738698 wait complete. 2024-04-22T06:32:11.916 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-22T06:32:10.976184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3256,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3334144,"data_stored":1994876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003049"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128312+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:31:45.128312+0000","last_peered":"2024-04-22T06:31:45.128312+0000","last_clean":"2024-04-22T06:31:45.128312+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:31:45.128312+0000","last_undegraded":"2024-04-22T06:31:45.128312+0000","last_fullsized":"2024-04-22T06:31:45.128312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128419+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:31:45.128419+0000","last_peered":"2024-04-22T06:31:45.128419+0000","last_clean":"2024-04-22T06:31:45.128419+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:31:45.128419+0000","last_undegraded":"2024-04-22T06:31:45.128419+0000","last_fullsized":"2024-04-22T06:31:45.128419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128781+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:31:45.128781+0000","last_peered":"2024-04-22T06:31:45.128781+0000","last_clean":"2024-04-22T06:31:45.128781+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:31:45.128781+0000","last_undegraded":"2024-04-22T06:31:45.128781+0000","last_fullsized":"2024-04-22T06:31:45.128781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128602+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:31:45.128602+0000","last_peered":"2024-04-22T06:31:45.128602+0000","last_clean":"2024-04-22T06:31:45.128602+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:31:45.128602+0000","last_undegraded":"2024-04-22T06:31:45.128602+0000","last_fullsized":"2024-04-22T06:31:45.128602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128070+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:31:45.128070+0000","last_peered":"2024-04-22T06:31:45.128070+0000","last_clean":"2024-04-22T06:31:45.128070+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:31:45.128070+0000","last_undegraded":"2024-04-22T06:31:45.128070+0000","last_fullsized":"2024-04-22T06:31:45.128070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158824+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:31:43.158824+0000","last_peered":"2024-04-22T06:31:43.158824+0000","last_clean":"2024-04-22T06:31:43.158824+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:31:43.158824+0000","last_undegraded":"2024-04-22T06:31:43.158824+0000","last_fullsized":"2024-04-22T06:31:43.158824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025053+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:31:45.025053+0000","last_peered":"2024-04-22T06:31:45.025053+0000","last_clean":"2024-04-22T06:31:45.025053+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:31:45.025053+0000","last_undegraded":"2024-04-22T06:31:45.025053+0000","last_fullsized":"2024-04-22T06:31:45.025053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858125+0000","last_change":"2024-04-22T06:31:37.850283+0000","last_active":"2024-04-22T06:31:42.858125+0000","last_peered":"2024-04-22T06:31:42.858125+0000","last_clean":"2024-04-22T06:31:42.858125+0000","last_became_active":"2024-04-22T06:31:37.849975+0000","last_became_peered":"2024-04-22T06:31:37.849975+0000","last_unstale":"2024-04-22T06:31:42.858125+0000","last_undegraded":"2024-04-22T06:31:42.858125+0000","last_fullsized":"2024-04-22T06:31:42.858125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:50.592700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158818+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:31:43.158818+0000","last_peered":"2024-04-22T06:31:43.158818+0000","last_clean":"2024-04-22T06:31:43.158818+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:31:43.158818+0000","last_undegraded":"2024-04-22T06:31:43.158818+0000","last_fullsized":"2024-04-22T06:31:43.158818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025025+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:31:45.025025+0000","last_peered":"2024-04-22T06:31:45.025025+0000","last_clean":"2024-04-22T06:31:45.025025+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:31:45.025025+0000","last_undegraded":"2024-04-22T06:31:45.025025+0000","last_fullsized":"2024-04-22T06:31:45.025025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857546+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:31:42.857546+0000","last_peered":"2024-04-22T06:31:42.857546+0000","last_clean":"2024-04-22T06:31:42.857546+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:31:42.857546+0000","last_undegraded":"2024-04-22T06:31:42.857546+0000","last_fullsized":"2024-04-22T06:31:42.857546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158709+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:31:43.158709+0000","last_peered":"2024-04-22T06:31:43.158709+0000","last_clean":"2024-04-22T06:31:43.158709+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:31:43.158709+0000","last_undegraded":"2024-04-22T06:31:43.158709+0000","last_fullsized":"2024-04-22T06:31:43.158709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857807+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:31:42.857807+0000","last_peered":"2024-04-22T06:31:42.857807+0000","last_clean":"2024-04-22T06:31:42.857807+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:31:42.857807+0000","last_undegraded":"2024-04-22T06:31:42.857807+0000","last_fullsized":"2024-04-22T06:31:42.857807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.707054+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:32:07.707054+0000","last_peered":"2024-04-22T06:32:07.707054+0000","last_clean":"2024-04-22T06:32:07.707054+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:32:07.707054+0000","last_undegraded":"2024-04-22T06:32:07.707054+0000","last_fullsized":"2024-04-22T06:32:07.707054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159258+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:31:43.159258+0000","last_peered":"2024-04-22T06:31:43.159258+0000","last_clean":"2024-04-22T06:31:43.159258+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:31:43.159258+0000","last_undegraded":"2024-04-22T06:31:43.159258+0000","last_fullsized":"2024-04-22T06:31:43.159258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128813+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:31:45.128813+0000","last_peered":"2024-04-22T06:31:45.128813+0000","last_clean":"2024-04-22T06:31:45.128813+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:31:45.128813+0000","last_undegraded":"2024-04-22T06:31:45.128813+0000","last_fullsized":"2024-04-22T06:31:45.128813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282227+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:31:44.282227+0000","last_peered":"2024-04-22T06:31:44.282227+0000","last_clean":"2024-04-22T06:31:44.282227+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:31:44.282227+0000","last_undegraded":"2024-04-22T06:31:44.282227+0000","last_fullsized":"2024-04-22T06:31:44.282227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159037+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:31:43.159037+0000","last_peered":"2024-04-22T06:31:43.159037+0000","last_clean":"2024-04-22T06:31:43.159037+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:31:43.159037+0000","last_undegraded":"2024-04-22T06:31:43.159037+0000","last_fullsized":"2024-04-22T06:31:43.159037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129077+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:31:45.129077+0000","last_peered":"2024-04-22T06:31:45.129077+0000","last_clean":"2024-04-22T06:31:45.129077+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:31:45.129077+0000","last_undegraded":"2024-04-22T06:31:45.129077+0000","last_fullsized":"2024-04-22T06:31:45.129077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.720670+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:32:07.720670+0000","last_peered":"2024-04-22T06:32:07.720670+0000","last_clean":"2024-04-22T06:32:07.720670+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:32:07.720670+0000","last_undegraded":"2024-04-22T06:32:07.720670+0000","last_fullsized":"2024-04-22T06:32:07.720670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282535+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:31:44.282535+0000","last_peered":"2024-04-22T06:31:44.282535+0000","last_clean":"2024-04-22T06:31:44.282535+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:31:44.282535+0000","last_undegraded":"2024-04-22T06:31:44.282535+0000","last_fullsized":"2024-04-22T06:31:44.282535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158989+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:31:43.158989+0000","last_peered":"2024-04-22T06:31:43.158989+0000","last_clean":"2024-04-22T06:31:43.158989+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:31:43.158989+0000","last_undegraded":"2024-04-22T06:31:43.158989+0000","last_fullsized":"2024-04-22T06:31:43.158989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.712760+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:32:07.712760+0000","last_peered":"2024-04-22T06:32:07.712760+0000","last_clean":"2024-04-22T06:32:07.712760+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:32:07.712760+0000","last_undegraded":"2024-04-22T06:32:07.712760+0000","last_fullsized":"2024-04-22T06:32:07.712760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159260+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:31:43.159260+0000","last_peered":"2024-04-22T06:31:43.159260+0000","last_clean":"2024-04-22T06:31:43.159260+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:31:43.159260+0000","last_undegraded":"2024-04-22T06:31:43.159260+0000","last_fullsized":"2024-04-22T06:31:43.159260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127898+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:31:45.127898+0000","last_peered":"2024-04-22T06:31:45.127898+0000","last_clean":"2024-04-22T06:31:45.127898+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:31:45.127898+0000","last_undegraded":"2024-04-22T06:31:45.127898+0000","last_fullsized":"2024-04-22T06:31:45.127898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.712921+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:32:07.712921+0000","last_peered":"2024-04-22T06:32:07.712921+0000","last_clean":"2024-04-22T06:32:07.712921+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:32:07.712921+0000","last_undegraded":"2024-04-22T06:32:07.712921+0000","last_fullsized":"2024-04-22T06:32:07.712921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159079+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:31:43.159079+0000","last_peered":"2024-04-22T06:31:43.159079+0000","last_clean":"2024-04-22T06:31:43.159079+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:31:43.159079+0000","last_undegraded":"2024-04-22T06:31:43.159079+0000","last_fullsized":"2024-04-22T06:31:43.159079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128503+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:31:45.128503+0000","last_peered":"2024-04-22T06:31:45.128503+0000","last_clean":"2024-04-22T06:31:45.128503+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:31:45.128503+0000","last_undegraded":"2024-04-22T06:31:45.128503+0000","last_fullsized":"2024-04-22T06:31:45.128503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282339+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:31:44.282339+0000","last_peered":"2024-04-22T06:31:44.282339+0000","last_clean":"2024-04-22T06:31:44.282339+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:31:44.282339+0000","last_undegraded":"2024-04-22T06:31:44.282339+0000","last_fullsized":"2024-04-22T06:31:44.282339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129012+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:31:45.129012+0000","last_peered":"2024-04-22T06:31:45.129012+0000","last_clean":"2024-04-22T06:31:45.129012+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:31:45.129012+0000","last_undegraded":"2024-04-22T06:31:45.129012+0000","last_fullsized":"2024-04-22T06:31:45.129012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282322+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:31:44.282322+0000","last_peered":"2024-04-22T06:31:44.282322+0000","last_clean":"2024-04-22T06:31:44.282322+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:31:44.282322+0000","last_undegraded":"2024-04-22T06:31:44.282322+0000","last_fullsized":"2024-04-22T06:31:44.282322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025960+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:31:45.025960+0000","last_peered":"2024-04-22T06:31:45.025960+0000","last_clean":"2024-04-22T06:31:45.025960+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:31:45.025960+0000","last_undegraded":"2024-04-22T06:31:45.025960+0000","last_fullsized":"2024-04-22T06:31:45.025960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127630+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:31:45.127630+0000","last_peered":"2024-04-22T06:31:45.127630+0000","last_clean":"2024-04-22T06:31:45.127630+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:31:45.127630+0000","last_undegraded":"2024-04-22T06:31:45.127630+0000","last_fullsized":"2024-04-22T06:31:45.127630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857639+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:31:42.857639+0000","last_peered":"2024-04-22T06:31:42.857639+0000","last_clean":"2024-04-22T06:31:42.857639+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:31:42.857639+0000","last_undegraded":"2024-04-22T06:31:42.857639+0000","last_fullsized":"2024-04-22T06:31:42.857639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282396+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:31:44.282396+0000","last_peered":"2024-04-22T06:31:44.282396+0000","last_clean":"2024-04-22T06:31:44.282396+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:31:44.282396+0000","last_undegraded":"2024-04-22T06:31:44.282396+0000","last_fullsized":"2024-04-22T06:31:44.282396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282029+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:31:44.282029+0000","last_peered":"2024-04-22T06:31:44.282029+0000","last_clean":"2024-04-22T06:31:44.282029+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:31:44.282029+0000","last_undegraded":"2024-04-22T06:31:44.282029+0000","last_fullsized":"2024-04-22T06:31:44.282029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159184+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:31:43.159184+0000","last_peered":"2024-04-22T06:31:43.159184+0000","last_clean":"2024-04-22T06:31:43.159184+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:31:43.159184+0000","last_undegraded":"2024-04-22T06:31:43.159184+0000","last_fullsized":"2024-04-22T06:31:43.159184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857873+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:31:42.857873+0000","last_peered":"2024-04-22T06:31:42.857873+0000","last_clean":"2024-04-22T06:31:42.857873+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:31:42.857873+0000","last_undegraded":"2024-04-22T06:31:42.857873+0000","last_fullsized":"2024-04-22T06:31:42.857873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282276+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:31:44.282276+0000","last_peered":"2024-04-22T06:31:44.282276+0000","last_clean":"2024-04-22T06:31:44.282276+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:31:44.282276+0000","last_undegraded":"2024-04-22T06:31:44.282276+0000","last_fullsized":"2024-04-22T06:31:44.282276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281878+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:31:44.281878+0000","last_peered":"2024-04-22T06:31:44.281878+0000","last_clean":"2024-04-22T06:31:44.281878+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:31:44.281878+0000","last_undegraded":"2024-04-22T06:31:44.281878+0000","last_fullsized":"2024-04-22T06:31:44.281878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855995+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:31:42.855995+0000","last_peered":"2024-04-22T06:31:42.855995+0000","last_clean":"2024-04-22T06:31:42.855995+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:31:42.855995+0000","last_undegraded":"2024-04-22T06:31:42.855995+0000","last_fullsized":"2024-04-22T06:31:42.855995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282665+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:31:44.282665+0000","last_peered":"2024-04-22T06:31:44.282665+0000","last_clean":"2024-04-22T06:31:44.282665+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:31:44.282665+0000","last_undegraded":"2024-04-22T06:31:44.282665+0000","last_fullsized":"2024-04-22T06:31:44.282665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127311+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:31:45.127311+0000","last_peered":"2024-04-22T06:31:45.127311+0000","last_clean":"2024-04-22T06:31:45.127311+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:31:45.127311+0000","last_undegraded":"2024-04-22T06:31:45.127311+0000","last_fullsized":"2024-04-22T06:31:45.127311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025061+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:31:45.025061+0000","last_peered":"2024-04-22T06:31:45.025061+0000","last_clean":"2024-04-22T06:31:45.025061+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:31:45.025061+0000","last_undegraded":"2024-04-22T06:31:45.025061+0000","last_fullsized":"2024-04-22T06:31:45.025061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127835+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:31:45.127835+0000","last_peered":"2024-04-22T06:31:45.127835+0000","last_clean":"2024-04-22T06:31:45.127835+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:31:45.127835+0000","last_undegraded":"2024-04-22T06:31:45.127835+0000","last_fullsized":"2024-04-22T06:31:45.127835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128116+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:31:45.128116+0000","last_peered":"2024-04-22T06:31:45.128116+0000","last_clean":"2024-04-22T06:31:45.128116+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:31:45.128116+0000","last_undegraded":"2024-04-22T06:31:45.128116+0000","last_fullsized":"2024-04-22T06:31:45.128116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.713815+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:32:07.713815+0000","last_peered":"2024-04-22T06:32:07.713815+0000","last_clean":"2024-04-22T06:32:07.713815+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:32:07.713815+0000","last_undegraded":"2024-04-22T06:32:07.713815+0000","last_fullsized":"2024-04-22T06:32:07.713815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025414+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:31:45.025414+0000","last_peered":"2024-04-22T06:31:45.025414+0000","last_clean":"2024-04-22T06:31:45.025414+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:31:45.025414+0000","last_undegraded":"2024-04-22T06:31:45.025414+0000","last_fullsized":"2024-04-22T06:31:45.025414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858050+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:31:42.858050+0000","last_peered":"2024-04-22T06:31:42.858050+0000","last_clean":"2024-04-22T06:31:42.858050+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:31:42.858050+0000","last_undegraded":"2024-04-22T06:31:42.858050+0000","last_fullsized":"2024-04-22T06:31:42.858050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025766+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:31:45.025766+0000","last_peered":"2024-04-22T06:31:45.025766+0000","last_clean":"2024-04-22T06:31:45.025766+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:31:45.025766+0000","last_undegraded":"2024-04-22T06:31:45.025766+0000","last_fullsized":"2024-04-22T06:31:45.025766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856286+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:31:42.856286+0000","last_peered":"2024-04-22T06:31:42.856286+0000","last_clean":"2024-04-22T06:31:42.856286+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:31:42.856286+0000","last_undegraded":"2024-04-22T06:31:42.856286+0000","last_fullsized":"2024-04-22T06:31:42.856286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857752+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:31:42.857752+0000","last_peered":"2024-04-22T06:31:42.857752+0000","last_clean":"2024-04-22T06:31:42.857752+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:31:42.857752+0000","last_undegraded":"2024-04-22T06:31:42.857752+0000","last_fullsized":"2024-04-22T06:31:42.857752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858226+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:31:42.858226+0000","last_peered":"2024-04-22T06:31:42.858226+0000","last_clean":"2024-04-22T06:31:42.858226+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:31:42.858226+0000","last_undegraded":"2024-04-22T06:31:42.858226+0000","last_fullsized":"2024-04-22T06:31:42.858226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282329+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:31:44.282329+0000","last_peered":"2024-04-22T06:31:44.282329+0000","last_clean":"2024-04-22T06:31:44.282329+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:31:44.282329+0000","last_undegraded":"2024-04-22T06:31:44.282329+0000","last_fullsized":"2024-04-22T06:31:44.282329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127795+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:31:45.127795+0000","last_peered":"2024-04-22T06:31:45.127795+0000","last_clean":"2024-04-22T06:31:45.127795+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:31:45.127795+0000","last_undegraded":"2024-04-22T06:31:45.127795+0000","last_fullsized":"2024-04-22T06:31:45.127795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.026029+0000","last_change":"2024-04-22T06:31:37.854957+0000","last_active":"2024-04-22T06:31:45.026029+0000","last_peered":"2024-04-22T06:31:45.026029+0000","last_clean":"2024-04-22T06:31:45.026029+0000","last_became_active":"2024-04-22T06:31:37.852899+0000","last_became_peered":"2024-04-22T06:31:37.852899+0000","last_unstale":"2024-04-22T06:31:45.026029+0000","last_undegraded":"2024-04-22T06:31:45.026029+0000","last_fullsized":"2024-04-22T06:31:45.026029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:30:53.163996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856291+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:31:42.856291+0000","last_peered":"2024-04-22T06:31:42.856291+0000","last_clean":"2024-04-22T06:31:42.856291+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:31:42.856291+0000","last_undegraded":"2024-04-22T06:31:42.856291+0000","last_fullsized":"2024-04-22T06:31:42.856291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856491+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:31:42.856491+0000","last_peered":"2024-04-22T06:31:42.856491+0000","last_clean":"2024-04-22T06:31:42.856491+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:31:42.856491+0000","last_undegraded":"2024-04-22T06:31:42.856491+0000","last_fullsized":"2024-04-22T06:31:42.856491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025748+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:31:45.025748+0000","last_peered":"2024-04-22T06:31:45.025748+0000","last_clean":"2024-04-22T06:31:45.025748+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:31:45.025748+0000","last_undegraded":"2024-04-22T06:31:45.025748+0000","last_fullsized":"2024-04-22T06:31:45.025748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159360+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:31:43.159360+0000","last_peered":"2024-04-22T06:31:43.159360+0000","last_clean":"2024-04-22T06:31:43.159360+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:31:43.159360+0000","last_undegraded":"2024-04-22T06:31:43.159360+0000","last_fullsized":"2024-04-22T06:31:43.159360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158599+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:31:43.158599+0000","last_peered":"2024-04-22T06:31:43.158599+0000","last_clean":"2024-04-22T06:31:43.158599+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:31:43.158599+0000","last_undegraded":"2024-04-22T06:31:43.158599+0000","last_fullsized":"2024-04-22T06:31:43.158599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025578+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:31:45.025578+0000","last_peered":"2024-04-22T06:31:45.025578+0000","last_clean":"2024-04-22T06:31:45.025578+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:31:45.025578+0000","last_undegraded":"2024-04-22T06:31:45.025578+0000","last_fullsized":"2024-04-22T06:31:45.025578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.716161+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:32:07.716161+0000","last_peered":"2024-04-22T06:32:07.716161+0000","last_clean":"2024-04-22T06:32:07.716161+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:32:07.716161+0000","last_undegraded":"2024-04-22T06:32:07.716161+0000","last_fullsized":"2024-04-22T06:32:07.716161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127692+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:31:45.127692+0000","last_peered":"2024-04-22T06:31:45.127692+0000","last_clean":"2024-04-22T06:31:45.127692+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:31:45.127692+0000","last_undegraded":"2024-04-22T06:31:45.127692+0000","last_fullsized":"2024-04-22T06:31:45.127692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857027+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:31:42.857027+0000","last_peered":"2024-04-22T06:31:42.857027+0000","last_clean":"2024-04-22T06:31:42.857027+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:31:42.857027+0000","last_undegraded":"2024-04-22T06:31:42.857027+0000","last_fullsized":"2024-04-22T06:31:42.857027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857459+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:31:42.857459+0000","last_peered":"2024-04-22T06:31:42.857459+0000","last_clean":"2024-04-22T06:31:42.857459+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:31:42.857459+0000","last_undegraded":"2024-04-22T06:31:42.857459+0000","last_fullsized":"2024-04-22T06:31:42.857459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128617+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:31:45.128617+0000","last_peered":"2024-04-22T06:31:45.128617+0000","last_clean":"2024-04-22T06:31:45.128617+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:31:45.128617+0000","last_undegraded":"2024-04-22T06:31:45.128617+0000","last_fullsized":"2024-04-22T06:31:45.128617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025635+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:31:45.025635+0000","last_peered":"2024-04-22T06:31:45.025635+0000","last_clean":"2024-04-22T06:31:45.025635+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:31:45.025635+0000","last_undegraded":"2024-04-22T06:31:45.025635+0000","last_fullsized":"2024-04-22T06:31:45.025635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.719364+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:32:07.719364+0000","last_peered":"2024-04-22T06:32:07.719364+0000","last_clean":"2024-04-22T06:32:07.719364+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:32:07.719364+0000","last_undegraded":"2024-04-22T06:32:07.719364+0000","last_fullsized":"2024-04-22T06:32:07.719364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128726+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:31:45.128726+0000","last_peered":"2024-04-22T06:31:45.128726+0000","last_clean":"2024-04-22T06:31:45.128726+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:31:45.128726+0000","last_undegraded":"2024-04-22T06:31:45.128726+0000","last_fullsized":"2024-04-22T06:31:45.128726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127522+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:31:45.127522+0000","last_peered":"2024-04-22T06:31:45.127522+0000","last_clean":"2024-04-22T06:31:45.127522+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:31:45.127522+0000","last_undegraded":"2024-04-22T06:31:45.127522+0000","last_fullsized":"2024-04-22T06:31:45.127522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.708359+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:32:07.708359+0000","last_peered":"2024-04-22T06:32:07.708359+0000","last_clean":"2024-04-22T06:32:07.708359+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:32:07.708359+0000","last_undegraded":"2024-04-22T06:32:07.708359+0000","last_fullsized":"2024-04-22T06:32:07.708359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857582+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:31:42.857582+0000","last_peered":"2024-04-22T06:31:42.857582+0000","last_clean":"2024-04-22T06:31:42.857582+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:31:42.857582+0000","last_undegraded":"2024-04-22T06:31:42.857582+0000","last_fullsized":"2024-04-22T06:31:42.857582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025665+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:31:45.025665+0000","last_peered":"2024-04-22T06:31:45.025665+0000","last_clean":"2024-04-22T06:31:45.025665+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:31:45.025665+0000","last_undegraded":"2024-04-22T06:31:45.025665+0000","last_fullsized":"2024-04-22T06:31:45.025665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.711849+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:32:07.711849+0000","last_peered":"2024-04-22T06:32:07.711849+0000","last_clean":"2024-04-22T06:32:07.711849+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:32:07.711849+0000","last_undegraded":"2024-04-22T06:32:07.711849+0000","last_fullsized":"2024-04-22T06:32:07.711849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282326+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:31:44.282326+0000","last_peered":"2024-04-22T06:31:44.282326+0000","last_clean":"2024-04-22T06:31:44.282326+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:31:44.282326+0000","last_undegraded":"2024-04-22T06:31:44.282326+0000","last_fullsized":"2024-04-22T06:31:44.282326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159136+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:31:43.159136+0000","last_peered":"2024-04-22T06:31:43.159136+0000","last_clean":"2024-04-22T06:31:43.159136+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:31:43.159136+0000","last_undegraded":"2024-04-22T06:31:43.159136+0000","last_fullsized":"2024-04-22T06:31:43.159136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282348+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:31:44.282348+0000","last_peered":"2024-04-22T06:31:44.282348+0000","last_clean":"2024-04-22T06:31:44.282348+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:31:44.282348+0000","last_undegraded":"2024-04-22T06:31:44.282348+0000","last_fullsized":"2024-04-22T06:31:44.282348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159104+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:31:43.159104+0000","last_peered":"2024-04-22T06:31:43.159104+0000","last_clean":"2024-04-22T06:31:43.159104+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:31:43.159104+0000","last_undegraded":"2024-04-22T06:31:43.159104+0000","last_fullsized":"2024-04-22T06:31:43.159104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128227+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:31:45.128227+0000","last_peered":"2024-04-22T06:31:45.128227+0000","last_clean":"2024-04-22T06:31:45.128227+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:31:45.128227+0000","last_undegraded":"2024-04-22T06:31:45.128227+0000","last_fullsized":"2024-04-22T06:31:45.128227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.713211+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:32:07.713211+0000","last_peered":"2024-04-22T06:32:07.713211+0000","last_clean":"2024-04-22T06:32:07.713211+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:32:07.713211+0000","last_undegraded":"2024-04-22T06:32:07.713211+0000","last_fullsized":"2024-04-22T06:32:07.713211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129007+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:31:45.129007+0000","last_peered":"2024-04-22T06:31:45.129007+0000","last_clean":"2024-04-22T06:31:45.129007+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:31:45.129007+0000","last_undegraded":"2024-04-22T06:31:45.129007+0000","last_fullsized":"2024-04-22T06:31:45.129007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857776+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:31:42.857776+0000","last_peered":"2024-04-22T06:31:42.857776+0000","last_clean":"2024-04-22T06:31:42.857776+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:31:42.857776+0000","last_undegraded":"2024-04-22T06:31:42.857776+0000","last_fullsized":"2024-04-22T06:31:42.857776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.713967+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:32:07.713967+0000","last_peered":"2024-04-22T06:32:07.713967+0000","last_clean":"2024-04-22T06:32:07.713967+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:32:07.713967+0000","last_undegraded":"2024-04-22T06:32:07.713967+0000","last_fullsized":"2024-04-22T06:32:07.713967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128174+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:31:45.128174+0000","last_peered":"2024-04-22T06:31:45.128174+0000","last_clean":"2024-04-22T06:31:45.128174+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:31:45.128174+0000","last_undegraded":"2024-04-22T06:31:45.128174+0000","last_fullsized":"2024-04-22T06:31:45.128174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127735+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:31:45.127735+0000","last_peered":"2024-04-22T06:31:45.127735+0000","last_clean":"2024-04-22T06:31:45.127735+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:31:45.127735+0000","last_undegraded":"2024-04-22T06:31:45.127735+0000","last_fullsized":"2024-04-22T06:31:45.127735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281798+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:31:44.281798+0000","last_peered":"2024-04-22T06:31:44.281798+0000","last_clean":"2024-04-22T06:31:44.281798+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:31:44.281798+0000","last_undegraded":"2024-04-22T06:31:44.281798+0000","last_fullsized":"2024-04-22T06:31:44.281798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856816+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:31:42.856816+0000","last_peered":"2024-04-22T06:31:42.856816+0000","last_clean":"2024-04-22T06:31:42.856816+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:31:42.856816+0000","last_undegraded":"2024-04-22T06:31:42.856816+0000","last_fullsized":"2024-04-22T06:31:42.856816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857039+0000","last_change":"2024-04-22T06:31:41.877804+0000","last_active":"2024-04-22T06:31:42.857039+0000","last_peered":"2024-04-22T06:31:42.857039+0000","last_clean":"2024-04-22T06:31:42.857039+0000","last_became_active":"2024-04-22T06:31:41.877413+0000","last_became_peered":"2024-04-22T06:31:41.877413+0000","last_unstale":"2024-04-22T06:31:42.857039+0000","last_undegraded":"2024-04-22T06:31:42.857039+0000","last_fullsized":"2024-04-22T06:31:42.857039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129073+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:31:45.129073+0000","last_peered":"2024-04-22T06:31:45.129073+0000","last_clean":"2024-04-22T06:31:45.129073+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:31:45.129073+0000","last_undegraded":"2024-04-22T06:31:45.129073+0000","last_fullsized":"2024-04-22T06:31:45.129073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127679+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:31:45.127679+0000","last_peered":"2024-04-22T06:31:45.127679+0000","last_clean":"2024-04-22T06:31:45.127679+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:31:45.127679+0000","last_undegraded":"2024-04-22T06:31:45.127679+0000","last_fullsized":"2024-04-22T06:31:45.127679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858059+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:31:42.858059+0000","last_peered":"2024-04-22T06:31:42.858059+0000","last_clean":"2024-04-22T06:31:42.858059+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:31:42.858059+0000","last_undegraded":"2024-04-22T06:31:42.858059+0000","last_fullsized":"2024-04-22T06:31:42.858059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127969+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:31:45.127969+0000","last_peered":"2024-04-22T06:31:45.127969+0000","last_clean":"2024-04-22T06:31:45.127969+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:31:45.127969+0000","last_undegraded":"2024-04-22T06:31:45.127969+0000","last_fullsized":"2024-04-22T06:31:45.127969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856224+0000","last_change":"2024-04-22T06:31:41.881465+0000","last_active":"2024-04-22T06:31:42.856224+0000","last_peered":"2024-04-22T06:31:42.856224+0000","last_clean":"2024-04-22T06:31:42.856224+0000","last_became_active":"2024-04-22T06:31:41.881079+0000","last_became_peered":"2024-04-22T06:31:41.881079+0000","last_unstale":"2024-04-22T06:31:42.856224+0000","last_undegraded":"2024-04-22T06:31:42.856224+0000","last_fullsized":"2024-04-22T06:31:42.856224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:22.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.718658+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:32:07.718658+0000","last_peered":"2024-04-22T06:32:07.718658+0000","last_clean":"2024-04-22T06:32:07.718658+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:32:07.718658+0000","last_undegraded":"2024-04-22T06:32:07.718658+0000","last_fullsized":"2024-04-22T06:32:07.718658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158921+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:31:43.158921+0000","last_peered":"2024-04-22T06:31:43.158921+0000","last_clean":"2024-04-22T06:31:43.158921+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:31:43.158921+0000","last_undegraded":"2024-04-22T06:31:43.158921+0000","last_fullsized":"2024-04-22T06:31:43.158921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128692+0000","last_change":"2024-04-22T06:31:41.878179+0000","last_active":"2024-04-22T06:31:45.128692+0000","last_peered":"2024-04-22T06:31:45.128692+0000","last_clean":"2024-04-22T06:31:45.128692+0000","last_became_active":"2024-04-22T06:31:41.877745+0000","last_became_peered":"2024-04-22T06:31:41.877745+0000","last_unstale":"2024-04-22T06:31:45.128692+0000","last_undegraded":"2024-04-22T06:31:45.128692+0000","last_fullsized":"2024-04-22T06:31:45.128692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:12.198244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856815+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:31:42.856815+0000","last_peered":"2024-04-22T06:31:42.856815+0000","last_clean":"2024-04-22T06:31:42.856815+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:31:42.856815+0000","last_undegraded":"2024-04-22T06:31:42.856815+0000","last_fullsized":"2024-04-22T06:31:42.856815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855964+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:31:42.855964+0000","last_peered":"2024-04-22T06:31:42.855964+0000","last_clean":"2024-04-22T06:31:42.855964+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:31:42.855964+0000","last_undegraded":"2024-04-22T06:31:42.855964+0000","last_fullsized":"2024-04-22T06:31:42.855964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857763+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:31:42.857763+0000","last_peered":"2024-04-22T06:31:42.857763+0000","last_clean":"2024-04-22T06:31:42.857763+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:31:42.857763+0000","last_undegraded":"2024-04-22T06:31:42.857763+0000","last_fullsized":"2024-04-22T06:31:42.857763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127886+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:31:45.127886+0000","last_peered":"2024-04-22T06:31:45.127886+0000","last_clean":"2024-04-22T06:31:45.127886+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:31:45.127886+0000","last_undegraded":"2024-04-22T06:31:45.127886+0000","last_fullsized":"2024-04-22T06:31:45.127886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128913+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:31:45.128913+0000","last_peered":"2024-04-22T06:31:45.128913+0000","last_clean":"2024-04-22T06:31:45.128913+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:31:45.128913+0000","last_undegraded":"2024-04-22T06:31:45.128913+0000","last_fullsized":"2024-04-22T06:31:45.128913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282208+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:31:44.282208+0000","last_peered":"2024-04-22T06:31:44.282208+0000","last_clean":"2024-04-22T06:31:44.282208+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:31:44.282208+0000","last_undegraded":"2024-04-22T06:31:44.282208+0000","last_fullsized":"2024-04-22T06:31:44.282208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858025+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:31:42.858025+0000","last_peered":"2024-04-22T06:31:42.858025+0000","last_clean":"2024-04-22T06:31:42.858025+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:31:42.858025+0000","last_undegraded":"2024-04-22T06:31:42.858025+0000","last_fullsized":"2024-04-22T06:31:42.858025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128390+0000","last_change":"2024-04-22T06:31:37.849680+0000","last_active":"2024-04-22T06:31:45.128390+0000","last_peered":"2024-04-22T06:31:45.128390+0000","last_clean":"2024-04-22T06:31:45.128390+0000","last_became_active":"2024-04-22T06:31:37.849196+0000","last_became_peered":"2024-04-22T06:31:37.849196+0000","last_unstale":"2024-04-22T06:31:45.128390+0000","last_undegraded":"2024-04-22T06:31:45.128390+0000","last_fullsized":"2024-04-22T06:31:45.128390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:16:40.650719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856559+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:31:42.856559+0000","last_peered":"2024-04-22T06:31:42.856559+0000","last_clean":"2024-04-22T06:31:42.856559+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:31:42.856559+0000","last_undegraded":"2024-04-22T06:31:42.856559+0000","last_fullsized":"2024-04-22T06:31:42.856559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128430+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:31:45.128430+0000","last_peered":"2024-04-22T06:31:45.128430+0000","last_clean":"2024-04-22T06:31:45.128430+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:31:45.128430+0000","last_undegraded":"2024-04-22T06:31:45.128430+0000","last_fullsized":"2024-04-22T06:31:45.128430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857712+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:31:42.857712+0000","last_peered":"2024-04-22T06:31:42.857712+0000","last_clean":"2024-04-22T06:31:42.857712+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:31:42.857712+0000","last_undegraded":"2024-04-22T06:31:42.857712+0000","last_fullsized":"2024-04-22T06:31:42.857712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127630+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:31:45.127630+0000","last_peered":"2024-04-22T06:31:45.127630+0000","last_clean":"2024-04-22T06:31:45.127630+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:31:45.127630+0000","last_undegraded":"2024-04-22T06:31:45.127630+0000","last_fullsized":"2024-04-22T06:31:45.127630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857005+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:31:42.857005+0000","last_peered":"2024-04-22T06:31:42.857005+0000","last_clean":"2024-04-22T06:31:42.857005+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:31:42.857005+0000","last_undegraded":"2024-04-22T06:31:42.857005+0000","last_fullsized":"2024-04-22T06:31:42.857005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025893+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:31:45.025893+0000","last_peered":"2024-04-22T06:31:45.025893+0000","last_clean":"2024-04-22T06:31:45.025893+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:31:45.025893+0000","last_undegraded":"2024-04-22T06:31:45.025893+0000","last_fullsized":"2024-04-22T06:31:45.025893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856259+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:31:42.856259+0000","last_peered":"2024-04-22T06:31:42.856259+0000","last_clean":"2024-04-22T06:31:42.856259+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:31:42.856259+0000","last_undegraded":"2024-04-22T06:31:42.856259+0000","last_fullsized":"2024-04-22T06:31:42.856259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858268+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:31:42.858268+0000","last_peered":"2024-04-22T06:31:42.858268+0000","last_clean":"2024-04-22T06:31:42.858268+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:31:42.858268+0000","last_undegraded":"2024-04-22T06:31:42.858268+0000","last_fullsized":"2024-04-22T06:31:42.858268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856449+0000","last_change":"2024-04-22T06:31:37.851894+0000","last_active":"2024-04-22T06:31:42.856449+0000","last_peered":"2024-04-22T06:31:42.856449+0000","last_clean":"2024-04-22T06:31:42.856449+0000","last_became_active":"2024-04-22T06:31:37.851595+0000","last_became_peered":"2024-04-22T06:31:37.851595+0000","last_unstale":"2024-04-22T06:31:42.856449+0000","last_undegraded":"2024-04-22T06:31:42.856449+0000","last_fullsized":"2024-04-22T06:31:42.856449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:06.634700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281858+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:31:44.281858+0000","last_peered":"2024-04-22T06:31:44.281858+0000","last_clean":"2024-04-22T06:31:44.281858+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:31:44.281858+0000","last_undegraded":"2024-04-22T06:31:44.281858+0000","last_fullsized":"2024-04-22T06:31:44.281858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127492+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:31:45.127492+0000","last_peered":"2024-04-22T06:31:45.127492+0000","last_clean":"2024-04-22T06:31:45.127492+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:31:45.127492+0000","last_undegraded":"2024-04-22T06:31:45.127492+0000","last_fullsized":"2024-04-22T06:31:45.127492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128719+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:31:45.128719+0000","last_peered":"2024-04-22T06:31:45.128719+0000","last_clean":"2024-04-22T06:31:45.128719+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:31:45.128719+0000","last_undegraded":"2024-04-22T06:31:45.128719+0000","last_fullsized":"2024-04-22T06:31:45.128719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159105+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:31:43.159105+0000","last_peered":"2024-04-22T06:31:43.159105+0000","last_clean":"2024-04-22T06:31:43.159105+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:31:43.159105+0000","last_undegraded":"2024-04-22T06:31:43.159105+0000","last_fullsized":"2024-04-22T06:31:43.159105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858147+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:31:42.858147+0000","last_peered":"2024-04-22T06:31:42.858147+0000","last_clean":"2024-04-22T06:31:42.858147+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:31:42.858147+0000","last_undegraded":"2024-04-22T06:31:42.858147+0000","last_fullsized":"2024-04-22T06:31:42.858147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857952+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:31:42.857952+0000","last_peered":"2024-04-22T06:31:42.857952+0000","last_clean":"2024-04-22T06:31:42.857952+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:31:42.857952+0000","last_undegraded":"2024-04-22T06:31:42.857952+0000","last_fullsized":"2024-04-22T06:31:42.857952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025959+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:31:45.025959+0000","last_peered":"2024-04-22T06:31:45.025959+0000","last_clean":"2024-04-22T06:31:45.025959+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:31:45.025959+0000","last_undegraded":"2024-04-22T06:31:45.025959+0000","last_fullsized":"2024-04-22T06:31:45.025959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128919+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:31:45.128919+0000","last_peered":"2024-04-22T06:31:45.128919+0000","last_clean":"2024-04-22T06:31:45.128919+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:31:45.128919+0000","last_undegraded":"2024-04-22T06:31:45.128919+0000","last_fullsized":"2024-04-22T06:31:45.128919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025381+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:31:45.025381+0000","last_peered":"2024-04-22T06:31:45.025381+0000","last_clean":"2024-04-22T06:31:45.025381+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:31:45.025381+0000","last_undegraded":"2024-04-22T06:31:45.025381+0000","last_fullsized":"2024-04-22T06:31:45.025381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857644+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:31:42.857644+0000","last_peered":"2024-04-22T06:31:42.857644+0000","last_clean":"2024-04-22T06:31:42.857644+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:31:42.857644+0000","last_undegraded":"2024-04-22T06:31:42.857644+0000","last_fullsized":"2024-04-22T06:31:42.857644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025479+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:31:45.025479+0000","last_peered":"2024-04-22T06:31:45.025479+0000","last_clean":"2024-04-22T06:31:45.025479+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:31:45.025479+0000","last_undegraded":"2024-04-22T06:31:45.025479+0000","last_fullsized":"2024-04-22T06:31:45.025479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858020+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:31:42.858020+0000","last_peered":"2024-04-22T06:31:42.858020+0000","last_clean":"2024-04-22T06:31:42.858020+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:31:42.858020+0000","last_undegraded":"2024-04-22T06:31:42.858020+0000","last_fullsized":"2024-04-22T06:31:42.858020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127596+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:31:45.127596+0000","last_peered":"2024-04-22T06:31:45.127596+0000","last_clean":"2024-04-22T06:31:45.127596+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:31:45.127596+0000","last_undegraded":"2024-04-22T06:31:45.127596+0000","last_fullsized":"2024-04-22T06:31:45.127596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282236+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:31:44.282236+0000","last_peered":"2024-04-22T06:31:44.282236+0000","last_clean":"2024-04-22T06:31:44.282236+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:31:44.282236+0000","last_undegraded":"2024-04-22T06:31:44.282236+0000","last_fullsized":"2024-04-22T06:31:44.282236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025855+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:31:45.025855+0000","last_peered":"2024-04-22T06:31:45.025855+0000","last_clean":"2024-04-22T06:31:45.025855+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:31:45.025855+0000","last_undegraded":"2024-04-22T06:31:45.025855+0000","last_fullsized":"2024-04-22T06:31:45.025855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":691940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":104188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":101018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":101088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":691284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:32:11.921 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:32:12.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.055+0000 7fc62725c640 1 Processor -- start 2024-04-22T06:32:12.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.055+0000 7fc62725c640 1 -- start start 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc62725c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc6201553a0 0x7fc6200c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc62725c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc62015bb80 0x7fc6200c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc62725c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc62006c850 con 0x7fc6200c8070 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc62725c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fc62006cb30 con 0x7fc62015bb80 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc62725c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fc62006ce10 con 0x7fc6201553a0 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc6257f9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc62015bb80 0x7fc6200c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc6257f9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc62015bb80 0x7fc6200c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40180/0 (socket says 172.21.15.113:40180) 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc6257f9640 1 -- 172.21.15.113:0/1931529029 learned_addr learned my addr 172.21.15.113:0/1931529029 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:12.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.056+0000 7fc61ffff640 1 --1- 172.21.15.113:0/1931529029 >> v1:172.21.15.113:6789/0 conn(0x7fc6200c8070 0x7fc6200ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:37076/0 (socket says 172.21.15.113:37076) 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.057+0000 7fc624ff8640 1 --2- 172.21.15.113:0/1931529029 >> v2:172.21.15.145:3300/0 conn(0x7fc6201553a0 0x7fc6200c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.057+0000 7fc6257f9640 1 -- 172.21.15.113:0/1931529029 >> v2:172.21.15.145:3300/0 conn(0x7fc6201553a0 msgr2=0x7fc6200c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.057+0000 7fc6257f9640 1 --2- 172.21.15.113:0/1931529029 >> v2:172.21.15.145:3300/0 conn(0x7fc6201553a0 0x7fc6200c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.057+0000 7fc6257f9640 1 -- 172.21.15.113:0/1931529029 >> v1:172.21.15.113:6789/0 conn(0x7fc6200c8070 legacy=0x7fc6200ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.057+0000 7fc61f7fe640 1 -- 172.21.15.113:0/1931529029 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423984800 0 0) 0x7fc62006c850 con 0x7fc6200c8070 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.057+0000 7fc6257f9640 1 -- 172.21.15.113:0/1931529029 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62006d0f0 con 0x7fc62015bb80 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.057+0000 7fc6257f9640 1 --2- 172.21.15.113:0/1931529029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62015bb80 0x7fc6200c8c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc62006db00 tx=0x7fc61802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137c10c61e7280df server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc61f7fe640 1 -- 172.21.15.113:0/1931529029 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61802cbb0 con 0x7fc62015bb80 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc61f7fe640 1 -- 172.21.15.113:0/1931529029 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61802cd50 con 0x7fc62015bb80 2024-04-22T06:32:12.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc61f7fe640 1 -- 172.21.15.113:0/1931529029 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618034610 con 0x7fc62015bb80 2024-04-22T06:32:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc62725c640 1 -- 172.21.15.113:0/1931529029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62015bb80 msgr2=0x7fc6200c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc62725c640 1 --2- 172.21.15.113:0/1931529029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62015bb80 0x7fc6200c8c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc62006db00 tx=0x7fc61802c010 comp rx=0 tx=0).stop 2024-04-22T06:32:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc62725c640 1 -- 172.21.15.113:0/1931529029 shutdown_connections 2024-04-22T06:32:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc62725c640 1 --2- 172.21.15.113:0/1931529029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62015bb80 0x7fc6200c8c40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc62725c640 1 --2- 172.21.15.113:0/1931529029 >> v2:172.21.15.145:3300/0 conn(0x7fc6201553a0 0x7fc6200c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc62725c640 1 -- 172.21.15.113:0/1931529029 >> 172.21.15.113:0/1931529029 conn(0x7fc620073010 msgr2=0x7fc620073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:12.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc62725c640 1 -- 172.21.15.113:0/1931529029 shutdown_connections 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.058+0000 7fc62725c640 1 -- 172.21.15.113:0/1931529029 wait complete. 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.059+0000 7fc62725c640 1 Processor -- start 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.059+0000 7fc62725c640 1 -- start start 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc62725c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6200c8070 0x7fc6200c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc62725c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6201553a0 0x7fc6200c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc62725c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62015bb80 0x7fc62015a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc62725c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc6200cd4d0 con 0x7fc6201553a0 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc62725c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc620155780 con 0x7fc62015bb80 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc62725c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc6200cd650 con 0x7fc6200c8070 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc61ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6201553a0 0x7fc6200c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc61ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6201553a0 0x7fc6200c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40194/0 (socket says 172.21.15.113:40194) 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc61ffff640 1 -- 172.21.15.113:0/4289313893 learned_addr learned my addr 172.21.15.113:0/4289313893 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:12.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc624ff8640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6200c8070 0x7fc6200c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.060+0000 7fc6257f9640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62015bb80 0x7fc62015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61ffff640 1 -- 172.21.15.113:0/4289313893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6200c8070 msgr2=0x7fc6200c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61ffff640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6200c8070 0x7fc6200c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61ffff640 1 -- 172.21.15.113:0/4289313893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62015bb80 msgr2=0x7fc62015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61ffff640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62015bb80 0x7fc62015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61ffff640 1 -- 172.21.15.113:0/4289313893 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6201f05f0 con 0x7fc6201553a0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61ffff640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6201553a0 0x7fc6200c4750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c500 tx=0x7fc60c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61d7fa640 1 -- 172.21.15.113:0/4289313893 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c018070 con 0x7fc6201553a0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61d7fa640 1 -- 172.21.15.113:0/4289313893 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60c007580 con 0x7fc6201553a0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6200d05d0 con 0x7fc6201553a0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc61d7fa640 1 -- 172.21.15.113:0/4289313893 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c004a20 con 0x7fc6201553a0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.061+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6201f0870 con 0x7fc6201553a0 2024-04-22T06:32:12.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.062+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc620068e40 con 0x7fc6201553a0 2024-04-22T06:32:12.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.062+0000 7fc61d7fa640 1 -- 172.21.15.113:0/4289313893 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc60c01b070 con 0x7fc6201553a0 2024-04-22T06:32:12.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.063+0000 7fc61d7fa640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc60406c8f0 0x7fc60406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.063+0000 7fc61d7fa640 1 -- 172.21.15.113:0/4289313893 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc60c08b070 con 0x7fc6201553a0 2024-04-22T06:32:12.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.063+0000 7fc624ff8640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc60406c8f0 0x7fc60406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.063+0000 7fc624ff8640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc60406c8f0 0x7fc60406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc620158bc0 tx=0x7fc614009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:12.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.067+0000 7fc61d7fa640 1 -- 172.21.15.113:0/4289313893 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6201f05f0 con 0x7fc6201553a0 2024-04-22T06:32:12.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.247+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6200cd000 con 0x7fc60406c8f0 2024-04-22T06:32:12.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.255+0000 7fc61d7fa640 1 -- 172.21.15.113:0/4289313893 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332660 (secure 0 0 0) 0x7fc6200cd000 con 0x7fc60406c8f0 2024-04-22T06:32:12.257 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:12.259 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:32:12.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc60406c8f0 msgr2=0x7fc60406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc60406c8f0 0x7fc60406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc620158bc0 tx=0x7fc614009190 comp rx=0 tx=0).stop 2024-04-22T06:32:12.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6201553a0 msgr2=0x7fc6200c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6201553a0 0x7fc6200c4750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c500 tx=0x7fc60c00c9c0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 shutdown_connections 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc62015bb80 0x7fc62015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc60406c8f0 0x7fc60406edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6201553a0 0x7fc6200c4750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 --2- 172.21.15.113:0/4289313893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6200c8070 0x7fc6200c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 >> 172.21.15.113:0/4289313893 conn(0x7fc620073010 msgr2=0x7fc6200733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 shutdown_connections 2024-04-22T06:32:12.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.259+0000 7fc62725c640 1 -- 172.21.15.113:0/4289313893 wait complete. 2024-04-22T06:32:12.268 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-22T06:32:10.976184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3256,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3334144,"data_stored":1994876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003049"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128312+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:31:45.128312+0000","last_peered":"2024-04-22T06:31:45.128312+0000","last_clean":"2024-04-22T06:31:45.128312+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:31:45.128312+0000","last_undegraded":"2024-04-22T06:31:45.128312+0000","last_fullsized":"2024-04-22T06:31:45.128312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128419+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:31:45.128419+0000","last_peered":"2024-04-22T06:31:45.128419+0000","last_clean":"2024-04-22T06:31:45.128419+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:31:45.128419+0000","last_undegraded":"2024-04-22T06:31:45.128419+0000","last_fullsized":"2024-04-22T06:31:45.128419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128781+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:31:45.128781+0000","last_peered":"2024-04-22T06:31:45.128781+0000","last_clean":"2024-04-22T06:31:45.128781+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:31:45.128781+0000","last_undegraded":"2024-04-22T06:31:45.128781+0000","last_fullsized":"2024-04-22T06:31:45.128781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128602+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:31:45.128602+0000","last_peered":"2024-04-22T06:31:45.128602+0000","last_clean":"2024-04-22T06:31:45.128602+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:31:45.128602+0000","last_undegraded":"2024-04-22T06:31:45.128602+0000","last_fullsized":"2024-04-22T06:31:45.128602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128070+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:31:45.128070+0000","last_peered":"2024-04-22T06:31:45.128070+0000","last_clean":"2024-04-22T06:31:45.128070+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:31:45.128070+0000","last_undegraded":"2024-04-22T06:31:45.128070+0000","last_fullsized":"2024-04-22T06:31:45.128070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158824+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:31:43.158824+0000","last_peered":"2024-04-22T06:31:43.158824+0000","last_clean":"2024-04-22T06:31:43.158824+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:31:43.158824+0000","last_undegraded":"2024-04-22T06:31:43.158824+0000","last_fullsized":"2024-04-22T06:31:43.158824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025053+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:31:45.025053+0000","last_peered":"2024-04-22T06:31:45.025053+0000","last_clean":"2024-04-22T06:31:45.025053+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:31:45.025053+0000","last_undegraded":"2024-04-22T06:31:45.025053+0000","last_fullsized":"2024-04-22T06:31:45.025053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858125+0000","last_change":"2024-04-22T06:31:37.850283+0000","last_active":"2024-04-22T06:31:42.858125+0000","last_peered":"2024-04-22T06:31:42.858125+0000","last_clean":"2024-04-22T06:31:42.858125+0000","last_became_active":"2024-04-22T06:31:37.849975+0000","last_became_peered":"2024-04-22T06:31:37.849975+0000","last_unstale":"2024-04-22T06:31:42.858125+0000","last_undegraded":"2024-04-22T06:31:42.858125+0000","last_fullsized":"2024-04-22T06:31:42.858125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:50.592700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158818+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:31:43.158818+0000","last_peered":"2024-04-22T06:31:43.158818+0000","last_clean":"2024-04-22T06:31:43.158818+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:31:43.158818+0000","last_undegraded":"2024-04-22T06:31:43.158818+0000","last_fullsized":"2024-04-22T06:31:43.158818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025025+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:31:45.025025+0000","last_peered":"2024-04-22T06:31:45.025025+0000","last_clean":"2024-04-22T06:31:45.025025+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:31:45.025025+0000","last_undegraded":"2024-04-22T06:31:45.025025+0000","last_fullsized":"2024-04-22T06:31:45.025025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857546+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:31:42.857546+0000","last_peered":"2024-04-22T06:31:42.857546+0000","last_clean":"2024-04-22T06:31:42.857546+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:31:42.857546+0000","last_undegraded":"2024-04-22T06:31:42.857546+0000","last_fullsized":"2024-04-22T06:31:42.857546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158709+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:31:43.158709+0000","last_peered":"2024-04-22T06:31:43.158709+0000","last_clean":"2024-04-22T06:31:43.158709+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:31:43.158709+0000","last_undegraded":"2024-04-22T06:31:43.158709+0000","last_fullsized":"2024-04-22T06:31:43.158709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857807+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:31:42.857807+0000","last_peered":"2024-04-22T06:31:42.857807+0000","last_clean":"2024-04-22T06:31:42.857807+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:31:42.857807+0000","last_undegraded":"2024-04-22T06:31:42.857807+0000","last_fullsized":"2024-04-22T06:31:42.857807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.707054+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:32:07.707054+0000","last_peered":"2024-04-22T06:32:07.707054+0000","last_clean":"2024-04-22T06:32:07.707054+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:32:07.707054+0000","last_undegraded":"2024-04-22T06:32:07.707054+0000","last_fullsized":"2024-04-22T06:32:07.707054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159258+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:31:43.159258+0000","last_peered":"2024-04-22T06:31:43.159258+0000","last_clean":"2024-04-22T06:31:43.159258+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:31:43.159258+0000","last_undegraded":"2024-04-22T06:31:43.159258+0000","last_fullsized":"2024-04-22T06:31:43.159258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128813+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:31:45.128813+0000","last_peered":"2024-04-22T06:31:45.128813+0000","last_clean":"2024-04-22T06:31:45.128813+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:31:45.128813+0000","last_undegraded":"2024-04-22T06:31:45.128813+0000","last_fullsized":"2024-04-22T06:31:45.128813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282227+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:31:44.282227+0000","last_peered":"2024-04-22T06:31:44.282227+0000","last_clean":"2024-04-22T06:31:44.282227+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:31:44.282227+0000","last_undegraded":"2024-04-22T06:31:44.282227+0000","last_fullsized":"2024-04-22T06:31:44.282227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159037+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:31:43.159037+0000","last_peered":"2024-04-22T06:31:43.159037+0000","last_clean":"2024-04-22T06:31:43.159037+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:31:43.159037+0000","last_undegraded":"2024-04-22T06:31:43.159037+0000","last_fullsized":"2024-04-22T06:31:43.159037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129077+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:31:45.129077+0000","last_peered":"2024-04-22T06:31:45.129077+0000","last_clean":"2024-04-22T06:31:45.129077+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:31:45.129077+0000","last_undegraded":"2024-04-22T06:31:45.129077+0000","last_fullsized":"2024-04-22T06:31:45.129077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.720670+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:32:07.720670+0000","last_peered":"2024-04-22T06:32:07.720670+0000","last_clean":"2024-04-22T06:32:07.720670+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:32:07.720670+0000","last_undegraded":"2024-04-22T06:32:07.720670+0000","last_fullsized":"2024-04-22T06:32:07.720670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282535+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:31:44.282535+0000","last_peered":"2024-04-22T06:31:44.282535+0000","last_clean":"2024-04-22T06:31:44.282535+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:31:44.282535+0000","last_undegraded":"2024-04-22T06:31:44.282535+0000","last_fullsized":"2024-04-22T06:31:44.282535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158989+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:31:43.158989+0000","last_peered":"2024-04-22T06:31:43.158989+0000","last_clean":"2024-04-22T06:31:43.158989+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:31:43.158989+0000","last_undegraded":"2024-04-22T06:31:43.158989+0000","last_fullsized":"2024-04-22T06:31:43.158989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.712760+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:32:07.712760+0000","last_peered":"2024-04-22T06:32:07.712760+0000","last_clean":"2024-04-22T06:32:07.712760+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:32:07.712760+0000","last_undegraded":"2024-04-22T06:32:07.712760+0000","last_fullsized":"2024-04-22T06:32:07.712760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159260+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:31:43.159260+0000","last_peered":"2024-04-22T06:31:43.159260+0000","last_clean":"2024-04-22T06:31:43.159260+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:31:43.159260+0000","last_undegraded":"2024-04-22T06:31:43.159260+0000","last_fullsized":"2024-04-22T06:31:43.159260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127898+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:31:45.127898+0000","last_peered":"2024-04-22T06:31:45.127898+0000","last_clean":"2024-04-22T06:31:45.127898+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:31:45.127898+0000","last_undegraded":"2024-04-22T06:31:45.127898+0000","last_fullsized":"2024-04-22T06:31:45.127898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.712921+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:32:07.712921+0000","last_peered":"2024-04-22T06:32:07.712921+0000","last_clean":"2024-04-22T06:32:07.712921+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:32:07.712921+0000","last_undegraded":"2024-04-22T06:32:07.712921+0000","last_fullsized":"2024-04-22T06:32:07.712921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159079+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:31:43.159079+0000","last_peered":"2024-04-22T06:31:43.159079+0000","last_clean":"2024-04-22T06:31:43.159079+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:31:43.159079+0000","last_undegraded":"2024-04-22T06:31:43.159079+0000","last_fullsized":"2024-04-22T06:31:43.159079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128503+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:31:45.128503+0000","last_peered":"2024-04-22T06:31:45.128503+0000","last_clean":"2024-04-22T06:31:45.128503+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:31:45.128503+0000","last_undegraded":"2024-04-22T06:31:45.128503+0000","last_fullsized":"2024-04-22T06:31:45.128503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282339+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:31:44.282339+0000","last_peered":"2024-04-22T06:31:44.282339+0000","last_clean":"2024-04-22T06:31:44.282339+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:31:44.282339+0000","last_undegraded":"2024-04-22T06:31:44.282339+0000","last_fullsized":"2024-04-22T06:31:44.282339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129012+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:31:45.129012+0000","last_peered":"2024-04-22T06:31:45.129012+0000","last_clean":"2024-04-22T06:31:45.129012+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:31:45.129012+0000","last_undegraded":"2024-04-22T06:31:45.129012+0000","last_fullsized":"2024-04-22T06:31:45.129012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282322+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:31:44.282322+0000","last_peered":"2024-04-22T06:31:44.282322+0000","last_clean":"2024-04-22T06:31:44.282322+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:31:44.282322+0000","last_undegraded":"2024-04-22T06:31:44.282322+0000","last_fullsized":"2024-04-22T06:31:44.282322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025960+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:31:45.025960+0000","last_peered":"2024-04-22T06:31:45.025960+0000","last_clean":"2024-04-22T06:31:45.025960+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:31:45.025960+0000","last_undegraded":"2024-04-22T06:31:45.025960+0000","last_fullsized":"2024-04-22T06:31:45.025960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127630+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:31:45.127630+0000","last_peered":"2024-04-22T06:31:45.127630+0000","last_clean":"2024-04-22T06:31:45.127630+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:31:45.127630+0000","last_undegraded":"2024-04-22T06:31:45.127630+0000","last_fullsized":"2024-04-22T06:31:45.127630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857639+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:31:42.857639+0000","last_peered":"2024-04-22T06:31:42.857639+0000","last_clean":"2024-04-22T06:31:42.857639+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:31:42.857639+0000","last_undegraded":"2024-04-22T06:31:42.857639+0000","last_fullsized":"2024-04-22T06:31:42.857639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282396+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:31:44.282396+0000","last_peered":"2024-04-22T06:31:44.282396+0000","last_clean":"2024-04-22T06:31:44.282396+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:31:44.282396+0000","last_undegraded":"2024-04-22T06:31:44.282396+0000","last_fullsized":"2024-04-22T06:31:44.282396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282029+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:31:44.282029+0000","last_peered":"2024-04-22T06:31:44.282029+0000","last_clean":"2024-04-22T06:31:44.282029+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:31:44.282029+0000","last_undegraded":"2024-04-22T06:31:44.282029+0000","last_fullsized":"2024-04-22T06:31:44.282029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159184+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:31:43.159184+0000","last_peered":"2024-04-22T06:31:43.159184+0000","last_clean":"2024-04-22T06:31:43.159184+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:31:43.159184+0000","last_undegraded":"2024-04-22T06:31:43.159184+0000","last_fullsized":"2024-04-22T06:31:43.159184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857873+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:31:42.857873+0000","last_peered":"2024-04-22T06:31:42.857873+0000","last_clean":"2024-04-22T06:31:42.857873+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:31:42.857873+0000","last_undegraded":"2024-04-22T06:31:42.857873+0000","last_fullsized":"2024-04-22T06:31:42.857873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282276+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:31:44.282276+0000","last_peered":"2024-04-22T06:31:44.282276+0000","last_clean":"2024-04-22T06:31:44.282276+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:31:44.282276+0000","last_undegraded":"2024-04-22T06:31:44.282276+0000","last_fullsized":"2024-04-22T06:31:44.282276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281878+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:31:44.281878+0000","last_peered":"2024-04-22T06:31:44.281878+0000","last_clean":"2024-04-22T06:31:44.281878+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:31:44.281878+0000","last_undegraded":"2024-04-22T06:31:44.281878+0000","last_fullsized":"2024-04-22T06:31:44.281878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855995+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:31:42.855995+0000","last_peered":"2024-04-22T06:31:42.855995+0000","last_clean":"2024-04-22T06:31:42.855995+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:31:42.855995+0000","last_undegraded":"2024-04-22T06:31:42.855995+0000","last_fullsized":"2024-04-22T06:31:42.855995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282665+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:31:44.282665+0000","last_peered":"2024-04-22T06:31:44.282665+0000","last_clean":"2024-04-22T06:31:44.282665+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:31:44.282665+0000","last_undegraded":"2024-04-22T06:31:44.282665+0000","last_fullsized":"2024-04-22T06:31:44.282665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127311+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:31:45.127311+0000","last_peered":"2024-04-22T06:31:45.127311+0000","last_clean":"2024-04-22T06:31:45.127311+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:31:45.127311+0000","last_undegraded":"2024-04-22T06:31:45.127311+0000","last_fullsized":"2024-04-22T06:31:45.127311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025061+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:31:45.025061+0000","last_peered":"2024-04-22T06:31:45.025061+0000","last_clean":"2024-04-22T06:31:45.025061+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:31:45.025061+0000","last_undegraded":"2024-04-22T06:31:45.025061+0000","last_fullsized":"2024-04-22T06:31:45.025061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127835+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:31:45.127835+0000","last_peered":"2024-04-22T06:31:45.127835+0000","last_clean":"2024-04-22T06:31:45.127835+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:31:45.127835+0000","last_undegraded":"2024-04-22T06:31:45.127835+0000","last_fullsized":"2024-04-22T06:31:45.127835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128116+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:31:45.128116+0000","last_peered":"2024-04-22T06:31:45.128116+0000","last_clean":"2024-04-22T06:31:45.128116+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:31:45.128116+0000","last_undegraded":"2024-04-22T06:31:45.128116+0000","last_fullsized":"2024-04-22T06:31:45.128116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.713815+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:32:07.713815+0000","last_peered":"2024-04-22T06:32:07.713815+0000","last_clean":"2024-04-22T06:32:07.713815+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:32:07.713815+0000","last_undegraded":"2024-04-22T06:32:07.713815+0000","last_fullsized":"2024-04-22T06:32:07.713815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025414+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:31:45.025414+0000","last_peered":"2024-04-22T06:31:45.025414+0000","last_clean":"2024-04-22T06:31:45.025414+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:31:45.025414+0000","last_undegraded":"2024-04-22T06:31:45.025414+0000","last_fullsized":"2024-04-22T06:31:45.025414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858050+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:31:42.858050+0000","last_peered":"2024-04-22T06:31:42.858050+0000","last_clean":"2024-04-22T06:31:42.858050+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:31:42.858050+0000","last_undegraded":"2024-04-22T06:31:42.858050+0000","last_fullsized":"2024-04-22T06:31:42.858050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025766+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:31:45.025766+0000","last_peered":"2024-04-22T06:31:45.025766+0000","last_clean":"2024-04-22T06:31:45.025766+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:31:45.025766+0000","last_undegraded":"2024-04-22T06:31:45.025766+0000","last_fullsized":"2024-04-22T06:31:45.025766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856286+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:31:42.856286+0000","last_peered":"2024-04-22T06:31:42.856286+0000","last_clean":"2024-04-22T06:31:42.856286+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:31:42.856286+0000","last_undegraded":"2024-04-22T06:31:42.856286+0000","last_fullsized":"2024-04-22T06:31:42.856286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857752+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:31:42.857752+0000","last_peered":"2024-04-22T06:31:42.857752+0000","last_clean":"2024-04-22T06:31:42.857752+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:31:42.857752+0000","last_undegraded":"2024-04-22T06:31:42.857752+0000","last_fullsized":"2024-04-22T06:31:42.857752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858226+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:31:42.858226+0000","last_peered":"2024-04-22T06:31:42.858226+0000","last_clean":"2024-04-22T06:31:42.858226+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:31:42.858226+0000","last_undegraded":"2024-04-22T06:31:42.858226+0000","last_fullsized":"2024-04-22T06:31:42.858226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282329+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:31:44.282329+0000","last_peered":"2024-04-22T06:31:44.282329+0000","last_clean":"2024-04-22T06:31:44.282329+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:31:44.282329+0000","last_undegraded":"2024-04-22T06:31:44.282329+0000","last_fullsized":"2024-04-22T06:31:44.282329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127795+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:31:45.127795+0000","last_peered":"2024-04-22T06:31:45.127795+0000","last_clean":"2024-04-22T06:31:45.127795+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:31:45.127795+0000","last_undegraded":"2024-04-22T06:31:45.127795+0000","last_fullsized":"2024-04-22T06:31:45.127795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.026029+0000","last_change":"2024-04-22T06:31:37.854957+0000","last_active":"2024-04-22T06:31:45.026029+0000","last_peered":"2024-04-22T06:31:45.026029+0000","last_clean":"2024-04-22T06:31:45.026029+0000","last_became_active":"2024-04-22T06:31:37.852899+0000","last_became_peered":"2024-04-22T06:31:37.852899+0000","last_unstale":"2024-04-22T06:31:45.026029+0000","last_undegraded":"2024-04-22T06:31:45.026029+0000","last_fullsized":"2024-04-22T06:31:45.026029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:30:53.163996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856291+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:31:42.856291+0000","last_peered":"2024-04-22T06:31:42.856291+0000","last_clean":"2024-04-22T06:31:42.856291+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:31:42.856291+0000","last_undegraded":"2024-04-22T06:31:42.856291+0000","last_fullsized":"2024-04-22T06:31:42.856291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856491+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:31:42.856491+0000","last_peered":"2024-04-22T06:31:42.856491+0000","last_clean":"2024-04-22T06:31:42.856491+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:31:42.856491+0000","last_undegraded":"2024-04-22T06:31:42.856491+0000","last_fullsized":"2024-04-22T06:31:42.856491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025748+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:31:45.025748+0000","last_peered":"2024-04-22T06:31:45.025748+0000","last_clean":"2024-04-22T06:31:45.025748+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:31:45.025748+0000","last_undegraded":"2024-04-22T06:31:45.025748+0000","last_fullsized":"2024-04-22T06:31:45.025748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159360+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:31:43.159360+0000","last_peered":"2024-04-22T06:31:43.159360+0000","last_clean":"2024-04-22T06:31:43.159360+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:31:43.159360+0000","last_undegraded":"2024-04-22T06:31:43.159360+0000","last_fullsized":"2024-04-22T06:31:43.159360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158599+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:31:43.158599+0000","last_peered":"2024-04-22T06:31:43.158599+0000","last_clean":"2024-04-22T06:31:43.158599+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:31:43.158599+0000","last_undegraded":"2024-04-22T06:31:43.158599+0000","last_fullsized":"2024-04-22T06:31:43.158599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025578+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:31:45.025578+0000","last_peered":"2024-04-22T06:31:45.025578+0000","last_clean":"2024-04-22T06:31:45.025578+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:31:45.025578+0000","last_undegraded":"2024-04-22T06:31:45.025578+0000","last_fullsized":"2024-04-22T06:31:45.025578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.716161+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:32:07.716161+0000","last_peered":"2024-04-22T06:32:07.716161+0000","last_clean":"2024-04-22T06:32:07.716161+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:32:07.716161+0000","last_undegraded":"2024-04-22T06:32:07.716161+0000","last_fullsized":"2024-04-22T06:32:07.716161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127692+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:31:45.127692+0000","last_peered":"2024-04-22T06:31:45.127692+0000","last_clean":"2024-04-22T06:31:45.127692+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:31:45.127692+0000","last_undegraded":"2024-04-22T06:31:45.127692+0000","last_fullsized":"2024-04-22T06:31:45.127692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857027+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:31:42.857027+0000","last_peered":"2024-04-22T06:31:42.857027+0000","last_clean":"2024-04-22T06:31:42.857027+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:31:42.857027+0000","last_undegraded":"2024-04-22T06:31:42.857027+0000","last_fullsized":"2024-04-22T06:31:42.857027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857459+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:31:42.857459+0000","last_peered":"2024-04-22T06:31:42.857459+0000","last_clean":"2024-04-22T06:31:42.857459+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:31:42.857459+0000","last_undegraded":"2024-04-22T06:31:42.857459+0000","last_fullsized":"2024-04-22T06:31:42.857459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128617+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:31:45.128617+0000","last_peered":"2024-04-22T06:31:45.128617+0000","last_clean":"2024-04-22T06:31:45.128617+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:31:45.128617+0000","last_undegraded":"2024-04-22T06:31:45.128617+0000","last_fullsized":"2024-04-22T06:31:45.128617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025635+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:31:45.025635+0000","last_peered":"2024-04-22T06:31:45.025635+0000","last_clean":"2024-04-22T06:31:45.025635+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:31:45.025635+0000","last_undegraded":"2024-04-22T06:31:45.025635+0000","last_fullsized":"2024-04-22T06:31:45.025635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.719364+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:32:07.719364+0000","last_peered":"2024-04-22T06:32:07.719364+0000","last_clean":"2024-04-22T06:32:07.719364+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:32:07.719364+0000","last_undegraded":"2024-04-22T06:32:07.719364+0000","last_fullsized":"2024-04-22T06:32:07.719364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128726+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:31:45.128726+0000","last_peered":"2024-04-22T06:31:45.128726+0000","last_clean":"2024-04-22T06:31:45.128726+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:31:45.128726+0000","last_undegraded":"2024-04-22T06:31:45.128726+0000","last_fullsized":"2024-04-22T06:31:45.128726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127522+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:31:45.127522+0000","last_peered":"2024-04-22T06:31:45.127522+0000","last_clean":"2024-04-22T06:31:45.127522+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:31:45.127522+0000","last_undegraded":"2024-04-22T06:31:45.127522+0000","last_fullsized":"2024-04-22T06:31:45.127522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.708359+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:32:07.708359+0000","last_peered":"2024-04-22T06:32:07.708359+0000","last_clean":"2024-04-22T06:32:07.708359+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:32:07.708359+0000","last_undegraded":"2024-04-22T06:32:07.708359+0000","last_fullsized":"2024-04-22T06:32:07.708359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857582+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:31:42.857582+0000","last_peered":"2024-04-22T06:31:42.857582+0000","last_clean":"2024-04-22T06:31:42.857582+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:31:42.857582+0000","last_undegraded":"2024-04-22T06:31:42.857582+0000","last_fullsized":"2024-04-22T06:31:42.857582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025665+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:31:45.025665+0000","last_peered":"2024-04-22T06:31:45.025665+0000","last_clean":"2024-04-22T06:31:45.025665+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:31:45.025665+0000","last_undegraded":"2024-04-22T06:31:45.025665+0000","last_fullsized":"2024-04-22T06:31:45.025665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.711849+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:32:07.711849+0000","last_peered":"2024-04-22T06:32:07.711849+0000","last_clean":"2024-04-22T06:32:07.711849+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:32:07.711849+0000","last_undegraded":"2024-04-22T06:32:07.711849+0000","last_fullsized":"2024-04-22T06:32:07.711849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282326+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:31:44.282326+0000","last_peered":"2024-04-22T06:31:44.282326+0000","last_clean":"2024-04-22T06:31:44.282326+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:31:44.282326+0000","last_undegraded":"2024-04-22T06:31:44.282326+0000","last_fullsized":"2024-04-22T06:31:44.282326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159136+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:31:43.159136+0000","last_peered":"2024-04-22T06:31:43.159136+0000","last_clean":"2024-04-22T06:31:43.159136+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:31:43.159136+0000","last_undegraded":"2024-04-22T06:31:43.159136+0000","last_fullsized":"2024-04-22T06:31:43.159136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282348+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:31:44.282348+0000","last_peered":"2024-04-22T06:31:44.282348+0000","last_clean":"2024-04-22T06:31:44.282348+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:31:44.282348+0000","last_undegraded":"2024-04-22T06:31:44.282348+0000","last_fullsized":"2024-04-22T06:31:44.282348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159104+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:31:43.159104+0000","last_peered":"2024-04-22T06:31:43.159104+0000","last_clean":"2024-04-22T06:31:43.159104+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:31:43.159104+0000","last_undegraded":"2024-04-22T06:31:43.159104+0000","last_fullsized":"2024-04-22T06:31:43.159104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128227+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:31:45.128227+0000","last_peered":"2024-04-22T06:31:45.128227+0000","last_clean":"2024-04-22T06:31:45.128227+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:31:45.128227+0000","last_undegraded":"2024-04-22T06:31:45.128227+0000","last_fullsized":"2024-04-22T06:31:45.128227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.713211+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:32:07.713211+0000","last_peered":"2024-04-22T06:32:07.713211+0000","last_clean":"2024-04-22T06:32:07.713211+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:32:07.713211+0000","last_undegraded":"2024-04-22T06:32:07.713211+0000","last_fullsized":"2024-04-22T06:32:07.713211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129007+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:31:45.129007+0000","last_peered":"2024-04-22T06:31:45.129007+0000","last_clean":"2024-04-22T06:31:45.129007+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:31:45.129007+0000","last_undegraded":"2024-04-22T06:31:45.129007+0000","last_fullsized":"2024-04-22T06:31:45.129007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857776+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:31:42.857776+0000","last_peered":"2024-04-22T06:31:42.857776+0000","last_clean":"2024-04-22T06:31:42.857776+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:31:42.857776+0000","last_undegraded":"2024-04-22T06:31:42.857776+0000","last_fullsized":"2024-04-22T06:31:42.857776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.713967+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:32:07.713967+0000","last_peered":"2024-04-22T06:32:07.713967+0000","last_clean":"2024-04-22T06:32:07.713967+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:32:07.713967+0000","last_undegraded":"2024-04-22T06:32:07.713967+0000","last_fullsized":"2024-04-22T06:32:07.713967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128174+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:31:45.128174+0000","last_peered":"2024-04-22T06:31:45.128174+0000","last_clean":"2024-04-22T06:31:45.128174+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:31:45.128174+0000","last_undegraded":"2024-04-22T06:31:45.128174+0000","last_fullsized":"2024-04-22T06:31:45.128174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127735+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:31:45.127735+0000","last_peered":"2024-04-22T06:31:45.127735+0000","last_clean":"2024-04-22T06:31:45.127735+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:31:45.127735+0000","last_undegraded":"2024-04-22T06:31:45.127735+0000","last_fullsized":"2024-04-22T06:31:45.127735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281798+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:31:44.281798+0000","last_peered":"2024-04-22T06:31:44.281798+0000","last_clean":"2024-04-22T06:31:44.281798+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:31:44.281798+0000","last_undegraded":"2024-04-22T06:31:44.281798+0000","last_fullsized":"2024-04-22T06:31:44.281798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856816+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:31:42.856816+0000","last_peered":"2024-04-22T06:31:42.856816+0000","last_clean":"2024-04-22T06:31:42.856816+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:31:42.856816+0000","last_undegraded":"2024-04-22T06:31:42.856816+0000","last_fullsized":"2024-04-22T06:31:42.856816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857039+0000","last_change":"2024-04-22T06:31:41.877804+0000","last_active":"2024-04-22T06:31:42.857039+0000","last_peered":"2024-04-22T06:31:42.857039+0000","last_clean":"2024-04-22T06:31:42.857039+0000","last_became_active":"2024-04-22T06:31:41.877413+0000","last_became_peered":"2024-04-22T06:31:41.877413+0000","last_unstale":"2024-04-22T06:31:42.857039+0000","last_undegraded":"2024-04-22T06:31:42.857039+0000","last_fullsized":"2024-04-22T06:31:42.857039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.129073+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:31:45.129073+0000","last_peered":"2024-04-22T06:31:45.129073+0000","last_clean":"2024-04-22T06:31:45.129073+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:31:45.129073+0000","last_undegraded":"2024-04-22T06:31:45.129073+0000","last_fullsized":"2024-04-22T06:31:45.129073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127679+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:31:45.127679+0000","last_peered":"2024-04-22T06:31:45.127679+0000","last_clean":"2024-04-22T06:31:45.127679+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:31:45.127679+0000","last_undegraded":"2024-04-22T06:31:45.127679+0000","last_fullsized":"2024-04-22T06:31:45.127679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858059+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:31:42.858059+0000","last_peered":"2024-04-22T06:31:42.858059+0000","last_clean":"2024-04-22T06:31:42.858059+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:31:42.858059+0000","last_undegraded":"2024-04-22T06:31:42.858059+0000","last_fullsized":"2024-04-22T06:31:42.858059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127969+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:31:45.127969+0000","last_peered":"2024-04-22T06:31:45.127969+0000","last_clean":"2024-04-22T06:31:45.127969+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:31:45.127969+0000","last_undegraded":"2024-04-22T06:31:45.127969+0000","last_fullsized":"2024-04-22T06:31:45.127969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856224+0000","last_change":"2024-04-22T06:31:41.881465+0000","last_active":"2024-04-22T06:31:42.856224+0000","last_peered":"2024-04-22T06:31:42.856224+0000","last_clean":"2024-04-22T06:31:42.856224+0000","last_became_active":"2024-04-22T06:31:41.881079+0000","last_became_peered":"2024-04-22T06:31:41.881079+0000","last_unstale":"2024-04-22T06:31:42.856224+0000","last_undegraded":"2024-04-22T06:31:42.856224+0000","last_fullsized":"2024-04-22T06:31:42.856224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:22.486406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:32:07.718658+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:32:07.718658+0000","last_peered":"2024-04-22T06:32:07.718658+0000","last_clean":"2024-04-22T06:32:07.718658+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:32:07.718658+0000","last_undegraded":"2024-04-22T06:32:07.718658+0000","last_fullsized":"2024-04-22T06:32:07.718658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.158921+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:31:43.158921+0000","last_peered":"2024-04-22T06:31:43.158921+0000","last_clean":"2024-04-22T06:31:43.158921+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:31:43.158921+0000","last_undegraded":"2024-04-22T06:31:43.158921+0000","last_fullsized":"2024-04-22T06:31:43.158921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128692+0000","last_change":"2024-04-22T06:31:41.878179+0000","last_active":"2024-04-22T06:31:45.128692+0000","last_peered":"2024-04-22T06:31:45.128692+0000","last_clean":"2024-04-22T06:31:45.128692+0000","last_became_active":"2024-04-22T06:31:41.877745+0000","last_became_peered":"2024-04-22T06:31:41.877745+0000","last_unstale":"2024-04-22T06:31:45.128692+0000","last_undegraded":"2024-04-22T06:31:45.128692+0000","last_fullsized":"2024-04-22T06:31:45.128692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:12.198244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856815+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:31:42.856815+0000","last_peered":"2024-04-22T06:31:42.856815+0000","last_clean":"2024-04-22T06:31:42.856815+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:31:42.856815+0000","last_undegraded":"2024-04-22T06:31:42.856815+0000","last_fullsized":"2024-04-22T06:31:42.856815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.855964+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:31:42.855964+0000","last_peered":"2024-04-22T06:31:42.855964+0000","last_clean":"2024-04-22T06:31:42.855964+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:31:42.855964+0000","last_undegraded":"2024-04-22T06:31:42.855964+0000","last_fullsized":"2024-04-22T06:31:42.855964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857763+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:31:42.857763+0000","last_peered":"2024-04-22T06:31:42.857763+0000","last_clean":"2024-04-22T06:31:42.857763+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:31:42.857763+0000","last_undegraded":"2024-04-22T06:31:42.857763+0000","last_fullsized":"2024-04-22T06:31:42.857763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127886+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:31:45.127886+0000","last_peered":"2024-04-22T06:31:45.127886+0000","last_clean":"2024-04-22T06:31:45.127886+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:31:45.127886+0000","last_undegraded":"2024-04-22T06:31:45.127886+0000","last_fullsized":"2024-04-22T06:31:45.127886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128913+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:31:45.128913+0000","last_peered":"2024-04-22T06:31:45.128913+0000","last_clean":"2024-04-22T06:31:45.128913+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:31:45.128913+0000","last_undegraded":"2024-04-22T06:31:45.128913+0000","last_fullsized":"2024-04-22T06:31:45.128913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282208+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:31:44.282208+0000","last_peered":"2024-04-22T06:31:44.282208+0000","last_clean":"2024-04-22T06:31:44.282208+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:31:44.282208+0000","last_undegraded":"2024-04-22T06:31:44.282208+0000","last_fullsized":"2024-04-22T06:31:44.282208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858025+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:31:42.858025+0000","last_peered":"2024-04-22T06:31:42.858025+0000","last_clean":"2024-04-22T06:31:42.858025+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:31:42.858025+0000","last_undegraded":"2024-04-22T06:31:42.858025+0000","last_fullsized":"2024-04-22T06:31:42.858025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128390+0000","last_change":"2024-04-22T06:31:37.849680+0000","last_active":"2024-04-22T06:31:45.128390+0000","last_peered":"2024-04-22T06:31:45.128390+0000","last_clean":"2024-04-22T06:31:45.128390+0000","last_became_active":"2024-04-22T06:31:37.849196+0000","last_became_peered":"2024-04-22T06:31:37.849196+0000","last_unstale":"2024-04-22T06:31:45.128390+0000","last_undegraded":"2024-04-22T06:31:45.128390+0000","last_fullsized":"2024-04-22T06:31:45.128390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:16:40.650719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856559+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:31:42.856559+0000","last_peered":"2024-04-22T06:31:42.856559+0000","last_clean":"2024-04-22T06:31:42.856559+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:31:42.856559+0000","last_undegraded":"2024-04-22T06:31:42.856559+0000","last_fullsized":"2024-04-22T06:31:42.856559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128430+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:31:45.128430+0000","last_peered":"2024-04-22T06:31:45.128430+0000","last_clean":"2024-04-22T06:31:45.128430+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:31:45.128430+0000","last_undegraded":"2024-04-22T06:31:45.128430+0000","last_fullsized":"2024-04-22T06:31:45.128430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857712+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:31:42.857712+0000","last_peered":"2024-04-22T06:31:42.857712+0000","last_clean":"2024-04-22T06:31:42.857712+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:31:42.857712+0000","last_undegraded":"2024-04-22T06:31:42.857712+0000","last_fullsized":"2024-04-22T06:31:42.857712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127630+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:31:45.127630+0000","last_peered":"2024-04-22T06:31:45.127630+0000","last_clean":"2024-04-22T06:31:45.127630+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:31:45.127630+0000","last_undegraded":"2024-04-22T06:31:45.127630+0000","last_fullsized":"2024-04-22T06:31:45.127630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857005+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:31:42.857005+0000","last_peered":"2024-04-22T06:31:42.857005+0000","last_clean":"2024-04-22T06:31:42.857005+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:31:42.857005+0000","last_undegraded":"2024-04-22T06:31:42.857005+0000","last_fullsized":"2024-04-22T06:31:42.857005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025893+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:31:45.025893+0000","last_peered":"2024-04-22T06:31:45.025893+0000","last_clean":"2024-04-22T06:31:45.025893+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:31:45.025893+0000","last_undegraded":"2024-04-22T06:31:45.025893+0000","last_fullsized":"2024-04-22T06:31:45.025893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856259+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:31:42.856259+0000","last_peered":"2024-04-22T06:31:42.856259+0000","last_clean":"2024-04-22T06:31:42.856259+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:31:42.856259+0000","last_undegraded":"2024-04-22T06:31:42.856259+0000","last_fullsized":"2024-04-22T06:31:42.856259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858268+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:31:42.858268+0000","last_peered":"2024-04-22T06:31:42.858268+0000","last_clean":"2024-04-22T06:31:42.858268+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:31:42.858268+0000","last_undegraded":"2024-04-22T06:31:42.858268+0000","last_fullsized":"2024-04-22T06:31:42.858268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.856449+0000","last_change":"2024-04-22T06:31:37.851894+0000","last_active":"2024-04-22T06:31:42.856449+0000","last_peered":"2024-04-22T06:31:42.856449+0000","last_clean":"2024-04-22T06:31:42.856449+0000","last_became_active":"2024-04-22T06:31:37.851595+0000","last_became_peered":"2024-04-22T06:31:37.851595+0000","last_unstale":"2024-04-22T06:31:42.856449+0000","last_undegraded":"2024-04-22T06:31:42.856449+0000","last_fullsized":"2024-04-22T06:31:42.856449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:06.634700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.281858+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:31:44.281858+0000","last_peered":"2024-04-22T06:31:44.281858+0000","last_clean":"2024-04-22T06:31:44.281858+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:31:44.281858+0000","last_undegraded":"2024-04-22T06:31:44.281858+0000","last_fullsized":"2024-04-22T06:31:44.281858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127492+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:31:45.127492+0000","last_peered":"2024-04-22T06:31:45.127492+0000","last_clean":"2024-04-22T06:31:45.127492+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:31:45.127492+0000","last_undegraded":"2024-04-22T06:31:45.127492+0000","last_fullsized":"2024-04-22T06:31:45.127492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128719+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:31:45.128719+0000","last_peered":"2024-04-22T06:31:45.128719+0000","last_clean":"2024-04-22T06:31:45.128719+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:31:45.128719+0000","last_undegraded":"2024-04-22T06:31:45.128719+0000","last_fullsized":"2024-04-22T06:31:45.128719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:43.159105+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:31:43.159105+0000","last_peered":"2024-04-22T06:31:43.159105+0000","last_clean":"2024-04-22T06:31:43.159105+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:31:43.159105+0000","last_undegraded":"2024-04-22T06:31:43.159105+0000","last_fullsized":"2024-04-22T06:31:43.159105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858147+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:31:42.858147+0000","last_peered":"2024-04-22T06:31:42.858147+0000","last_clean":"2024-04-22T06:31:42.858147+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:31:42.858147+0000","last_undegraded":"2024-04-22T06:31:42.858147+0000","last_fullsized":"2024-04-22T06:31:42.858147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857952+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:31:42.857952+0000","last_peered":"2024-04-22T06:31:42.857952+0000","last_clean":"2024-04-22T06:31:42.857952+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:31:42.857952+0000","last_undegraded":"2024-04-22T06:31:42.857952+0000","last_fullsized":"2024-04-22T06:31:42.857952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025959+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:31:45.025959+0000","last_peered":"2024-04-22T06:31:45.025959+0000","last_clean":"2024-04-22T06:31:45.025959+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:31:45.025959+0000","last_undegraded":"2024-04-22T06:31:45.025959+0000","last_fullsized":"2024-04-22T06:31:45.025959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.128919+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:31:45.128919+0000","last_peered":"2024-04-22T06:31:45.128919+0000","last_clean":"2024-04-22T06:31:45.128919+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:31:45.128919+0000","last_undegraded":"2024-04-22T06:31:45.128919+0000","last_fullsized":"2024-04-22T06:31:45.128919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025381+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:31:45.025381+0000","last_peered":"2024-04-22T06:31:45.025381+0000","last_clean":"2024-04-22T06:31:45.025381+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:31:45.025381+0000","last_undegraded":"2024-04-22T06:31:45.025381+0000","last_fullsized":"2024-04-22T06:31:45.025381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.857644+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:31:42.857644+0000","last_peered":"2024-04-22T06:31:42.857644+0000","last_clean":"2024-04-22T06:31:42.857644+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:31:42.857644+0000","last_undegraded":"2024-04-22T06:31:42.857644+0000","last_fullsized":"2024-04-22T06:31:42.857644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025479+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:31:45.025479+0000","last_peered":"2024-04-22T06:31:45.025479+0000","last_clean":"2024-04-22T06:31:45.025479+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:31:45.025479+0000","last_undegraded":"2024-04-22T06:31:45.025479+0000","last_fullsized":"2024-04-22T06:31:45.025479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:42.858020+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:31:42.858020+0000","last_peered":"2024-04-22T06:31:42.858020+0000","last_clean":"2024-04-22T06:31:42.858020+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:31:42.858020+0000","last_undegraded":"2024-04-22T06:31:42.858020+0000","last_fullsized":"2024-04-22T06:31:42.858020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.127596+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:31:45.127596+0000","last_peered":"2024-04-22T06:31:45.127596+0000","last_clean":"2024-04-22T06:31:45.127596+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:31:45.127596+0000","last_undegraded":"2024-04-22T06:31:45.127596+0000","last_fullsized":"2024-04-22T06:31:45.127596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:44.282236+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:31:44.282236+0000","last_peered":"2024-04-22T06:31:44.282236+0000","last_clean":"2024-04-22T06:31:44.282236+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:31:44.282236+0000","last_undegraded":"2024-04-22T06:31:44.282236+0000","last_fullsized":"2024-04-22T06:31:44.282236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-22T06:31:45.025855+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:31:45.025855+0000","last_peered":"2024-04-22T06:31:45.025855+0000","last_clean":"2024-04-22T06:31:45.025855+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:31:45.025855+0000","last_undegraded":"2024-04-22T06:31:45.025855+0000","last_fullsized":"2024-04-22T06:31:45.025855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":691940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":104188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":101018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":101088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":691284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:32:12.273 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T06:32:12.273 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-22T06:32:12.273 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-22T06:32:12.273 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-22T06:32:12.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.406+0000 7f6a132eb640 1 Processor -- start 2024-04-22T06:32:12.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.406+0000 7f6a132eb640 1 -- start start 2024-04-22T06:32:12.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a132eb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6a0c151f90 0x7f6a0c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a132eb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a0c072bd0 0x7f6a0c073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a132eb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c070630 0x7f6a0c06f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a132eb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f6a0c0736a0 con 0x7f6a0c072bd0 2024-04-22T06:32:12.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a132eb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f6a0c15b9b0 con 0x7f6a0c151f90 2024-04-22T06:32:12.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a132eb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0c15bc90 con 0x7f6a0c070630 2024-04-22T06:32:12.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a10886640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a0c072bd0 0x7f6a0c073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a10886640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6a0c072bd0 0x7f6a0c073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40210/0 (socket says 172.21.15.113:40210) 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.407+0000 7f6a10886640 1 -- 172.21.15.113:0/1046286777 learned_addr learned my addr 172.21.15.113:0/1046286777 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.408+0000 7f6a11087640 1 --2- 172.21.15.113:0/1046286777 >> v2:172.21.15.145:3300/0 conn(0x7f6a0c151f90 0x7f6a0c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.408+0000 7f6a11888640 1 --2- 172.21.15.113:0/1046286777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c070630 0x7f6a0c06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.408+0000 7f6a10886640 1 -- 172.21.15.113:0/1046286777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c070630 msgr2=0x7f6a0c06f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.408+0000 7f6a10886640 1 --2- 172.21.15.113:0/1046286777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c070630 0x7f6a0c06f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.408+0000 7f6a10886640 1 -- 172.21.15.113:0/1046286777 >> v2:172.21.15.145:3300/0 conn(0x7f6a0c151f90 msgr2=0x7f6a0c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.408+0000 7f6a10886640 1 --2- 172.21.15.113:0/1046286777 >> v2:172.21.15.145:3300/0 conn(0x7f6a0c151f90 0x7f6a0c15b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.408+0000 7f6a10886640 1 -- 172.21.15.113:0/1046286777 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c15bf70 con 0x7f6a0c072bd0 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.408+0000 7f6a10886640 1 --2- 172.21.15.113:0/1046286777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c072bd0 0x7f6a0c073b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c071880 tx=0x7f6a0802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb72eec1ff6a1e23 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a03fff640 1 -- 172.21.15.113:0/1046286777 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08034070 con 0x7f6a0c072bd0 2024-04-22T06:32:12.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a03fff640 1 -- 172.21.15.113:0/1046286777 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a08030860 con 0x7f6a0c072bd0 2024-04-22T06:32:12.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a03fff640 1 -- 172.21.15.113:0/1046286777 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08030c30 con 0x7f6a0c072bd0 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 -- 172.21.15.113:0/1046286777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c072bd0 msgr2=0x7f6a0c073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 --2- 172.21.15.113:0/1046286777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c072bd0 0x7f6a0c073b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c071880 tx=0x7f6a0802b9a0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 -- 172.21.15.113:0/1046286777 shutdown_connections 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 --2- 172.21.15.113:0/1046286777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c070630 0x7f6a0c06f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 --2- 172.21.15.113:0/1046286777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c072bd0 0x7f6a0c073b30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 --2- 172.21.15.113:0/1046286777 >> v2:172.21.15.145:3300/0 conn(0x7f6a0c151f90 0x7f6a0c15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 -- 172.21.15.113:0/1046286777 >> 172.21.15.113:0/1046286777 conn(0x7f6a0c0ca0d0 msgr2=0x7f6a0c0ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 -- 172.21.15.113:0/1046286777 shutdown_connections 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.409+0000 7f6a132eb640 1 -- 172.21.15.113:0/1046286777 wait complete. 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.410+0000 7f6a132eb640 1 Processor -- start 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.410+0000 7f6a132eb640 1 -- start start 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a132eb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c070630 0x7f6a0c15a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a132eb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a0c072bd0 0x7f6a0c0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a132eb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c151f90 0x7f6a0c158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a132eb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c152370 con 0x7f6a0c070630 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a132eb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c0c7fd0 con 0x7f6a0c072bd0 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a132eb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0c1524f0 con 0x7f6a0c151f90 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11087640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c070630 0x7f6a0c15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11087640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c070630 0x7f6a0c15a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40218/0 (socket says 172.21.15.113:40218) 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11087640 1 -- 172.21.15.113:0/4100422566 learned_addr learned my addr 172.21.15.113:0/4100422566 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a10886640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a0c072bd0 0x7f6a0c0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11888640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c151f90 0x7f6a0c158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11087640 1 -- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c151f90 msgr2=0x7f6a0c158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11087640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c151f90 0x7f6a0c158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11087640 1 -- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a0c072bd0 msgr2=0x7f6a0c0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11087640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a0c072bd0 0x7f6a0c0c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11087640 1 -- 172.21.15.113:0/4100422566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c15a330 con 0x7f6a0c070630 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a11888640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c151f90 0x7f6a0c158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.411+0000 7f6a10886640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a0c072bd0 0x7f6a0c0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.412+0000 7f6a11087640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c070630 0x7f6a0c15a580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e870 tx=0x7f69fc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.412+0000 7f6a01ffb640 1 -- 172.21.15.113:0/4100422566 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc017070 con 0x7f6a0c070630 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.412+0000 7f6a01ffb640 1 -- 172.21.15.113:0/4100422566 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc00c940 con 0x7f6a0c070630 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.412+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c15a050 con 0x7f6a0c070630 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.412+0000 7f6a01ffb640 1 -- 172.21.15.113:0/4100422566 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00cd30 con 0x7f6a0c070630 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.412+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c0c6dd0 con 0x7f6a0c070630 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.413+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c1508e0 con 0x7f6a0c070630 2024-04-22T06:32:12.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.414+0000 7f6a01ffb640 1 -- 172.21.15.113:0/4100422566 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f69fc01a070 con 0x7f6a0c070630 2024-04-22T06:32:12.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.414+0000 7f6a01ffb640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f69f006c8f0 0x7f69f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:12.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.414+0000 7f6a10886640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f69f006c8f0 0x7f69f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:12.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.414+0000 7f6a01ffb640 1 -- 172.21.15.113:0/4100422566 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f69fc08bd60 con 0x7f6a0c070630 2024-04-22T06:32:12.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.415+0000 7f6a10886640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f69f006c8f0 0x7f69f006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a08036000 tx=0x7f6a0803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:12.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.419+0000 7f6a01ffb640 1 -- 172.21.15.113:0/4100422566 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a0c1508e0 con 0x7f6a0c070630 2024-04-22T06:32:12.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.639+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6a0c068e40 con 0x7f6a0c070630 2024-04-22T06:32:12.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.640+0000 7f6a01ffb640 1 -- 172.21.15.113:0/4100422566 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f69fc059e50 con 0x7f6a0c070630 2024-04-22T06:32:12.638 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:12.638 INFO:teuthology.orchestra.run.smithi113.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-22T06:32:12.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.641+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f69f006c8f0 msgr2=0x7f69f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.641+0000 7f6a132eb640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f69f006c8f0 0x7f69f006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a08036000 tx=0x7f6a0803b040 comp rx=0 tx=0).stop 2024-04-22T06:32:12.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.641+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c070630 msgr2=0x7f6a0c15a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c070630 0x7f6a0c15a580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e870 tx=0x7f69fc00ed30 comp rx=0 tx=0).stop 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 shutdown_connections 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a0c151f90 0x7f6a0c158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a0c072bd0 0x7f6a0c0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f69f006c8f0 0x7f69f006edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 --2- 172.21.15.113:0/4100422566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a0c070630 0x7f6a0c15a580 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 >> 172.21.15.113:0/4100422566 conn(0x7f6a0c0ca0d0 msgr2=0x7f6a0c147020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 shutdown_connections 2024-04-22T06:32:12.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:12.642+0000 7f6a132eb640 1 -- 172.21.15.113:0/4100422566 wait complete. 2024-04-22T06:32:15.652 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-22T06:32:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.750+0000 7fb4fa9e6640 1 Processor -- start 2024-04-22T06:32:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.750+0000 7fb4fa9e6640 1 -- start start 2024-04-22T06:32:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.751+0000 7fb4fa9e6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4f40ca220 0x7fb4f40ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.751+0000 7fb4fa9e6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f406bd40 con 0x7fb4f40c9aa0 2024-04-22T06:32:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.751+0000 7fb4fa9e6640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f406c020 con 0x7fb4f4155250 2024-04-22T06:32:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.751+0000 7fb4fa9e6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f415b160 con 0x7fb4f40ca220 2024-04-22T06:32:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.751+0000 7fb4f8f83640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4f40ca220 0x7fb4f40ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.751+0000 7fb4f8f83640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4f40ca220 0x7fb4f40ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40232/0 (socket says 172.21.15.113:40232) 2024-04-22T06:32:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.751+0000 7fb4f8f83640 1 -- 172.21.15.113:0/3940215551 learned_addr learned my addr 172.21.15.113:0/3940215551 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.752+0000 7fb4f8f83640 1 -- 172.21.15.113:0/3940215551 >> v1:172.21.15.145:6789/0 conn(0x7fb4f4155250 legacy=0x7fb4f40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.752+0000 7fb4f8f83640 1 -- 172.21.15.113:0/3940215551 >> v1:172.21.15.113:6789/0 conn(0x7fb4f40c9aa0 legacy=0x7fb4f41639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.752+0000 7fb4f2ffd640 1 -- 172.21.15.113:0/3940215551 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250242581 0 0) 0x7fb4f406bd40 con 0x7fb4f40c9aa0 2024-04-22T06:32:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.752+0000 7fb4f8f83640 1 -- 172.21.15.113:0/3940215551 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f415b440 con 0x7fb4f40ca220 2024-04-22T06:32:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4f8f83640 1 --2- 172.21.15.113:0/3940215551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f40ca770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009e50 tx=0x7fb4ec02c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a94ed0f44714c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4f2ffd640 1 -- 172.21.15.113:0/3940215551 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec02cc30 con 0x7fb4f40ca220 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4f2ffd640 1 -- 172.21.15.113:0/3940215551 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ec02cdd0 con 0x7fb4f40ca220 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4f2ffd640 1 -- 172.21.15.113:0/3940215551 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec034610 con 0x7fb4f40ca220 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3940215551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 msgr2=0x7fb4f40ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4fa9e6640 1 --2- 172.21.15.113:0/3940215551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f40ca770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009e50 tx=0x7fb4ec02c090 comp rx=0 tx=0).stop 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3940215551 shutdown_connections 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4fa9e6640 1 --2- 172.21.15.113:0/3940215551 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f40ca770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3940215551 >> 172.21.15.113:0/3940215551 conn(0x7fb4f4074d50 msgr2=0x7fb4f4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3940215551 shutdown_connections 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.753+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3940215551 wait complete. 2024-04-22T06:32:15.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.754+0000 7fb4fa9e6640 1 Processor -- start 2024-04-22T06:32:15.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4fa9e6640 1 -- start start 2024-04-22T06:32:15.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4fa9e6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4f40c9aa0 0x7fb4f41409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:15.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4fa9e6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f41e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:15.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4fa9e6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f4155250 0x7fb4f41e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:15.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4fa9e6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f4155630 con 0x7fb4f40ca220 2024-04-22T06:32:15.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4fa9e6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40c90f0 con 0x7fb4f4155250 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4fa9e6640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f41559e0 con 0x7fb4f40c9aa0 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4f37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f41e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4f37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f41e7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:40238/0 (socket says 172.21.15.113:40238) 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.755+0000 7fb4f37fe640 1 -- 172.21.15.113:0/3478014770 learned_addr learned my addr 172.21.15.113:0/3478014770 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f8f83640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f4155250 0x7fb4f41e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f3fff640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4f40c9aa0 0x7fb4f41409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f37fe640 1 -- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4f40c9aa0 msgr2=0x7fb4f41409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f37fe640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4f40c9aa0 0x7fb4f41409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f37fe640 1 -- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f4155250 msgr2=0x7fb4f41e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f37fe640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f4155250 0x7fb4f41e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f37fe640 1 -- 172.21.15.113:0/3478014770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f4155ca0 con 0x7fb4f40ca220 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f3fff640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4f40c9aa0 0x7fb4f41409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f37fe640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f41e7a30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c490 tx=0x7fb4e400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:15.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f0ff9640 1 -- 172.21.15.113:0/3478014770 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4005480 con 0x7fb4f40ca220 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f0ff9640 1 -- 172.21.15.113:0/3478014770 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e40035f0 con 0x7fb4f40ca220 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f4155f80 con 0x7fb4f40ca220 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4f0ff9640 1 -- 172.21.15.113:0/3478014770 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40039c0 con 0x7fb4f40ca220 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.756+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f4156540 con 0x7fb4f40ca220 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.757+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f40c9300 con 0x7fb4f40ca220 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.757+0000 7fb4f0ff9640 1 -- 172.21.15.113:0/3478014770 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4e4003b60 con 0x7fb4f40ca220 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.758+0000 7fb4f0ff9640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb4d406ca90 0x7fb4d406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.758+0000 7fb4f0ff9640 1 -- 172.21.15.113:0/3478014770 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb4e408bbe0 con 0x7fb4f40ca220 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.758+0000 7fb4f3fff640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb4d406ca90 0x7fb4d406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:15.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.758+0000 7fb4f3fff640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb4d406ca90 0x7fb4d406ef50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc000f60 tx=0x7fb4dc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.766+0000 7fb4f0ff9640 1 -- 172.21.15.113:0/3478014770 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4f40c9300 con 0x7fb4f40ca220 2024-04-22T06:32:15.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.986+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb4f4068e40 con 0x7fb4f40ca220 2024-04-22T06:32:15.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.986+0000 7fb4f0ff9640 1 -- 172.21.15.113:0/3478014770 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fb4e40182b0 con 0x7fb4f40ca220 2024-04-22T06:32:15.985 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:15.985 INFO:teuthology.orchestra.run.smithi113.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb4d406ca90 msgr2=0x7fb4d406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb4d406ca90 0x7fb4d406ef50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc000f60 tx=0x7fb4dc009040 comp rx=0 tx=0).stop 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 msgr2=0x7fb4f41e7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f41e7a30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c490 tx=0x7fb4e400c950 comp rx=0 tx=0).stop 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 shutdown_connections 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f4155250 0x7fb4f41e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb4d406ca90 0x7fb4d406ef50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4f40ca220 0x7fb4f41e7a30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 --2- 172.21.15.113:0/3478014770 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb4f40c9aa0 0x7fb4f41409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:15.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 >> 172.21.15.113:0/3478014770 conn(0x7fb4f4074d50 msgr2=0x7fb4f4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:15.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 shutdown_connections 2024-04-22T06:32:15.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:15.988+0000 7fb4fa9e6640 1 -- 172.21.15.113:0/3478014770 wait complete. 2024-04-22T06:32:16.616 INFO:tasks.ceph.mds.c.smithi113.stderr:2024-04-22T06:32:16.617+0000 7f042e2e7640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-22T06:32:18.999 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-22T06:32:19.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.096+0000 7fe0886c1640 1 Processor -- start 2024-04-22T06:32:19.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.096+0000 7fe0886c1640 1 -- start start 2024-04-22T06:32:19.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.097+0000 7fe0886c1640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe080153130 0x7fe080073c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.097+0000 7fe0886c1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe08015c620 0x7fe08015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.097+0000 7fe0886c1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08015cff0 con 0x7fe0800ca940 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.097+0000 7fe0886c1640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fe080159c20 con 0x7fe080153130 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.097+0000 7fe0886c1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe0800c7690 con 0x7fe08015c620 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.097+0000 7fe085c5c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe0800ca940 0x7fe0800ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59656/0 (socket says 172.21.15.113:59656) 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.097+0000 7fe085c5c640 1 -- 172.21.15.113:0/2770415576 learned_addr learned my addr 172.21.15.113:0/2770415576 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08645d640 1 --2- 172.21.15.113:0/2770415576 >> v2:172.21.15.145:3300/0 conn(0x7fe080153130 0x7fe080073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe086c5e640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe08015c620 0x7fe08015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296308113 0 0) 0x7fe08015cff0 con 0x7fe0800ca940 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe06c003520 con 0x7fe0800ca940 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3289347328 0 0) 0x7fe06c003520 con 0x7fe0800ca940 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe08015c620 msgr2=0x7fe08015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe08015c620 0x7fe08015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 >> v2:172.21.15.145:3300/0 conn(0x7fe080153130 msgr2=0x7fe080073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 --2- 172.21.15.113:0/2770415576 >> v2:172.21.15.145:3300/0 conn(0x7fe080153130 0x7fe080073c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe080158d50 con 0x7fe0800ca940 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fe070001670 con 0x7fe0800ca940 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 >> v1:172.21.15.113:6789/0 conn(0x7fe0800ca940 legacy=0x7fe0800ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe06c0039b0 0x7fe06c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe08015c620 0x7fe06c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe06c004d40 0x7fe06c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe080159c20 con 0x7fe06c004d40 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe0800c7690 con 0x7fe06c0039b0 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe06c00b9c0 con 0x7fe08015c620 2024-04-22T06:32:19.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe086c5e640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe06c004d40 0x7fe06c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe085c5c640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe08015c620 0x7fe06c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe08645d640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe06c0039b0 0x7fe06c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe086c5e640 1 -- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe08015c620 msgr2=0x7fe06c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe086c5e640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe08015c620 0x7fe06c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe086c5e640 1 -- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe06c0039b0 msgr2=0x7fe06c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe086c5e640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe06c0039b0 0x7fe06c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.098+0000 7fe086c5e640 1 -- 172.21.15.113:0/2770415576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c003520 con 0x7fe06c004d40 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.099+0000 7fe086c5e640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe06c004d40 0x7fe06c0051c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009ac0 tx=0x7fe06c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a90658b91dd218 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.099+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c039070 con 0x7fe06c004d40 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.099+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c02c6b0 con 0x7fe06c004d40 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.099+0000 7fe08545b640 1 -- 172.21.15.113:0/2770415576 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c009690 con 0x7fe06c004d40 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.100+0000 7fe0886c1640 1 -- 172.21.15.113:0/2770415576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe06c004d40 msgr2=0x7fe06c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:19.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.100+0000 7fe0886c1640 1 --2- 172.21.15.113:0/2770415576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe06c004d40 0x7fe06c0051c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009ac0 tx=0x7fe06c005830 comp rx=0 tx=0).stop 2024-04-22T06:32:19.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.100+0000 7fe086c5e640 1 -- 172.21.15.113:0/2770415576 reap_dead start 2024-04-22T06:32:19.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.100+0000 7fe0886c1640 1 -- 172.21.15.113:0/2770415576 shutdown_connections 2024-04-22T06:32:19.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.100+0000 7fe0886c1640 1 -- 172.21.15.113:0/2770415576 >> 172.21.15.113:0/2770415576 conn(0x7fe080074d50 msgr2=0x7fe080075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:19.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.100+0000 7fe0886c1640 1 -- 172.21.15.113:0/2770415576 shutdown_connections 2024-04-22T06:32:19.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.100+0000 7fe0886c1640 1 -- 172.21.15.113:0/2770415576 wait complete. 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.101+0000 7fe0886c1640 1 Processor -- start 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.101+0000 7fe0886c1640 1 -- start start 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe0886c1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe06c004d40 0x7fe080148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe0886c1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe080154d00 0x7fe0801494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe0886c1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0801e3770 0x7fe0801e3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe0886c1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe0801595d0 con 0x7fe0801e3770 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe0886c1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe0801592f0 con 0x7fe080154d00 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe0886c1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe0801598b0 con 0x7fe06c004d40 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0801e3770 0x7fe0801e3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0801e3770 0x7fe0801e3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55018/0 (socket says 172.21.15.113:55018) 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 -- 172.21.15.113:0/1248742785 learned_addr learned my addr 172.21.15.113:0/1248742785 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe085c5c640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe080154d00 0x7fe0801494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe08645d640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe06c004d40 0x7fe080148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 -- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe06c004d40 msgr2=0x7fe080148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe06c004d40 0x7fe080148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 -- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe080154d00 msgr2=0x7fe0801494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe080154d00 0x7fe0801494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 -- 172.21.15.113:0/1248742785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0801e4130 con 0x7fe0801e3770 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe085c5c640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe080154d00 0x7fe0801494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe08645d640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe06c004d40 0x7fe080148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe086c5e640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0801e3770 0x7fe0801e3bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009ac0 tx=0x7fe07c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:19.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe076ffd640 1 -- 172.21.15.113:0/1248742785 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c039070 con 0x7fe0801e3770 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe076ffd640 1 -- 172.21.15.113:0/1248742785 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c043070 con 0x7fe0801e3770 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe080156860 con 0x7fe0801e3770 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe076ffd640 1 -- 172.21.15.113:0/1248742785 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c009690 con 0x7fe0801e3770 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.102+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe080155fc0 con 0x7fe0801e3770 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.103+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe080068e40 con 0x7fe0801e3770 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.104+0000 7fe076ffd640 1 -- 172.21.15.113:0/1248742785 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe07c003850 con 0x7fe0801e3770 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.104+0000 7fe076ffd640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe06406c8f0 0x7fe06406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.104+0000 7fe076ffd640 1 -- 172.21.15.113:0/1248742785 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe07c0ad7c0 con 0x7fe0801e3770 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.104+0000 7fe08645d640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe06406c8f0 0x7fe06406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:19.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.105+0000 7fe08645d640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe06406c8f0 0x7fe06406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe078007440 tx=0x7fe07800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:19.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.109+0000 7fe076ffd640 1 -- 172.21.15.113:0/1248742785 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0801e4130 con 0x7fe0801e3770 2024-04-22T06:32:19.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.326+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe0800c72d0 con 0x7fe0801e3770 2024-04-22T06:32:19.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.327+0000 7fe076ffd640 1 -- 172.21.15.113:0/1248742785 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fe07c07b6c0 con 0x7fe0801e3770 2024-04-22T06:32:19.325 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:19.325 INFO:teuthology.orchestra.run.smithi113.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-22T06:32:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe06406c8f0 msgr2=0x7fe06406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:19.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe06406c8f0 0x7fe06406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe078007440 tx=0x7fe07800b040 comp rx=0 tx=0).stop 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0801e3770 msgr2=0x7fe0801e3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0801e3770 0x7fe0801e3bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009ac0 tx=0x7fe07c004730 comp rx=0 tx=0).stop 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 shutdown_connections 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe06406c8f0 0x7fe06406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe0801e3770 0x7fe0801e3bf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe080154d00 0x7fe0801494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 --2- 172.21.15.113:0/1248742785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe06c004d40 0x7fe080148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 >> 172.21.15.113:0/1248742785 conn(0x7fe080074d50 msgr2=0x7fe0800cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 shutdown_connections 2024-04-22T06:32:19.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:19.329+0000 7fe0886c1640 1 -- 172.21.15.113:0/1248742785 wait complete. 2024-04-22T06:32:21.616 INFO:tasks.ceph.mds.c.smithi113.stderr:2024-04-22T06:32:21.618+0000 7f042e2e7640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-22T06:32:22.338 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-22T06:32:22.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.436+0000 7fd241674640 1 Processor -- start 2024-04-22T06:32:22.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.436+0000 7fd241674640 1 -- start start 2024-04-22T06:32:22.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd241674640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd23c15baf0 0x7fd23c0c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd241674640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23c1557c0 con 0x7fd23c1553e0 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd241674640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23c0c2100 con 0x7fd23c068290 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd241674640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fd23c0c1eb0 con 0x7fd23c15baf0 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd23affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd23c1553e0 0x7fd23c06dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59666/0 (socket says 172.21.15.113:59666) 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd23affd640 1 -- 172.21.15.113:0/1245389611 learned_addr learned my addr 172.21.15.113:0/1245389611 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd23b7fe640 1 --2- 172.21.15.113:0/1245389611 >> v2:172.21.15.145:3300/0 conn(0x7fd23c15baf0 0x7fd23c0c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd239ffb640 1 -- 172.21.15.113:0/1245389611 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490579574 0 0) 0x7fd23c1557c0 con 0x7fd23c1553e0 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd239ffb640 1 -- 172.21.15.113:0/1245389611 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd228003520 con 0x7fd23c1553e0 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd23b7fe640 1 -- 172.21.15.113:0/1245389611 >> v1:172.21.15.145:6789/0 conn(0x7fd23c068290 legacy=0x7fd23c0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd239ffb640 1 -- 172.21.15.113:0/1245389611 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 159742981 0 0) 0x7fd228003520 con 0x7fd23c1553e0 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd23b7fe640 1 -- 172.21.15.113:0/1245389611 >> v1:172.21.15.113:6789/0 conn(0x7fd23c1553e0 legacy=0x7fd23c06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.437+0000 7fd23b7fe640 1 -- 172.21.15.113:0/1245389611 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c0c23e0 con 0x7fd23c15baf0 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.438+0000 7fd23b7fe640 1 --2- 172.21.15.113:0/1245389611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c15baf0 0x7fd23c0c2fd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd234009d90 tx=0x7fd23402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2206054b6a738ee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:22.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.438+0000 7fd239ffb640 1 -- 172.21.15.113:0/1245389611 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234039070 con 0x7fd23c15baf0 2024-04-22T06:32:22.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.438+0000 7fd239ffb640 1 -- 172.21.15.113:0/1245389611 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23402c940 con 0x7fd23c15baf0 2024-04-22T06:32:22.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.438+0000 7fd239ffb640 1 -- 172.21.15.113:0/1245389611 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c001670 con 0x7fd23c15baf0 2024-04-22T06:32:22.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.439+0000 7fd241674640 1 -- 172.21.15.113:0/1245389611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c15baf0 msgr2=0x7fd23c0c2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.439+0000 7fd241674640 1 --2- 172.21.15.113:0/1245389611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c15baf0 0x7fd23c0c2fd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd234009d90 tx=0x7fd23402be10 comp rx=0 tx=0).stop 2024-04-22T06:32:22.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.439+0000 7fd241674640 1 -- 172.21.15.113:0/1245389611 shutdown_connections 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.439+0000 7fd241674640 1 --2- 172.21.15.113:0/1245389611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c15baf0 0x7fd23c0c2fd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.439+0000 7fd241674640 1 -- 172.21.15.113:0/1245389611 >> 172.21.15.113:0/1245389611 conn(0x7fd23c06f2f0 msgr2=0x7fd23c06f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.439+0000 7fd241674640 1 -- 172.21.15.113:0/1245389611 shutdown_connections 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.439+0000 7fd241674640 1 -- 172.21.15.113:0/1245389611 wait complete. 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.440+0000 7fd241674640 1 Processor -- start 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.440+0000 7fd241674640 1 -- start start 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd241674640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c068290 0x7fd23c1f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd241674640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd23c1553e0 0x7fd23c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd241674640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd23c15baf0 0x7fd23c14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd241674640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c06dad0 con 0x7fd23c1553e0 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd241674640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0c26c0 con 0x7fd23c068290 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd241674640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c0c3510 con 0x7fd23c15baf0 2024-04-22T06:32:22.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd23c1553e0 0x7fd23c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd23c1553e0 0x7fd23c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55024/0 (socket says 172.21.15.113:55024) 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 -- 172.21.15.113:0/1550373418 learned_addr learned my addr 172.21.15.113:0/1550373418 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23affd640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c068290 0x7fd23c1f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23b7fe640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd23c15baf0 0x7fd23c14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 -- 172.21.15.113:0/1550373418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd23c15baf0 msgr2=0x7fd23c14fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd23c15baf0 0x7fd23c14fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 -- 172.21.15.113:0/1550373418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c068290 msgr2=0x7fd23c1f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c068290 0x7fd23c1f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 -- 172.21.15.113:0/1550373418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c0b0300 con 0x7fd23c1553e0 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.441+0000 7fd23a7fc640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd23c1553e0 0x7fd23c15a1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd22400c430 tx=0x7fd22400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.442+0000 7fd2337fe640 1 -- 172.21.15.113:0/1550373418 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224017070 con 0x7fd23c1553e0 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.442+0000 7fd2337fe640 1 -- 172.21.15.113:0/1550373418 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2240052d0 con 0x7fd23c1553e0 2024-04-22T06:32:22.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.442+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c1f5460 con 0x7fd23c1553e0 2024-04-22T06:32:22.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.442+0000 7fd2337fe640 1 -- 172.21.15.113:0/1550373418 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224003830 con 0x7fd23c1553e0 2024-04-22T06:32:22.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.442+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c0afd40 con 0x7fd23c1553e0 2024-04-22T06:32:22.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.443+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c068e40 con 0x7fd23c1553e0 2024-04-22T06:32:22.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.443+0000 7fd2337fe640 1 -- 172.21.15.113:0/1550373418 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd22401a070 con 0x7fd23c1553e0 2024-04-22T06:32:22.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.443+0000 7fd2337fe640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd21c06c8f0 0x7fd21c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.444+0000 7fd2337fe640 1 -- 172.21.15.113:0/1550373418 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd22408b1e0 con 0x7fd23c1553e0 2024-04-22T06:32:22.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.444+0000 7fd23affd640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd21c06c8f0 0x7fd21c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.444+0000 7fd23affd640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd21c06c8f0 0x7fd21c06edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd22c005880 tx=0x7fd22c0057f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.448+0000 7fd2337fe640 1 -- 172.21.15.113:0/1550373418 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd23c0b0300 con 0x7fd23c1553e0 2024-04-22T06:32:22.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.666+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd23c0703a0 con 0x7fd23c1553e0 2024-04-22T06:32:22.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.666+0000 7fd2337fe640 1 -- 172.21.15.113:0/1550373418 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd224058bc0 con 0x7fd23c1553e0 2024-04-22T06:32:22.665 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:22.665 INFO:teuthology.orchestra.run.smithi113.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd21c06c8f0 msgr2=0x7fd21c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd21c06c8f0 0x7fd21c06edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd22c005880 tx=0x7fd22c0057f0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd23c1553e0 msgr2=0x7fd23c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd23c1553e0 0x7fd23c15a1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd22400c430 tx=0x7fd22400c8f0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 shutdown_connections 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd23c15baf0 0x7fd23c14fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd21c06c8f0 0x7fd21c06edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd23c1553e0 0x7fd23c15a1a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 --2- 172.21.15.113:0/1550373418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd23c068290 0x7fd23c1f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 >> 172.21.15.113:0/1550373418 conn(0x7fd23c06f2f0 msgr2=0x7fd23c153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:22.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 shutdown_connections 2024-04-22T06:32:22.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.668+0000 7fd241674640 1 -- 172.21.15.113:0/1550373418 wait complete. 2024-04-22T06:32:22.677 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-22T06:32:22.677 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:22.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.775+0000 7f766d65c640 1 Processor -- start 2024-04-22T06:32:22.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.775+0000 7f766d65c640 1 -- start start 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f766d65c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7668155170 0x7f766815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f766d65c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76680ccf00 con 0x7f76680cb9e0 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f766d65c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76680cd1e0 con 0x7f7668155550 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f766d65c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f76680cddf0 con 0x7f7668155170 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f7666ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7668155170 0x7f766815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f76677fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f76680cb9e0 0x7f76680c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59678/0 (socket says 172.21.15.113:59678) 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f76677fe640 1 -- 172.21.15.113:0/3015554679 learned_addr learned my addr 172.21.15.113:0/3015554679 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f7666ffd640 1 -- 172.21.15.113:0/3015554679 >> v1:172.21.15.145:6789/0 conn(0x7f7668155550 legacy=0x7f76680d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f7666ffd640 1 -- 172.21.15.113:0/3015554679 >> v1:172.21.15.113:6789/0 conn(0x7f76680cb9e0 legacy=0x7f76680c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f7665ffb640 1 -- 172.21.15.113:0/3015554679 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217984629 0 0) 0x7f76680ccf00 con 0x7f76680cb9e0 2024-04-22T06:32:22.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.776+0000 7f7666ffd640 1 -- 172.21.15.113:0/3015554679 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76680cd4c0 con 0x7f7668155170 2024-04-22T06:32:22.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.777+0000 7f7666ffd640 1 --2- 172.21.15.113:0/3015554679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7668155170 0x7f766815eef0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f76680cdf70 tx=0x7f765c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e403f7bff32400 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.777+0000 7f7665ffb640 1 -- 172.21.15.113:0/3015554679 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c035020 con 0x7f7668155170 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.777+0000 7f7665ffb640 1 -- 172.21.15.113:0/3015554679 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765c031800 con 0x7f7668155170 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.777+0000 7f7665ffb640 1 -- 172.21.15.113:0/3015554679 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c031bd0 con 0x7f7668155170 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.778+0000 7f766d65c640 1 -- 172.21.15.113:0/3015554679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7668155170 msgr2=0x7f766815eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.778+0000 7f766d65c640 1 --2- 172.21.15.113:0/3015554679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7668155170 0x7f766815eef0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f76680cdf70 tx=0x7f765c02b8a0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.778+0000 7f766d65c640 1 -- 172.21.15.113:0/3015554679 shutdown_connections 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.778+0000 7f766d65c640 1 --2- 172.21.15.113:0/3015554679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7668155170 0x7f766815eef0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.778+0000 7f766d65c640 1 -- 172.21.15.113:0/3015554679 >> 172.21.15.113:0/3015554679 conn(0x7f7668072570 msgr2=0x7f7668074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.778+0000 7f766d65c640 1 -- 172.21.15.113:0/3015554679 shutdown_connections 2024-04-22T06:32:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.778+0000 7f766d65c640 1 -- 172.21.15.113:0/3015554679 wait complete. 2024-04-22T06:32:22.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.779+0000 7f766d65c640 1 Processor -- start 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.779+0000 7f766d65c640 1 -- start start 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f766d65c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76680cb9e0 0x7f766814cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f766d65c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7668155170 0x7f766814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f766d65c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7668155550 0x7f76681f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f766d65c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f76680cda80 con 0x7f76680cb9e0 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f766d65c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f766815f430 con 0x7f7668155170 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f766d65c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f76680ccae0 con 0x7f7668155550 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76680cb9e0 0x7f766814cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76680cb9e0 0x7f766814cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55052/0 (socket says 172.21.15.113:55052) 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 -- 172.21.15.113:0/3817565408 learned_addr learned my addr 172.21.15.113:0/3817565408 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f76667fc640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7668155170 0x7f766814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f76677fe640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7668155550 0x7f76681f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 -- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7668155550 msgr2=0x7f76681f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7668155550 0x7f76681f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 -- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7668155170 msgr2=0x7f766814d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7668155170 0x7f766814d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 -- 172.21.15.113:0/3817565408 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76680b3dc0 con 0x7f76680cb9e0 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f76677fe640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7668155550 0x7f76681f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f7666ffd640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76680cb9e0 0x7f766814cfe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f765c0098c0 tx=0x7f765c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f764f7fe640 1 -- 172.21.15.113:0/3817565408 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c03cd80 con 0x7f76680cb9e0 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f764f7fe640 1 -- 172.21.15.113:0/3817565408 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765c004030 con 0x7f76680cb9e0 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766814bf80 con 0x7f76680cb9e0 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f764f7fe640 1 -- 172.21.15.113:0/3817565408 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c004420 con 0x7f76680cb9e0 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.780+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766814c500 con 0x7f76680cb9e0 2024-04-22T06:32:22.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.781+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7668068e40 con 0x7f76680cb9e0 2024-04-22T06:32:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.782+0000 7f764f7fe640 1 -- 172.21.15.113:0/3817565408 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f765c038020 con 0x7f76680cb9e0 2024-04-22T06:32:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.783+0000 7f764f7fe640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f765406c920 0x7f765406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.783+0000 7f764f7fe640 1 -- 172.21.15.113:0/3817565408 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f765c0ae420 con 0x7f76680cb9e0 2024-04-22T06:32:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.783+0000 7f76667fc640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f765406c920 0x7f765406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:22.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.783+0000 7f76667fc640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f765406c920 0x7f765406ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f76681f5490 tx=0x7f7658009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:22.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.787+0000 7f764f7fe640 1 -- 172.21.15.113:0/3817565408 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f765c041070 con 0x7f76680cb9e0 2024-04-22T06:32:22.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.965+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76680cc2b0 con 0x7f76680cb9e0 2024-04-22T06:32:22.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.966+0000 7f764f7fe640 1 -- 172.21.15.113:0/3817565408 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f765c07c450 con 0x7f76680cb9e0 2024-04-22T06:32:22.965 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:22.965 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:22.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f765406c920 msgr2=0x7f765406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f765406c920 0x7f765406ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f76681f5490 tx=0x7f7658009040 comp rx=0 tx=0).stop 2024-04-22T06:32:22.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76680cb9e0 msgr2=0x7f766814cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:22.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76680cb9e0 0x7f766814cfe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f765c0098c0 tx=0x7f765c0046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 shutdown_connections 2024-04-22T06:32:22.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7668155550 0x7f76681f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7668155170 0x7f766814d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f765406c920 0x7f765406ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 --2- 172.21.15.113:0/3817565408 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f76680cb9e0 0x7f766814cfe0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:22.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 >> 172.21.15.113:0/3817565408 conn(0x7f7668072570 msgr2=0x7f76680ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:22.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 shutdown_connections 2024-04-22T06:32:22.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:22.968+0000 7f766d65c640 1 -- 172.21.15.113:0/3817565408 wait complete. 2024-04-22T06:32:22.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:32:22.979 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:32:23.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.081+0000 7f4ca58b3640 1 Processor -- start 2024-04-22T06:32:23.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.081+0000 7f4ca58b3640 1 -- start start 2024-04-22T06:32:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.082+0000 7f4ca58b3640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4ca00c8950 0x7f4ca00c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.082+0000 7f4ca58b3640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca00c41b0 con 0x7f4ca00c8ea0 2024-04-22T06:32:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.082+0000 7f4ca58b3640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca00b2380 con 0x7f4ca00ca3a0 2024-04-22T06:32:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.082+0000 7f4ca58b3640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca00c2ac0 con 0x7f4ca00c8950 2024-04-22T06:32:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9effd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4ca00c8ea0 0x7f4ca00c81f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59686/0 (socket says 172.21.15.113:59686) 2024-04-22T06:32:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9effd640 1 -- 172.21.15.113:0/2593109658 learned_addr learned my addr 172.21.15.113:0/2593109658 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809843208 0 0) 0x7f4ca00c41b0 con 0x7f4ca00c8ea0 2024-04-22T06:32:23.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c8c003520 con 0x7f4ca00c8ea0 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9f7fe640 1 --2- 172.21.15.113:0/2593109658 >> v2:172.21.15.145:3300/0 conn(0x7f4ca00c8950 0x7f4ca00c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1783362409 0 0) 0x7f4c8c003520 con 0x7f4ca00c8ea0 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 >> v2:172.21.15.145:3300/0 conn(0x7f4ca00c8950 msgr2=0x7f4ca00c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 --2- 172.21.15.113:0/2593109658 >> v2:172.21.15.145:3300/0 conn(0x7f4ca00c8950 0x7f4ca00c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 >> v1:172.21.15.145:6789/0 conn(0x7f4ca00ca3a0 legacy=0x7f4ca0163ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca00c7c30 con 0x7f4ca00c8ea0 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f4c90001670 con 0x7f4ca00c8ea0 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 >> v1:172.21.15.113:6789/0 conn(0x7f4ca00c8ea0 legacy=0x7f4ca00c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c8c0039b0 0x7f4c8c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c8c004800 0x7f4c8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0051c0 0x7f4c8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca00c2ac0 con 0x7f4c8c0051c0 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c00c090 con 0x7f4c8c0039b0 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8c00c290 con 0x7f4c8c004800 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9effd640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c8c0039b0 0x7f4c8c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c9f7fe640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0051c0 0x7f4c8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.083+0000 7f4c97fff640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c8c004800 0x7f4c8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.084+0000 7f4c9effd640 1 -- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c8c004800 msgr2=0x7f4c8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.084+0000 7f4c9effd640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c8c004800 0x7f4c8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.084+0000 7f4c9effd640 1 -- 172.21.15.113:0/2593109658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0051c0 msgr2=0x7f4c8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.084+0000 7f4c9effd640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0051c0 0x7f4c8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.084+0000 7f4c9effd640 1 -- 172.21.15.113:0/2593109658 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8c003520 con 0x7f4c8c0039b0 2024-04-22T06:32:23.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.084+0000 7f4c9f7fe640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0051c0 0x7f4c8c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.084+0000 7f4c9f7fe640 1 -- 172.21.15.113:0/2593109658 reap_dead start 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.084+0000 7f4c9effd640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c8c0039b0 0x7f4c8c003df0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000c270 tx=0x7f4c8c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1bd1fca87f389b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90007cf0 con 0x7f4c8c0039b0 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c90030070 con 0x7f4c8c0039b0 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4c9e7fc640 1 -- 172.21.15.113:0/2593109658 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90005d70 con 0x7f4c8c0039b0 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c8c0039b0 msgr2=0x7f4c8c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4ca58b3640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c8c0039b0 0x7f4c8c003df0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000c270 tx=0x7f4c8c005830 comp rx=0 tx=0).stop 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2593109658 shutdown_connections 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4ca58b3640 1 --2- 172.21.15.113:0/2593109658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c8c0039b0 0x7f4c8c003df0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2593109658 >> 172.21.15.113:0/2593109658 conn(0x7f4ca006f5f0 msgr2=0x7f4ca006f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2593109658 shutdown_connections 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.085+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2593109658 wait complete. 2024-04-22T06:32:23.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.086+0000 7f4ca58b3640 1 Processor -- start 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.086+0000 7f4ca58b3640 1 -- start start 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4ca58b3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0039b0 0x7f4ca014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4ca58b3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ca0147570 0x7f4ca01479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4ca58b3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ca0147f30 0x7f4ca00cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4ca58b3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca00c7f10 con 0x7f4c8c0039b0 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4ca58b3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca00c79e0 con 0x7f4ca0147f30 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4ca58b3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca00c9f10 con 0x7f4ca0147570 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0039b0 0x7f4ca014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0039b0 0x7f4ca014c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55070/0 (socket says 172.21.15.113:55070) 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9effd640 1 -- 172.21.15.113:0/2906246446 learned_addr learned my addr 172.21.15.113:0/2906246446 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c97fff640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ca0147570 0x7f4ca01479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9f7fe640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ca0147f30 0x7f4ca00cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9effd640 1 -- 172.21.15.113:0/2906246446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ca0147570 msgr2=0x7f4ca01479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9effd640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ca0147570 0x7f4ca01479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9effd640 1 -- 172.21.15.113:0/2906246446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ca0147f30 msgr2=0x7f4ca00cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9effd640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ca0147f30 0x7f4ca00cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.087+0000 7f4c9effd640 1 -- 172.21.15.113:0/2906246446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca01483b0 con 0x7f4c8c0039b0 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.088+0000 7f4c9effd640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0039b0 0x7f4ca014c9e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4c9002c480 tx=0x7f4ca00c3ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.088+0000 7f4c9cff9640 1 -- 172.21.15.113:0/2906246446 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90001c30 con 0x7f4c8c0039b0 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.088+0000 7f4c9cff9640 1 -- 172.21.15.113:0/2906246446 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c90004bf0 con 0x7f4c8c0039b0 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.088+0000 7f4c9cff9640 1 -- 172.21.15.113:0/2906246446 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90007070 con 0x7f4c8c0039b0 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.088+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca015c080 con 0x7f4c8c0039b0 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.088+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca0152560 con 0x7f4c8c0039b0 2024-04-22T06:32:23.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.089+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca0068f50 con 0x7f4c8c0039b0 2024-04-22T06:32:23.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.089+0000 7f4c9cff9640 1 -- 172.21.15.113:0/2906246446 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c90048020 con 0x7f4c8c0039b0 2024-04-22T06:32:23.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.090+0000 7f4c9cff9640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c8006c920 0x7f4c8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.090+0000 7f4c97fff640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c8006c920 0x7f4c8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.090+0000 7f4c9cff9640 1 -- 172.21.15.113:0/2906246446 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4c900ad200 con 0x7f4c8c0039b0 2024-04-22T06:32:23.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.090+0000 7f4c97fff640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c8006c920 0x7f4c8006ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4c88000c00 tx=0x7f4c88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.094+0000 7f4c9cff9640 1 -- 172.21.15.113:0/2906246446 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ca015c080 con 0x7f4c8c0039b0 2024-04-22T06:32:23.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.273+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4ca0067c00 con 0x7f4c8c0039b0 2024-04-22T06:32:23.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.273+0000 7f4c9cff9640 1 -- 172.21.15.113:0/2906246446 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f4c9007b230 con 0x7f4c8c0039b0 2024-04-22T06:32:23.272 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c8006c920 msgr2=0x7f4c8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c8006c920 0x7f4c8006ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4c88000c00 tx=0x7f4c88009040 comp rx=0 tx=0).stop 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0039b0 msgr2=0x7f4ca014c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0039b0 0x7f4ca014c9e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4c9002c480 tx=0x7f4ca00c3ef0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 shutdown_connections 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ca0147f30 0x7f4ca00cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ca0147570 0x7f4ca01479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c8006c920 0x7f4c8006ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 --2- 172.21.15.113:0/2906246446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c8c0039b0 0x7f4ca014c9e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 >> 172.21.15.113:0/2906246446 conn(0x7f4ca006f5f0 msgr2=0x7f4ca01544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 shutdown_connections 2024-04-22T06:32:23.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.275+0000 7f4ca58b3640 1 -- 172.21.15.113:0/2906246446 wait complete. 2024-04-22T06:32:23.284 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:32:23.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.385+0000 7ff22e14a640 1 Processor -- start 2024-04-22T06:32:23.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.385+0000 7ff22e14a640 1 -- start start 2024-04-22T06:32:23.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff22e14a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff228144150 0x7ff2280c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff22e14a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff22815c660 0x7ff22815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff22e14a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22815cfd0 con 0x7ff22815baf0 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff22e14a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7ff228072380 con 0x7ff22815c660 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff22e14a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff228072660 con 0x7ff228144150 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff2277fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff228144150 0x7ff2280c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff227fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff22815c660 0x7ff22815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff21ffff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7ff22815baf0 0x7ff228074d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:45154/0 (socket says 172.21.15.113:45154) 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.386+0000 7ff21ffff640 1 -- 172.21.15.113:0/11972177 learned_addr learned my addr 172.21.15.113:0/11972177 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.387+0000 7ff226ffd640 1 -- 172.21.15.113:0/11972177 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307622830 0 0) 0x7ff22815cfd0 con 0x7ff22815baf0 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.387+0000 7ff226ffd640 1 -- 172.21.15.113:0/11972177 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff214003520 con 0x7ff22815baf0 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.387+0000 7ff2277fe640 1 -- 172.21.15.113:0/11972177 >> v2:172.21.15.145:3300/0 conn(0x7ff22815c660 msgr2=0x7ff22815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.387+0000 7ff2277fe640 1 --2- 172.21.15.113:0/11972177 >> v2:172.21.15.145:3300/0 conn(0x7ff22815c660 0x7ff22815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.387+0000 7ff2277fe640 1 -- 172.21.15.113:0/11972177 >> v1:172.21.15.145:6789/0 conn(0x7ff22815baf0 legacy=0x7ff228074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.387+0000 7ff2277fe640 1 -- 172.21.15.113:0/11972177 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff228072940 con 0x7ff228144150 2024-04-22T06:32:23.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.387+0000 7ff227fff640 1 --2- 172.21.15.113:0/11972177 >> v2:172.21.15.145:3300/0 conn(0x7ff22815c660 0x7ff22815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:23.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.387+0000 7ff2277fe640 1 --2- 172.21.15.113:0/11972177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff228144150 0x7ff2280c7ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff2180097a0 tx=0x7ff21802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb3e6db61233ac75 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff226ffd640 1 -- 172.21.15.113:0/11972177 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218034070 con 0x7ff228144150 2024-04-22T06:32:23.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff226ffd640 1 -- 172.21.15.113:0/11972177 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218030610 con 0x7ff228144150 2024-04-22T06:32:23.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff226ffd640 1 -- 172.21.15.113:0/11972177 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180309c0 con 0x7ff228144150 2024-04-22T06:32:23.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff22e14a640 1 -- 172.21.15.113:0/11972177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff228144150 msgr2=0x7ff2280c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff22e14a640 1 --2- 172.21.15.113:0/11972177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff228144150 0x7ff2280c7ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff2180097a0 tx=0x7ff21802b960 comp rx=0 tx=0).stop 2024-04-22T06:32:23.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff22e14a640 1 -- 172.21.15.113:0/11972177 shutdown_connections 2024-04-22T06:32:23.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff22e14a640 1 --2- 172.21.15.113:0/11972177 >> v2:172.21.15.145:3300/0 conn(0x7ff22815c660 0x7ff22815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff22e14a640 1 --2- 172.21.15.113:0/11972177 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff228144150 0x7ff2280c7ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff22e14a640 1 -- 172.21.15.113:0/11972177 >> 172.21.15.113:0/11972177 conn(0x7ff22806b920 msgr2=0x7ff22806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff22e14a640 1 -- 172.21.15.113:0/11972177 shutdown_connections 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.388+0000 7ff22e14a640 1 -- 172.21.15.113:0/11972177 wait complete. 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.389+0000 7ff22e14a640 1 Processor -- start 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.389+0000 7ff22e14a640 1 -- start start 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff22e14a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff228144150 0x7ff2281f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff22e14a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff22815baf0 0x7ff2281f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff22e14a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff22815c660 0x7ff2280cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff22e14a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff22815bf10 con 0x7ff228144150 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff22e14a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff228072f00 con 0x7ff22815c660 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff22e14a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff228144530 con 0x7ff22815baf0 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff2277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff228144150 0x7ff2281f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff2277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff228144150 0x7ff2281f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55084/0 (socket says 172.21.15.113:55084) 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff2277fe640 1 -- 172.21.15.113:0/1892865878 learned_addr learned my addr 172.21.15.113:0/1892865878 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff227fff640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff22815c660 0x7ff2280cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff21ffff640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff22815baf0 0x7ff2281f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff2277fe640 1 -- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff22815baf0 msgr2=0x7ff2281f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff2277fe640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff22815baf0 0x7ff2281f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff2277fe640 1 -- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff22815c660 msgr2=0x7ff2280cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff2277fe640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff22815c660 0x7ff2280cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff2277fe640 1 -- 172.21.15.113:0/1892865878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff228156c80 con 0x7ff228144150 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff227fff640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff22815c660 0x7ff2280cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.390+0000 7ff21ffff640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff22815baf0 0x7ff2281f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.391+0000 7ff2277fe640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff228144150 0x7ff2281f4db0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff21802bf70 tx=0x7ff2180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.391+0000 7ff224ff9640 1 -- 172.21.15.113:0/1892865878 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218034040 con 0x7ff228144150 2024-04-22T06:32:23.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.391+0000 7ff224ff9640 1 -- 172.21.15.113:0/1892865878 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21803aaa0 con 0x7ff228144150 2024-04-22T06:32:23.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.391+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff228156f60 con 0x7ff228144150 2024-04-22T06:32:23.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.391+0000 7ff224ff9640 1 -- 172.21.15.113:0/1892865878 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218006e10 con 0x7ff228144150 2024-04-22T06:32:23.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.391+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2281f42d0 con 0x7ff228144150 2024-04-22T06:32:23.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.392+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff228143d00 con 0x7ff228144150 2024-04-22T06:32:23.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.392+0000 7ff224ff9640 1 -- 172.21.15.113:0/1892865878 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff218037070 con 0x7ff228144150 2024-04-22T06:32:23.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.393+0000 7ff224ff9640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff20806c920 0x7ff20806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.393+0000 7ff21ffff640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff20806c920 0x7ff20806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.393+0000 7ff224ff9640 1 -- 172.21.15.113:0/1892865878 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff2180adce0 con 0x7ff228144150 2024-04-22T06:32:23.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.393+0000 7ff21ffff640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff20806c920 0x7ff20806ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff210007fd0 tx=0x7ff210009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.397+0000 7ff224ff9640 1 -- 172.21.15.113:0/1892865878 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff228143d00 con 0x7ff228144150 2024-04-22T06:32:23.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.573+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff228068f50 con 0x7ff228144150 2024-04-22T06:32:23.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.573+0000 7ff224ff9640 1 -- 172.21.15.113:0/1892865878 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff21803f070 con 0x7ff228144150 2024-04-22T06:32:23.572 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff20806c920 msgr2=0x7ff20806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff20806c920 0x7ff20806ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff210007fd0 tx=0x7ff210009040 comp rx=0 tx=0).stop 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff228144150 msgr2=0x7ff2281f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff228144150 0x7ff2281f4db0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff21802bf70 tx=0x7ff2180046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 shutdown_connections 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff22815c660 0x7ff2280cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff22815baf0 0x7ff2281f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff20806c920 0x7ff20806ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 --2- 172.21.15.113:0/1892865878 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff228144150 0x7ff2281f4db0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 >> 172.21.15.113:0/1892865878 conn(0x7ff22806b920 msgr2=0x7ff22806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:23.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 shutdown_connections 2024-04-22T06:32:23.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.575+0000 7ff22e14a640 1 -- 172.21.15.113:0/1892865878 wait complete. 2024-04-22T06:32:23.585 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:32:23.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.687+0000 7fc6d0a48640 1 Processor -- start 2024-04-22T06:32:23.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.687+0000 7fc6d0a48640 1 -- start start 2024-04-22T06:32:23.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6d0a48640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6cc14f750 0x7fc6cc075230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6d0a48640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 0x7fc6cc0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6d0a48640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc6cc1590f0 0x7fc6cc159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6d0a48640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fc6cc075ca0 con 0x7fc6cc14f750 2024-04-22T06:32:23.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6d0a48640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fc6cc0cb0c0 con 0x7fc6cc1590f0 2024-04-22T06:32:23.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6d0a48640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc6cc159ac0 con 0x7fc6cc0cd690 2024-04-22T06:32:23.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6ca59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6cc14f750 0x7fc6cc075230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6ca59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6cc14f750 0x7fc6cc075230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55096/0 (socket says 172.21.15.113:55096) 2024-04-22T06:32:23.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6ca59c640 1 -- 172.21.15.113:0/73501538 learned_addr learned my addr 172.21.15.113:0/73501538 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:23.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6c3fff640 1 --2- 172.21.15.113:0/73501538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 0x7fc6cc0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6cad9d640 1 --2- 172.21.15.113:0/73501538 >> v2:172.21.15.145:3300/0 conn(0x7fc6cc1590f0 0x7fc6cc159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6ca59c640 1 -- 172.21.15.113:0/73501538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 msgr2=0x7fc6cc0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:23.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6ca59c640 1 --2- 172.21.15.113:0/73501538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 0x7fc6cc0cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6ca59c640 1 -- 172.21.15.113:0/73501538 >> v2:172.21.15.145:3300/0 conn(0x7fc6cc1590f0 msgr2=0x7fc6cc159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:23.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6ca59c640 1 --2- 172.21.15.113:0/73501538 >> v2:172.21.15.145:3300/0 conn(0x7fc6cc1590f0 0x7fc6cc159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.688+0000 7fc6ca59c640 1 -- 172.21.15.113:0/73501538 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6cc075890 con 0x7fc6cc14f750 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.689+0000 7fc6ca59c640 1 --2- 172.21.15.113:0/73501538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc14f750 0x7fc6cc075230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc074f50 tx=0x7fc6bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdbb94505543c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.689+0000 7fc6c9d9b640 1 -- 172.21.15.113:0/73501538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc034070 con 0x7fc6cc14f750 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.689+0000 7fc6c9d9b640 1 -- 172.21.15.113:0/73501538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6bc030840 con 0x7fc6cc14f750 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.689+0000 7fc6c9d9b640 1 -- 172.21.15.113:0/73501538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc030c10 con 0x7fc6cc14f750 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 -- 172.21.15.113:0/73501538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc14f750 msgr2=0x7fc6cc075230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/73501538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc14f750 0x7fc6cc075230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc074f50 tx=0x7fc6bc02b980 comp rx=0 tx=0).stop 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 -- 172.21.15.113:0/73501538 shutdown_connections 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/73501538 >> v2:172.21.15.145:3300/0 conn(0x7fc6cc1590f0 0x7fc6cc159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/73501538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 0x7fc6cc0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/73501538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc14f750 0x7fc6cc075230 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 -- 172.21.15.113:0/73501538 >> 172.21.15.113:0/73501538 conn(0x7fc6cc06e8b0 msgr2=0x7fc6cc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 -- 172.21.15.113:0/73501538 shutdown_connections 2024-04-22T06:32:23.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.690+0000 7fc6d0a48640 1 -- 172.21.15.113:0/73501538 wait complete. 2024-04-22T06:32:23.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.691+0000 7fc6d0a48640 1 Processor -- start 2024-04-22T06:32:23.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.691+0000 7fc6d0a48640 1 -- start start 2024-04-22T06:32:23.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6d0a48640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 0x7fc6cc1e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6d0a48640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6cc14f750 0x7fc6cc14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6d0a48640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc1590f0 0x7fc6cc14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6d0a48640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc0ca790 con 0x7fc6cc1590f0 2024-04-22T06:32:23.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6d0a48640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc0ca4b0 con 0x7fc6cc14f750 2024-04-22T06:32:23.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6d0a48640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc6cc0caa70 con 0x7fc6cc0cd690 2024-04-22T06:32:23.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6cad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc1590f0 0x7fc6cc14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6cad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc1590f0 0x7fc6cc14b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55106/0 (socket says 172.21.15.113:55106) 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6cad9d640 1 -- 172.21.15.113:0/74742009 learned_addr learned my addr 172.21.15.113:0/74742009 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6ca59c640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 0x7fc6cc1e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6c3fff640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6cc14f750 0x7fc6cc14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6cad9d640 1 -- 172.21.15.113:0/74742009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 msgr2=0x7fc6cc1e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6cad9d640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 0x7fc6cc1e54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6cad9d640 1 -- 172.21.15.113:0/74742009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6cc14f750 msgr2=0x7fc6cc14ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6cad9d640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6cc14f750 0x7fc6cc14ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.692+0000 7fc6cad9d640 1 -- 172.21.15.113:0/74742009 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6cc1ef030 con 0x7fc6cc1590f0 2024-04-22T06:32:23.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.693+0000 7fc6cad9d640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc1590f0 0x7fc6cc14b040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400cc30 tx=0x7fc6c400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.693+0000 7fc6c2ffd640 1 -- 172.21.15.113:0/74742009 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400ce40 con 0x7fc6cc1590f0 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.693+0000 7fc6c2ffd640 1 -- 172.21.15.113:0/74742009 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c4003990 con 0x7fc6cc1590f0 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.693+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6cc1ef310 con 0x7fc6cc1590f0 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.693+0000 7fc6c2ffd640 1 -- 172.21.15.113:0/74742009 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4003d40 con 0x7fc6cc1590f0 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.693+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6cc1ef8d0 con 0x7fc6cc1590f0 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.694+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6cc068f50 con 0x7fc6cc1590f0 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.694+0000 7fc6c2ffd640 1 -- 172.21.15.113:0/74742009 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6c4004000 con 0x7fc6cc1590f0 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.695+0000 7fc6c2ffd640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc6ac06c8f0 0x7fc6ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.695+0000 7fc6c2ffd640 1 -- 172.21.15.113:0/74742009 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc6c408c320 con 0x7fc6cc1590f0 2024-04-22T06:32:23.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.695+0000 7fc6ca59c640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc6ac06c8f0 0x7fc6ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.695+0000 7fc6ca59c640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc6ac06c8f0 0x7fc6ac06edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc036000 tx=0x7fc6bc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.699+0000 7fc6c2ffd640 1 -- 172.21.15.113:0/74742009 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6c4014030 con 0x7fc6cc1590f0 2024-04-22T06:32:23.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.873+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc6cc159c90 con 0x7fc6cc1590f0 2024-04-22T06:32:23.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.874+0000 7fc6c2ffd640 1 -- 172.21.15.113:0/74742009 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fc6c4059d00 con 0x7fc6cc1590f0 2024-04-22T06:32:23.872 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:32:23.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc6ac06c8f0 msgr2=0x7fc6ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc6ac06c8f0 0x7fc6ac06edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc036000 tx=0x7fc6bc008030 comp rx=0 tx=0).stop 2024-04-22T06:32:23.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc1590f0 msgr2=0x7fc6cc14b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc1590f0 0x7fc6cc14b040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400cc30 tx=0x7fc6c400a5c0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 shutdown_connections 2024-04-22T06:32:23.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc6ac06c8f0 0x7fc6ac06edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6cc1590f0 0x7fc6cc14b040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6cc14f750 0x7fc6cc14ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 --2- 172.21.15.113:0/74742009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc6cc0cd690 0x7fc6cc1e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 >> 172.21.15.113:0/74742009 conn(0x7fc6cc06e8b0 msgr2=0x7fc6cc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:23.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 shutdown_connections 2024-04-22T06:32:23.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.876+0000 7fc6d0a48640 1 -- 172.21.15.113:0/74742009 wait complete. 2024-04-22T06:32:23.885 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:32:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.988+0000 7fee23631640 1 Processor -- start 2024-04-22T06:32:23.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.988+0000 7fee23631640 1 -- start start 2024-04-22T06:32:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee23631640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fee1c151fc0 0x7fee1c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee23631640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee23631640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee1c159f80 con 0x7fee1c159b30 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee23631640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fee1c15b420 con 0x7fee1c151fc0 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee23631640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c15b700 con 0x7fee1c0ca470 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee21bce640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fee1c159b30 0x7fee1c0c8660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59694/0 (socket says 172.21.15.113:59694) 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee21bce640 1 -- 172.21.15.113:0/4160628126 learned_addr learned my addr 172.21.15.113:0/4160628126 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee213cd640 1 --2- 172.21.15.113:0/4160628126 >> v2:172.21.15.145:3300/0 conn(0x7fee1c151fc0 0x7fee1c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.989+0000 7fee20bcc640 1 --2- 172.21.15.113:0/4160628126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.990+0000 7fee13fff640 1 -- 172.21.15.113:0/4160628126 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781258062 0 0) 0x7fee1c159f80 con 0x7fee1c159b30 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.990+0000 7fee13fff640 1 -- 172.21.15.113:0/4160628126 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee08005730 con 0x7fee1c159b30 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.990+0000 7fee20bcc640 1 -- 172.21.15.113:0/4160628126 >> v2:172.21.15.145:3300/0 conn(0x7fee1c151fc0 msgr2=0x7fee1c0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:23.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.990+0000 7fee20bcc640 1 --2- 172.21.15.113:0/4160628126 >> v2:172.21.15.145:3300/0 conn(0x7fee1c151fc0 0x7fee1c0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.990+0000 7fee20bcc640 1 -- 172.21.15.113:0/4160628126 >> v1:172.21.15.113:6789/0 conn(0x7fee1c159b30 legacy=0x7fee1c0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.990+0000 7fee20bcc640 1 -- 172.21.15.113:0/4160628126 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c15b9e0 con 0x7fee1c0ca470 2024-04-22T06:32:23.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.990+0000 7fee213cd640 1 --2- 172.21.15.113:0/4160628126 >> v2:172.21.15.145:3300/0 conn(0x7fee1c151fc0 0x7fee1c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee20bcc640 1 --2- 172.21.15.113:0/4160628126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c1595f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0097a0 tx=0x7fee0c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db44e213a1bd56f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee13fff640 1 -- 172.21.15.113:0/4160628126 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c034070 con 0x7fee1c0ca470 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee13fff640 1 -- 172.21.15.113:0/4160628126 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0c030800 con 0x7fee1c0ca470 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee13fff640 1 -- 172.21.15.113:0/4160628126 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c030bd0 con 0x7fee1c0ca470 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee23631640 1 -- 172.21.15.113:0/4160628126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 msgr2=0x7fee1c1595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee23631640 1 --2- 172.21.15.113:0/4160628126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c1595f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0097a0 tx=0x7fee0c02b940 comp rx=0 tx=0).stop 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee23631640 1 -- 172.21.15.113:0/4160628126 shutdown_connections 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee23631640 1 --2- 172.21.15.113:0/4160628126 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c1595f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee23631640 1 --2- 172.21.15.113:0/4160628126 >> v2:172.21.15.145:3300/0 conn(0x7fee1c151fc0 0x7fee1c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee23631640 1 -- 172.21.15.113:0/4160628126 >> 172.21.15.113:0/4160628126 conn(0x7fee1c06b920 msgr2=0x7fee1c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:23.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee23631640 1 -- 172.21.15.113:0/4160628126 shutdown_connections 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.991+0000 7fee23631640 1 -- 172.21.15.113:0/4160628126 wait complete. 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.992+0000 7fee23631640 1 Processor -- start 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee23631640 1 -- start start 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee23631640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee23631640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee1c151fc0 0x7fee1c1e13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee23631640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee1c159b30 0x7fee1c1e2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee23631640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c158b80 con 0x7fee1c159b30 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee23631640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c15bfa0 con 0x7fee1c151fc0 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee23631640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c1523a0 con 0x7fee1c0ca470 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee21bce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee1c159b30 0x7fee1c1e2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee21bce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee1c159b30 0x7fee1c1e2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55112/0 (socket says 172.21.15.113:55112) 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.993+0000 7fee21bce640 1 -- 172.21.15.113:0/3129574667 learned_addr learned my addr 172.21.15.113:0/3129574667 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:23.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee213cd640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee20bcc640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee1c151fc0 0x7fee1c1e13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee21bce640 1 -- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 msgr2=0x7fee1c0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee21bce640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c0cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee21bce640 1 -- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee1c151fc0 msgr2=0x7fee1c1e13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee21bce640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee1c151fc0 0x7fee1c1e13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee21bce640 1 -- 172.21.15.113:0/3129574667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c0cb9d0 con 0x7fee1c159b30 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee213cd640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee20bcc640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee1c151fc0 0x7fee1c1e13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee21bce640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee1c159b30 0x7fee1c1e2630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee1400caa0 tx=0x7fee1400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee11ffb640 1 -- 172.21.15.113:0/3129574667 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14017070 con 0x7fee1c159b30 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee11ffb640 1 -- 172.21.15.113:0/3129574667 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1400aba0 con 0x7fee1c159b30 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1c1e2260 con 0x7fee1c159b30 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee11ffb640 1 -- 172.21.15.113:0/3129574667 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14012400 con 0x7fee1c159b30 2024-04-22T06:32:23.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.994+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee1c1f1c10 con 0x7fee1c159b30 2024-04-22T06:32:23.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.995+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1c0c5c50 con 0x7fee1c159b30 2024-04-22T06:32:23.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.996+0000 7fee11ffb640 1 -- 172.21.15.113:0/3129574667 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee1401a070 con 0x7fee1c159b30 2024-04-22T06:32:23.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.996+0000 7fee11ffb640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fee0006c8f0 0x7fee0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:23.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.996+0000 7fee11ffb640 1 -- 172.21.15.113:0/3129574667 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fee1408bc20 con 0x7fee1c159b30 2024-04-22T06:32:23.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.996+0000 7fee213cd640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fee0006c8f0 0x7fee0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:23.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:23.997+0000 7fee213cd640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fee0006c8f0 0x7fee0006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee18009ac0 tx=0x7fee18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:23.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.000+0000 7fee11ffb640 1 -- 172.21.15.113:0/3129574667 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fee1c0c5c50 con 0x7fee1c159b30 2024-04-22T06:32:24.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.174+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fee1c068f50 con 0x7fee1c159b30 2024-04-22T06:32:24.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.174+0000 7fee11ffb640 1 -- 172.21.15.113:0/3129574667 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fee14059ce0 con 0x7fee1c159b30 2024-04-22T06:32:24.173 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fee0006c8f0 msgr2=0x7fee0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fee0006c8f0 0x7fee0006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee18009ac0 tx=0x7fee18008040 comp rx=0 tx=0).stop 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee1c159b30 msgr2=0x7fee1c1e2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee1c159b30 0x7fee1c1e2630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee1400caa0 tx=0x7fee1400cf60 comp rx=0 tx=0).stop 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 shutdown_connections 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fee0006c8f0 0x7fee0006edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fee1c159b30 0x7fee1c1e2630 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee1c151fc0 0x7fee1c1e13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 --2- 172.21.15.113:0/3129574667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee1c0ca470 0x7fee1c0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 >> 172.21.15.113:0/3129574667 conn(0x7fee1c06b920 msgr2=0x7fee1c0c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:24.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 shutdown_connections 2024-04-22T06:32:24.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.176+0000 7fee23631640 1 -- 172.21.15.113:0/3129574667 wait complete. 2024-04-22T06:32:24.186 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:32:24.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.284+0000 7faf91d8f640 1 Processor -- start 2024-04-22T06:32:24.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.284+0000 7faf91d8f640 1 -- start start 2024-04-22T06:32:24.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.284+0000 7faf91d8f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf8c072bd0 0x7faf8c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.284+0000 7faf91d8f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8c074240 con 0x7faf8c151f90 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.284+0000 7faf91d8f640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8c15b9b0 con 0x7faf8c070630 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.284+0000 7faf91d8f640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7faf8c0736a0 con 0x7faf8c072bd0 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.285+0000 7faf8b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7faf8c151f90 0x7faf8c073b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59702/0 (socket says 172.21.15.113:59702) 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.285+0000 7faf8b7fe640 1 -- 172.21.15.113:0/2765415764 learned_addr learned my addr 172.21.15.113:0/2765415764 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.285+0000 7faf8affd640 1 --2- 172.21.15.113:0/2765415764 >> v2:172.21.15.145:3300/0 conn(0x7faf8c072bd0 0x7faf8c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.285+0000 7faf8a7fc640 1 -- 172.21.15.113:0/2765415764 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669392021 0 0) 0x7faf8c074240 con 0x7faf8c151f90 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.285+0000 7faf8a7fc640 1 -- 172.21.15.113:0/2765415764 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf74003520 con 0x7faf8c151f90 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.285+0000 7faf8affd640 1 -- 172.21.15.113:0/2765415764 >> v1:172.21.15.145:6789/0 conn(0x7faf8c070630 legacy=0x7faf8c06f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.285+0000 7faf8affd640 1 -- 172.21.15.113:0/2765415764 >> v1:172.21.15.113:6789/0 conn(0x7faf8c151f90 legacy=0x7faf8c073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.285+0000 7faf8affd640 1 -- 172.21.15.113:0/2765415764 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c15bc90 con 0x7faf8c072bd0 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf8affd640 1 --2- 172.21.15.113:0/2765415764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c072bd0 0x7faf8c15b2b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faf800097a0 tx=0x7faf8002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29b2c20486f510df server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf8a7fc640 1 -- 172.21.15.113:0/2765415764 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8002f810 con 0x7faf8c072bd0 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf8a7fc640 1 -- 172.21.15.113:0/2765415764 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8002f9b0 con 0x7faf8c072bd0 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf8a7fc640 1 -- 172.21.15.113:0/2765415764 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8002fd60 con 0x7faf8c072bd0 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf91d8f640 1 -- 172.21.15.113:0/2765415764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c072bd0 msgr2=0x7faf8c15b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf91d8f640 1 --2- 172.21.15.113:0/2765415764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c072bd0 0x7faf8c15b2b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faf800097a0 tx=0x7faf8002b9f0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf91d8f640 1 -- 172.21.15.113:0/2765415764 shutdown_connections 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf91d8f640 1 --2- 172.21.15.113:0/2765415764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c072bd0 0x7faf8c15b2b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf91d8f640 1 -- 172.21.15.113:0/2765415764 >> 172.21.15.113:0/2765415764 conn(0x7faf8c0ca0d0 msgr2=0x7faf8c0ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:24.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.286+0000 7faf91d8f640 1 -- 172.21.15.113:0/2765415764 shutdown_connections 2024-04-22T06:32:24.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.287+0000 7faf91d8f640 1 -- 172.21.15.113:0/2765415764 wait complete. 2024-04-22T06:32:24.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.288+0000 7faf91d8f640 1 Processor -- start 2024-04-22T06:32:24.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.288+0000 7faf91d8f640 1 -- start start 2024-04-22T06:32:24.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.288+0000 7faf91d8f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c070630 0x7faf8c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.288+0000 7faf91d8f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf8c072bd0 0x7faf8c156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.288+0000 7faf91d8f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf8c151f90 0x7faf8c159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.288+0000 7faf91d8f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c0c7fd0 con 0x7faf8c151f90 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.288+0000 7faf91d8f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c073330 con 0x7faf8c070630 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.288+0000 7faf91d8f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7faf8c152370 con 0x7faf8c072bd0 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf8c151f90 0x7faf8c159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf8c151f90 0x7faf8c159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55122/0 (socket says 172.21.15.113:55122) 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 -- 172.21.15.113:0/1823714692 learned_addr learned my addr 172.21.15.113:0/1823714692 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8affd640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf8c072bd0 0x7faf8c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8b7fe640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c070630 0x7faf8c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 -- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf8c072bd0 msgr2=0x7faf8c156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf8c072bd0 0x7faf8c156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 -- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c070630 msgr2=0x7faf8c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c070630 0x7faf8c157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 -- 172.21.15.113:0/1823714692 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c1f16d0 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8b7fe640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c070630 0x7faf8c157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf8bfff640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf8c151f90 0x7faf8c159c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf8400c7a0 tx=0x7faf8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf73fff640 1 -- 172.21.15.113:0/1823714692 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84003b70 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf73fff640 1 -- 172.21.15.113:0/1823714692 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf84003d30 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c1585c0 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf73fff640 1 -- 172.21.15.113:0/1823714692 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8400aa90 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.289+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c159470 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.290+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8c068e20 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.291+0000 7faf73fff640 1 -- 172.21.15.113:0/1823714692 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf8400ac30 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.291+0000 7faf73fff640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faf7806c8f0 0x7faf7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.291+0000 7faf73fff640 1 -- 172.21.15.113:0/1823714692 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7faf8408bda0 con 0x7faf8c151f90 2024-04-22T06:32:24.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.291+0000 7faf8b7fe640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faf7806c8f0 0x7faf7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.292+0000 7faf8b7fe640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faf7806c8f0 0x7faf7806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0011e0 tx=0x7faf7c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.295+0000 7faf73fff640 1 -- 172.21.15.113:0/1823714692 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf84059de0 con 0x7faf8c151f90 2024-04-22T06:32:24.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.506+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf8c151660 con 0x7faf8c151f90 2024-04-22T06:32:24.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.507+0000 7faf73fff640 1 -- 172.21.15.113:0/1823714692 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6913 (secure 0 0 0) 0x7faf840596e0 con 0x7faf8c151f90 2024-04-22T06:32:24.506 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:24.506 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:19.967527+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4308,"mds_2":4305,"mds_3":4264,"mds_4":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":4,"incarnation":16,"state":"up:creating","state_seq":1,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"a","rank":2,"incarnation":12,"state":"up:active","state_seq":12,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:active","state_seq":11,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4311,4308,4305,4264]},"id":1}]} 2024-04-22T06:32:24.506 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 16 2024-04-22T06:32:24.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faf7806c8f0 msgr2=0x7faf7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faf7806c8f0 0x7faf7806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0011e0 tx=0x7faf7c009040 comp rx=0 tx=0).stop 2024-04-22T06:32:24.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf8c151f90 msgr2=0x7faf8c159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf8c151f90 0x7faf8c159c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf8400c7a0 tx=0x7faf8400cc60 comp rx=0 tx=0).stop 2024-04-22T06:32:24.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 shutdown_connections 2024-04-22T06:32:24.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faf7806c8f0 0x7faf7806edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faf8c151f90 0x7faf8c159c70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faf8c072bd0 0x7faf8c156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 --2- 172.21.15.113:0/1823714692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf8c070630 0x7faf8c157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 >> 172.21.15.113:0/1823714692 conn(0x7faf8c0ca0d0 msgr2=0x7faf8c06f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:24.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 shutdown_connections 2024-04-22T06:32:24.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.509+0000 7faf91d8f640 1 -- 172.21.15.113:0/1823714692 wait complete. 2024-04-22T06:32:24.519 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:24.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.617+0000 7f4c7359e640 1 Processor -- start 2024-04-22T06:32:24.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.617+0000 7f4c7359e640 1 -- start start 2024-04-22T06:32:24.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7359e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4c74153220 0x7f4c740c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7359e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c740caa80 con 0x7f4c740ca4b0 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7359e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c740cad60 con 0x7f4c74071540 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7359e640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f4c740710b0 con 0x7f4c74153220 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c71d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4c740ca4b0 0x7f4c7415c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59712/0 (socket says 172.21.15.113:59712) 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c71d9b640 1 -- 172.21.15.113:0/1690343989 learned_addr learned my addr 172.21.15.113:0/1690343989 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7259c640 1 --2- 172.21.15.113:0/1690343989 >> v2:172.21.15.145:3300/0 conn(0x7f4c74153220 0x7f4c740c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172927037 0 0) 0x7f4c740caa80 con 0x7f4c740ca4b0 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c5c003520 con 0x7f4c740ca4b0 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1633857167 0 0) 0x7f4c5c003520 con 0x7f4c740ca4b0 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 >> v2:172.21.15.145:3300/0 conn(0x7f4c74153220 msgr2=0x7f4c740c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 --2- 172.21.15.113:0/1690343989 >> v2:172.21.15.145:3300/0 conn(0x7f4c74153220 0x7f4c740c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 >> v1:172.21.15.145:6789/0 conn(0x7f4c74071540 legacy=0x7f4c740c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c74070a60 con 0x7f4c740ca4b0 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f4c68001670 con 0x7f4c740ca4b0 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 >> v1:172.21.15.113:6789/0 conn(0x7f4c740ca4b0 legacy=0x7f4c7415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c003a00 0x7f4c5c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c004800 0x7f4c5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c5c0051c0 0x7f4c5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740710b0 con 0x7f4c5c0051c0 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c00c0a0 con 0x7f4c5c003a00 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.618+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5c00c2a0 con 0x7f4c5c004800 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c72d9d640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c5c0051c0 0x7f4c5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c7259c640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c003a00 0x7f4c5c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c71d9b640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c004800 0x7f4c5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c72d9d640 1 -- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c004800 msgr2=0x7f4c5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c72d9d640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c004800 0x7f4c5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c72d9d640 1 -- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c003a00 msgr2=0x7f4c5c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c72d9d640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c003a00 0x7f4c5c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c72d9d640 1 -- 172.21.15.113:0/1690343989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c003520 con 0x7f4c5c0051c0 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.619+0000 7f4c7259c640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c003a00 0x7f4c5c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c72d9d640 1 -- 172.21.15.113:0/1690343989 reap_dead start 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c72d9d640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c5c0051c0 0x7f4c5c00b9c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4c740747e0 tx=0x7f4c5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e893034a754864d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64009690 con 0x7f4c5c0051c0 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6c003b70 con 0x7f4c5c0051c0 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7159a640 1 -- 172.21.15.113:0/1690343989 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c001a70 con 0x7f4c5c0051c0 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7359e640 1 -- 172.21.15.113:0/1690343989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c5c0051c0 msgr2=0x7f4c5c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7359e640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c5c0051c0 0x7f4c5c00b9c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4c740747e0 tx=0x7f4c5c005830 comp rx=0 tx=0).stop 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7359e640 1 -- 172.21.15.113:0/1690343989 shutdown_connections 2024-04-22T06:32:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7359e640 1 --2- 172.21.15.113:0/1690343989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c5c0051c0 0x7f4c5c00b9c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7359e640 1 -- 172.21.15.113:0/1690343989 >> 172.21.15.113:0/1690343989 conn(0x7f4c74074d50 msgr2=0x7f4c74075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:24.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7359e640 1 -- 172.21.15.113:0/1690343989 shutdown_connections 2024-04-22T06:32:24.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.620+0000 7f4c7359e640 1 -- 172.21.15.113:0/1690343989 wait complete. 2024-04-22T06:32:24.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.622+0000 7f4c7359e640 1 Processor -- start 2024-04-22T06:32:24.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.622+0000 7f4c7359e640 1 -- start start 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.622+0000 7f4c7359e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c0051c0 0x7f4c741471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c7359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c740ce090 0x7f4c741512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c7359e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c74158800 0x7f4c741eea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c7359e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740743d0 con 0x7f4c740ce090 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c7359e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74074250 con 0x7f4c74158800 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c7359e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4c74074550 con 0x7f4c5c0051c0 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c740ce090 0x7f4c741512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c740ce090 0x7f4c741512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55136/0 (socket says 172.21.15.113:55136) 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 -- 172.21.15.113:0/1970470989 learned_addr learned my addr 172.21.15.113:0/1970470989 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c7259c640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c0051c0 0x7f4c741471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c72d9d640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c74158800 0x7f4c741eea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 -- 172.21.15.113:0/1970470989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c0051c0 msgr2=0x7f4c741471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c0051c0 0x7f4c741471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 -- 172.21.15.113:0/1970470989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c74158800 msgr2=0x7f4c741eea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c74158800 0x7f4c741eea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 -- 172.21.15.113:0/1970470989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c741477f0 con 0x7f4c740ce090 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c71d9b640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c740ce090 0x7f4c741512a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4c68007290 tx=0x7f4c68007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c62ffd640 1 -- 172.21.15.113:0/1970470989 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800f9c0 con 0x7f4c740ce090 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c62ffd640 1 -- 172.21.15.113:0/1970470989 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c68018070 con 0x7f4c740ce090 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c741485f0 con 0x7f4c740ce090 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c62ffd640 1 -- 172.21.15.113:0/1970470989 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800fdc0 con 0x7f4c740ce090 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.623+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c74148bb0 con 0x7f4c740ce090 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.624+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c74069310 con 0x7f4c740ce090 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.625+0000 7f4c62ffd640 1 -- 172.21.15.113:0/1970470989 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c6801d460 con 0x7f4c740ce090 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.626+0000 7f4c62ffd640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c5406c8f0 0x7f4c5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.626+0000 7f4c7259c640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c5406c8f0 0x7f4c5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.626+0000 7f4c62ffd640 1 -- 172.21.15.113:0/1970470989 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4c6808bfb0 con 0x7f4c740ce090 2024-04-22T06:32:24.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.626+0000 7f4c7259c640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c5406c8f0 0x7f4c5406edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009960 tx=0x7f4c64008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.628 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.630+0000 7f4c62ffd640 1 -- 172.21.15.113:0/1970470989 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4c68059fe0 con 0x7f4c740ce090 2024-04-22T06:32:24.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.806+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c74071960 con 0x7f4c740ce090 2024-04-22T06:32:24.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.808+0000 7f4c62ffd640 1 -- 172.21.15.113:0/1970470989 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f4c6805ee20 con 0x7f4c740ce090 2024-04-22T06:32:24.807 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:24.807 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:24.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.809+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c5406c8f0 msgr2=0x7f4c5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.809+0000 7f4c7359e640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c5406c8f0 0x7f4c5406edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009960 tx=0x7f4c64008040 comp rx=0 tx=0).stop 2024-04-22T06:32:24.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.809+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c740ce090 msgr2=0x7f4c741512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.809+0000 7f4c7359e640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c740ce090 0x7f4c741512a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4c68007290 tx=0x7f4c68007690 comp rx=0 tx=0).stop 2024-04-22T06:32:24.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.810+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 shutdown_connections 2024-04-22T06:32:24.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.810+0000 7f4c7359e640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c74158800 0x7f4c741eea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.810+0000 7f4c7359e640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4c5406c8f0 0x7f4c5406edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.810+0000 7f4c7359e640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c740ce090 0x7f4c741512a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.810+0000 7f4c7359e640 1 --2- 172.21.15.113:0/1970470989 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c5c0051c0 0x7f4c741471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.810+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 >> 172.21.15.113:0/1970470989 conn(0x7f4c74074d50 msgr2=0x7f4c740c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:24.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.810+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 shutdown_connections 2024-04-22T06:32:24.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.810+0000 7f4c7359e640 1 -- 172.21.15.113:0/1970470989 wait complete. 2024-04-22T06:32:24.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:32:24.821 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:32:24.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.923+0000 7f050f752640 1 Processor -- start 2024-04-22T06:32:24.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.924+0000 7f050f752640 1 -- start start 2024-04-22T06:32:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.924+0000 7f050f752640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cb5c0 0x7f050806f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.924+0000 7f050f752640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f05080cb9a0 0x7f0508154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.924+0000 7f050f752640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050806fd30 con 0x7f05080cae40 2024-04-22T06:32:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.924+0000 7f050f752640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f05080c9d90 con 0x7f05080cb9a0 2024-04-22T06:32:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.924+0000 7f050f752640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f05080ca070 con 0x7f05080cb5c0 2024-04-22T06:32:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f050dcef640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f05080cb9a0 0x7f0508154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f050d4ee640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cb5c0 0x7f050806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f050cced640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f05080cae40 0x7f050815b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:45178/0 (socket says 172.21.15.113:45178) 2024-04-22T06:32:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f050cced640 1 -- 172.21.15.113:0/272020431 learned_addr learned my addr 172.21.15.113:0/272020431 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f04fffff640 1 -- 172.21.15.113:0/272020431 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357196745 0 0) 0x7f050806fd30 con 0x7f05080cae40 2024-04-22T06:32:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f050d4ee640 1 -- 172.21.15.113:0/272020431 >> v2:172.21.15.145:3300/0 conn(0x7f05080cb9a0 msgr2=0x7f0508154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f050d4ee640 1 --2- 172.21.15.113:0/272020431 >> v2:172.21.15.145:3300/0 conn(0x7f05080cb9a0 0x7f0508154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f050d4ee640 1 -- 172.21.15.113:0/272020431 >> v1:172.21.15.145:6789/0 conn(0x7f05080cae40 legacy=0x7f050815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.925+0000 7f050d4ee640 1 -- 172.21.15.113:0/272020431 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05080ca350 con 0x7f05080cb5c0 2024-04-22T06:32:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.926+0000 7f050d4ee640 1 --2- 172.21.15.113:0/272020431 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cb5c0 0x7f050806f380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05040097a0 tx=0x7f050402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2361d8c34c6f90d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.926+0000 7f04fffff640 1 -- 172.21.15.113:0/272020431 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504035020 con 0x7f05080cb5c0 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.926+0000 7f04fffff640 1 -- 172.21.15.113:0/272020431 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0504031830 con 0x7f05080cb5c0 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.926+0000 7f04fffff640 1 -- 172.21.15.113:0/272020431 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504031c00 con 0x7f05080cb5c0 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.926+0000 7f050f752640 1 -- 172.21.15.113:0/272020431 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cb5c0 msgr2=0x7f050806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.926+0000 7f050f752640 1 --2- 172.21.15.113:0/272020431 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cb5c0 0x7f050806f380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05040097a0 tx=0x7f050402b8d0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.927+0000 7f050f752640 1 -- 172.21.15.113:0/272020431 shutdown_connections 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.927+0000 7f050f752640 1 --2- 172.21.15.113:0/272020431 >> v2:172.21.15.145:3300/0 conn(0x7f05080cb9a0 0x7f0508154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.927+0000 7f050f752640 1 --2- 172.21.15.113:0/272020431 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cb5c0 0x7f050806f380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.927+0000 7f050f752640 1 -- 172.21.15.113:0/272020431 >> 172.21.15.113:0/272020431 conn(0x7f0508074d50 msgr2=0x7f0508075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.927+0000 7f050f752640 1 -- 172.21.15.113:0/272020431 shutdown_connections 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.927+0000 7f050f752640 1 -- 172.21.15.113:0/272020431 wait complete. 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.928+0000 7f050f752640 1 Processor -- start 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.928+0000 7f050f752640 1 -- start start 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.928+0000 7f050f752640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cae40 0x7f0508151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.928+0000 7f050f752640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f05080cb5c0 0x7f0508150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.928+0000 7f050f752640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05080cb9a0 0x7f0508156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.928+0000 7f050f752640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f050806c450 con 0x7f05080cb5c0 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.928+0000 7f050f752640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f05080ca910 con 0x7f05080cb9a0 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.928+0000 7f050f752640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f050806c5d0 con 0x7f05080cae40 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f05080cb5c0 0x7f0508150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f05080cb5c0 0x7f0508150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55140/0 (socket says 172.21.15.113:55140) 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 -- 172.21.15.113:0/1784370577 learned_addr learned my addr 172.21.15.113:0/1784370577 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050d4ee640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cae40 0x7f0508151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050dcef640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05080cb9a0 0x7f0508156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 -- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cae40 msgr2=0x7f0508151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cae40 0x7f0508151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 -- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05080cb9a0 msgr2=0x7f0508156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05080cb9a0 0x7f0508156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 -- 172.21.15.113:0/1784370577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050814eed0 con 0x7f05080cb5c0 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050d4ee640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cae40 0x7f0508151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050cced640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f05080cb5c0 0x7f0508150c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c4b0 tx=0x7f04f800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f04fdffb640 1 -- 172.21.15.113:0/1784370577 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8018070 con 0x7f05080cb5c0 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0508158520 con 0x7f05080cb5c0 2024-04-22T06:32:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f04fdffb640 1 -- 172.21.15.113:0/1784370577 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f8007500 con 0x7f05080cb5c0 2024-04-22T06:32:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f04fdffb640 1 -- 172.21.15.113:0/1784370577 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8004a20 con 0x7f05080cb5c0 2024-04-22T06:32:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.929+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0508158ae0 con 0x7f05080cb5c0 2024-04-22T06:32:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.930+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0508154480 con 0x7f05080cb5c0 2024-04-22T06:32:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.931+0000 7f04fdffb640 1 -- 172.21.15.113:0/1784370577 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04f801b070 con 0x7f05080cb5c0 2024-04-22T06:32:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.931+0000 7f04fdffb640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f04ec06c8f0 0x7f04ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:24.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.931+0000 7f04fdffb640 1 -- 172.21.15.113:0/1784370577 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f04f808b1f0 con 0x7f05080cb5c0 2024-04-22T06:32:24.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.931+0000 7f050d4ee640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f04ec06c8f0 0x7f04ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:24.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.932+0000 7f050d4ee640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f04ec06c8f0 0x7f04ec06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0504036000 tx=0x7f0504008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:24.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:24.935+0000 7f04fdffb640 1 -- 172.21.15.113:0/1784370577 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f04f8059370 con 0x7f05080cb5c0 2024-04-22T06:32:25.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.117+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0508068f50 con 0x7f05080cb5c0 2024-04-22T06:32:25.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.117+0000 7f04fdffb640 1 -- 172.21.15.113:0/1784370577 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f04f805f020 con 0x7f05080cb5c0 2024-04-22T06:32:25.116 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:32:25.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f04ec06c8f0 msgr2=0x7f04ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f04ec06c8f0 0x7f04ec06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0504036000 tx=0x7f0504008030 comp rx=0 tx=0).stop 2024-04-22T06:32:25.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f05080cb5c0 msgr2=0x7f0508150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f05080cb5c0 0x7f0508150c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c4b0 tx=0x7f04f800c970 comp rx=0 tx=0).stop 2024-04-22T06:32:25.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 shutdown_connections 2024-04-22T06:32:25.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f05080cb9a0 0x7f0508156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f04ec06c8f0 0x7f04ec06edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f05080cb5c0 0x7f0508150c90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 --2- 172.21.15.113:0/1784370577 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f05080cae40 0x7f0508151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 >> 172.21.15.113:0/1784370577 conn(0x7f0508074d50 msgr2=0x7f0508075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 shutdown_connections 2024-04-22T06:32:25.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.119+0000 7f050f752640 1 -- 172.21.15.113:0/1784370577 wait complete. 2024-04-22T06:32:25.129 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:32:25.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.229+0000 7f7b21752640 1 Processor -- start 2024-04-22T06:32:25.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.229+0000 7f7b21752640 1 -- start start 2024-04-22T06:32:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b21752640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b1c06cc00 0x7f7b1c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b21752640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c0cbc00 0x7f7b1c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b21752640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c15f500 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b21752640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1c0cd140 con 0x7f7b1c06cc00 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b21752640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c15b190 con 0x7f7b1c0cbc00 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b1affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b1c06cc00 0x7f7b1c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b1affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b1c06cc00 0x7f7b1c15efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55142/0 (socket says 172.21.15.113:55142) 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b1affd640 1 -- 172.21.15.113:0/2798626405 learned_addr learned my addr 172.21.15.113:0/2798626405 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b1affd640 1 -- 172.21.15.113:0/2798626405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c0cbc00 msgr2=0x7f7b1c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b1affd640 1 --2- 172.21.15.113:0/2798626405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c0cbc00 0x7f7b1c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b1affd640 1 -- 172.21.15.113:0/2798626405 >> v1:172.21.15.145:6789/0 conn(0x7f7b1c06cfe0 legacy=0x7f7b1c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.230+0000 7f7b1affd640 1 -- 172.21.15.113:0/2798626405 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c15b470 con 0x7f7b1c06cc00 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.231+0000 7f7b1affd640 1 --2- 172.21.15.113:0/2798626405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cc00 0x7f7b1c15efc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009e80 tx=0x7f7b0c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12adb686ca9e2cd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.231+0000 7f7b19ffb640 1 -- 172.21.15.113:0/2798626405 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c02caf0 con 0x7f7b1c06cc00 2024-04-22T06:32:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.231+0000 7f7b19ffb640 1 -- 172.21.15.113:0/2798626405 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c02cc90 con 0x7f7b1c06cc00 2024-04-22T06:32:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.231+0000 7f7b19ffb640 1 -- 172.21.15.113:0/2798626405 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c034610 con 0x7f7b1c06cc00 2024-04-22T06:32:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.232+0000 7f7b21752640 1 -- 172.21.15.113:0/2798626405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cc00 msgr2=0x7f7b1c15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.232+0000 7f7b21752640 1 --2- 172.21.15.113:0/2798626405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cc00 0x7f7b1c15efc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009e80 tx=0x7f7b0c02bf50 comp rx=0 tx=0).stop 2024-04-22T06:32:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.232+0000 7f7b21752640 1 -- 172.21.15.113:0/2798626405 shutdown_connections 2024-04-22T06:32:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.232+0000 7f7b21752640 1 --2- 172.21.15.113:0/2798626405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c0cbc00 0x7f7b1c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.232+0000 7f7b21752640 1 --2- 172.21.15.113:0/2798626405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cc00 0x7f7b1c15efc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.232+0000 7f7b21752640 1 -- 172.21.15.113:0/2798626405 >> 172.21.15.113:0/2798626405 conn(0x7f7b1c075570 msgr2=0x7f7b1c073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.232+0000 7f7b21752640 1 -- 172.21.15.113:0/2798626405 shutdown_connections 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.232+0000 7f7b21752640 1 -- 172.21.15.113:0/2798626405 wait complete. 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.233+0000 7f7b21752640 1 Processor -- start 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.233+0000 7f7b21752640 1 -- start start 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b21752640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c06cc00 0x7f7b1c1e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b21752640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cfe0 0x7f7b1c0cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b21752640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b1c0cbc00 0x7f7b1c142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b21752640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c15bd10 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b21752640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c15ba30 con 0x7f7b1c0cbc00 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b21752640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c155630 con 0x7f7b1c06cc00 2024-04-22T06:32:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cfe0 0x7f7b1c0cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cfe0 0x7f7b1c0cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55144/0 (socket says 172.21.15.113:55144) 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 -- 172.21.15.113:0/4171147490 learned_addr learned my addr 172.21.15.113:0/4171147490 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1b7fe640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b1c0cbc00 0x7f7b1c142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1affd640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c06cc00 0x7f7b1c1e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 -- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c06cc00 msgr2=0x7f7b1c1e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c06cc00 0x7f7b1c1e6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 -- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b1c0cbc00 msgr2=0x7f7b1c142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b1c0cbc00 0x7f7b1c142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 -- 172.21.15.113:0/4171147490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c1e5240 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1affd640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c06cc00 0x7f7b1c1e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b1a7fc640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cfe0 0x7f7b1c0cfda0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c430 tx=0x7f7b1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b037fe640 1 -- 172.21.15.113:0/4171147490 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10011790 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b037fe640 1 -- 172.21.15.113:0/4171147490 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b10017070 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b037fe640 1 -- 172.21.15.113:0/4171147490 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10011b70 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c15c590 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.234+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c1e57c0 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.235+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c068f50 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.236+0000 7f7b037fe640 1 -- 172.21.15.113:0/4171147490 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b10011d10 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.236+0000 7f7b037fe640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7b0806c920 0x7f7b0806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.236+0000 7f7b1affd640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7b0806c920 0x7f7b0806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.236+0000 7f7b037fe640 1 -- 172.21.15.113:0/4171147490 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7b1008bd60 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.237+0000 7f7b1affd640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7b0806c920 0x7f7b0806ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c035000 tx=0x7f7b0c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.241+0000 7f7b037fe640 1 -- 172.21.15.113:0/4171147490 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b10059e20 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.413+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7b1c0cc2b0 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.413+0000 7f7b037fe640 1 -- 172.21.15.113:0/4171147490 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f7b10059720 con 0x7f7b1c06cfe0 2024-04-22T06:32:25.412 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:25.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7b0806c920 msgr2=0x7f7b0806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7b0806c920 0x7f7b0806ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c035000 tx=0x7f7b0c030000 comp rx=0 tx=0).stop 2024-04-22T06:32:25.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cfe0 msgr2=0x7f7b1c0cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cfe0 0x7f7b1c0cfda0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c430 tx=0x7f7b1000c8f0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 shutdown_connections 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b1c0cbc00 0x7f7b1c142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f7b0806c920 0x7f7b0806ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7b1c06cfe0 0x7f7b1c0cfda0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 --2- 172.21.15.113:0/4171147490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b1c06cc00 0x7f7b1c1e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 >> 172.21.15.113:0/4171147490 conn(0x7f7b1c075570 msgr2=0x7f7b1c153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 shutdown_connections 2024-04-22T06:32:25.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.415+0000 7f7b21752640 1 -- 172.21.15.113:0/4171147490 wait complete. 2024-04-22T06:32:25.425 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:32:25.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.525+0000 7fd174093640 1 Processor -- start 2024-04-22T06:32:25.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.525+0000 7fd174093640 1 -- start start 2024-04-22T06:32:25.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.526+0000 7fd174093640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd16c1595f0 0x7fd16c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.526+0000 7fd174093640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd16c0c8660 0x7fd16c0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.526+0000 7fd174093640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c159f80 con 0x7fd16c151fc0 2024-04-22T06:32:25.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.526+0000 7fd174093640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fd16c15b420 con 0x7fd16c1595f0 2024-04-22T06:32:25.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.526+0000 7fd174093640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fd16c15b700 con 0x7fd16c0c8660 2024-04-22T06:32:25.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.526+0000 7fd17162e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd16c1595f0 0x7fd16c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.526+0000 7fd17162e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd16c1595f0 0x7fd16c159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55148/0 (socket says 172.21.15.113:55148) 2024-04-22T06:32:25.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.526+0000 7fd17162e640 1 -- 172.21.15.113:0/583245179 learned_addr learned my addr 172.21.15.113:0/583245179 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:25.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.527+0000 7fd172630640 1 --2- 172.21.15.113:0/583245179 >> v2:172.21.15.145:3300/0 conn(0x7fd16c0c8660 0x7fd16c0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.527+0000 7fd17162e640 1 -- 172.21.15.113:0/583245179 >> v2:172.21.15.145:3300/0 conn(0x7fd16c0c8660 msgr2=0x7fd16c0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:25.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.527+0000 7fd17162e640 1 --2- 172.21.15.113:0/583245179 >> v2:172.21.15.145:3300/0 conn(0x7fd16c0c8660 0x7fd16c0c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.527+0000 7fd17162e640 1 -- 172.21.15.113:0/583245179 >> v1:172.21.15.145:6789/0 conn(0x7fd16c151fc0 legacy=0x7fd16c0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:25.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.527+0000 7fd17162e640 1 -- 172.21.15.113:0/583245179 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c15b9e0 con 0x7fd16c1595f0 2024-04-22T06:32:25.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.527+0000 7fd17162e640 1 --2- 172.21.15.113:0/583245179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c1595f0 0x7fd16c159a40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd16c06ed70 tx=0x7fd15c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321237c3cbce2151 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd170e2d640 1 -- 172.21.15.113:0/583245179 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c034070 con 0x7fd16c1595f0 2024-04-22T06:32:25.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd170e2d640 1 -- 172.21.15.113:0/583245179 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15c030860 con 0x7fd16c1595f0 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd170e2d640 1 -- 172.21.15.113:0/583245179 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c030c30 con 0x7fd16c1595f0 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd174093640 1 -- 172.21.15.113:0/583245179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c1595f0 msgr2=0x7fd16c159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd174093640 1 --2- 172.21.15.113:0/583245179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c1595f0 0x7fd16c159a40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd16c06ed70 tx=0x7fd15c02b9a0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd174093640 1 -- 172.21.15.113:0/583245179 shutdown_connections 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd174093640 1 --2- 172.21.15.113:0/583245179 >> v2:172.21.15.145:3300/0 conn(0x7fd16c0c8660 0x7fd16c0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd174093640 1 --2- 172.21.15.113:0/583245179 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c1595f0 0x7fd16c159a40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd174093640 1 -- 172.21.15.113:0/583245179 >> 172.21.15.113:0/583245179 conn(0x7fd16c06b920 msgr2=0x7fd16c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd174093640 1 -- 172.21.15.113:0/583245179 shutdown_connections 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.528+0000 7fd174093640 1 -- 172.21.15.113:0/583245179 wait complete. 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.529+0000 7fd174093640 1 Processor -- start 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.529+0000 7fd174093640 1 -- start start 2024-04-22T06:32:25.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd174093640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c0c8660 0x7fd16c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd174093640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd16c151fc0 0x7fd16c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd174093640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd16c1595f0 0x7fd16c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd174093640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c158b80 con 0x7fd16c0c8660 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd174093640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c15bfa0 con 0x7fd16c151fc0 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd174093640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c1523a0 con 0x7fd16c1595f0 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd171e2f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c0c8660 0x7fd16c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd171e2f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c0c8660 0x7fd16c155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55160/0 (socket says 172.21.15.113:55160) 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd171e2f640 1 -- 172.21.15.113:0/1377373485 learned_addr learned my addr 172.21.15.113:0/1377373485 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd17162e640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd16c151fc0 0x7fd16c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.530+0000 7fd172630640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd16c1595f0 0x7fd16c14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd171e2f640 1 -- 172.21.15.113:0/1377373485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd16c1595f0 msgr2=0x7fd16c14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd171e2f640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd16c1595f0 0x7fd16c14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd171e2f640 1 -- 172.21.15.113:0/1377373485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd16c151fc0 msgr2=0x7fd16c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd171e2f640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd16c151fc0 0x7fd16c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd171e2f640 1 -- 172.21.15.113:0/1377373485 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c14e0e0 con 0x7fd16c0c8660 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd171e2f640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c0c8660 0x7fd16c155bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd16800c7c0 tx=0x7fd16800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd1627fc640 1 -- 172.21.15.113:0/1377373485 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168016020 con 0x7fd16c0c8660 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd1627fc640 1 -- 172.21.15.113:0/1377373485 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16800aa50 con 0x7fd16c0c8660 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd1627fc640 1 -- 172.21.15.113:0/1377373485 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16800ae40 con 0x7fd16c0c8660 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16c14c400 con 0x7fd16c0c8660 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.531+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16c14c9c0 con 0x7fd16c0c8660 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.532+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16c068f50 con 0x7fd16c0c8660 2024-04-22T06:32:25.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.532+0000 7fd1627fc640 1 -- 172.21.15.113:0/1377373485 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd168019020 con 0x7fd16c0c8660 2024-04-22T06:32:25.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.533+0000 7fd1627fc640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd15006c8f0 0x7fd15006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.533+0000 7fd17162e640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd15006c8f0 0x7fd15006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.533+0000 7fd1627fc640 1 -- 172.21.15.113:0/1377373485 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd16808bf30 con 0x7fd16c0c8660 2024-04-22T06:32:25.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.533+0000 7fd17162e640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd15006c8f0 0x7fd15006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd15c036000 tx=0x7fd15c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.537+0000 7fd1627fc640 1 -- 172.21.15.113:0/1377373485 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd168020030 con 0x7fd16c0c8660 2024-04-22T06:32:25.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.711+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd16c0c99c0 con 0x7fd16c0c8660 2024-04-22T06:32:25.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.712+0000 7fd1627fc640 1 -- 172.21.15.113:0/1377373485 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fd168059880 con 0x7fd16c0c8660 2024-04-22T06:32:25.711 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:32:25.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd15006c8f0 msgr2=0x7fd15006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd15006c8f0 0x7fd15006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd15c036000 tx=0x7fd15c008030 comp rx=0 tx=0).stop 2024-04-22T06:32:25.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c0c8660 msgr2=0x7fd16c155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c0c8660 0x7fd16c155bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd16800c7c0 tx=0x7fd16800cc80 comp rx=0 tx=0).stop 2024-04-22T06:32:25.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 shutdown_connections 2024-04-22T06:32:25.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd16c1595f0 0x7fd16c14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd16c151fc0 0x7fd16c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd15006c8f0 0x7fd15006edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 --2- 172.21.15.113:0/1377373485 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd16c0c8660 0x7fd16c155bb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 >> 172.21.15.113:0/1377373485 conn(0x7fd16c06b920 msgr2=0x7fd16c0c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:25.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 shutdown_connections 2024-04-22T06:32:25.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.714+0000 7fd174093640 1 -- 172.21.15.113:0/1377373485 wait complete. 2024-04-22T06:32:25.725 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.827+0000 7faefd154640 1 Processor -- start 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.827+0000 7faefd154640 1 -- start start 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faefd154640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 0x7faef8073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faefd154640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faef8159370 0x7faef81597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faefd154640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef8159d20 con 0x7faef80caa70 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faefd154640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7faef8074400 con 0x7faef8159370 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faefd154640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7faef8153530 con 0x7faef8153150 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faef759e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faef8159370 0x7faef81597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faef759e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faef8159370 0x7faef81597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55166/0 (socket says 172.21.15.113:55166) 2024-04-22T06:32:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faef759e640 1 -- 172.21.15.113:0/3515023388 learned_addr learned my addr 172.21.15.113:0/3515023388 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faef6d9d640 1 --2- 172.21.15.113:0/3515023388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 0x7faef8073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faef759e640 1 -- 172.21.15.113:0/3515023388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 msgr2=0x7faef8073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faef759e640 1 --2- 172.21.15.113:0/3515023388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 0x7faef8073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faef759e640 1 -- 172.21.15.113:0/3515023388 >> v1:172.21.15.145:6789/0 conn(0x7faef80caa70 legacy=0x7faef80ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.828+0000 7faef759e640 1 -- 172.21.15.113:0/3515023388 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef80c7c00 con 0x7faef8159370 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.829+0000 7faef759e640 1 --2- 172.21.15.113:0/3515023388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81597e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faef0009870 tx=0x7faef002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29ef25797f82bea server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.829+0000 7faef5d9b640 1 -- 172.21.15.113:0/3515023388 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef002f840 con 0x7faef8159370 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.829+0000 7faef5d9b640 1 -- 172.21.15.113:0/3515023388 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef002f9e0 con 0x7faef8159370 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.829+0000 7faef5d9b640 1 -- 172.21.15.113:0/3515023388 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef002fdb0 con 0x7faef8159370 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.830+0000 7faefd154640 1 -- 172.21.15.113:0/3515023388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 msgr2=0x7faef81597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.830+0000 7faefd154640 1 --2- 172.21.15.113:0/3515023388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81597e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faef0009870 tx=0x7faef002ba20 comp rx=0 tx=0).stop 2024-04-22T06:32:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.830+0000 7faefd154640 1 -- 172.21.15.113:0/3515023388 shutdown_connections 2024-04-22T06:32:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.830+0000 7faefd154640 1 --2- 172.21.15.113:0/3515023388 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81597e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.830+0000 7faefd154640 1 --2- 172.21.15.113:0/3515023388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 0x7faef8073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.830+0000 7faefd154640 1 -- 172.21.15.113:0/3515023388 >> 172.21.15.113:0/3515023388 conn(0x7faef8074d50 msgr2=0x7faef8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.830+0000 7faefd154640 1 -- 172.21.15.113:0/3515023388 shutdown_connections 2024-04-22T06:32:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.830+0000 7faefd154640 1 -- 172.21.15.113:0/3515023388 wait complete. 2024-04-22T06:32:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.831+0000 7faefd154640 1 Processor -- start 2024-04-22T06:32:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.831+0000 7faefd154640 1 -- start start 2024-04-22T06:32:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faefd154640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faef80caa70 0x7faef815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faefd154640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 0x7faef8157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faefd154640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faefd154640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7faef80c8480 con 0x7faef8159370 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faefd154640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faef80c81a0 con 0x7faef80caa70 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faefd154640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7faef80c8760 con 0x7faef8153150 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef759e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81f5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55172/0 (socket says 172.21.15.113:55172) 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef759e640 1 -- 172.21.15.113:0/1171567073 learned_addr learned my addr 172.21.15.113:0/1171567073 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef6d9d640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faef80caa70 0x7faef815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef659c640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 0x7faef8157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef759e640 1 -- 172.21.15.113:0/1171567073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 msgr2=0x7faef8157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef759e640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 0x7faef8157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef759e640 1 -- 172.21.15.113:0/1171567073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faef80caa70 msgr2=0x7faef815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.832+0000 7faef759e640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faef80caa70 0x7faef815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:25.835 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.833+0000 7faef759e640 1 -- 172.21.15.113:0/1171567073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef8152900 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.833+0000 7faef759e640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81f5420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faef0009870 tx=0x7faef0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.833+0000 7faedf7fe640 1 -- 172.21.15.113:0/1171567073 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0037c40 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.833+0000 7faedf7fe640 1 -- 172.21.15.113:0/1171567073 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef0046070 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.833+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef806ce10 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.833+0000 7faedf7fe640 1 -- 172.21.15.113:0/1171567073 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0041400 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.833+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef806d3d0 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.834+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef8068f50 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.834+0000 7faedf7fe640 1 -- 172.21.15.113:0/1171567073 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faef0040070 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.835+0000 7faedf7fe640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faee406c8f0 0x7faee406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.835+0000 7faedf7fe640 1 -- 172.21.15.113:0/1171567073 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7faef00ae3d0 con 0x7faef8159370 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.835+0000 7faef6d9d640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faee406c8f0 0x7faee406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.835+0000 7faef6d9d640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faee406c8f0 0x7faee406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faee8003b80 tx=0x7faee80098d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:25.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:25.839+0000 7faedf7fe640 1 -- 172.21.15.113:0/1171567073 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faef0033030 con 0x7faef8159370 2024-04-22T06:32:26.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.045+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7faef80696e0 con 0x7faef8159370 2024-04-22T06:32:26.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.045+0000 7faedf7fe640 1 -- 172.21.15.113:0/1171567073 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7faef007be70 con 0x7faef8159370 2024-04-22T06:32:26.044 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:26.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faee406c8f0 msgr2=0x7faee406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faee406c8f0 0x7faee406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faee8003b80 tx=0x7faee80098d0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 msgr2=0x7faef81f5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81f5420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faef0009870 tx=0x7faef0004730 comp rx=0 tx=0).stop 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 shutdown_connections 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7faee406c8f0 0x7faee406edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faef8159370 0x7faef81f5420 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faef8153150 0x7faef8157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 --2- 172.21.15.113:0/1171567073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faef80caa70 0x7faef815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.047+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 >> 172.21.15.113:0/1171567073 conn(0x7faef8074d50 msgr2=0x7faef80c9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.048+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 shutdown_connections 2024-04-22T06:32:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.048+0000 7faefd154640 1 -- 172.21.15.113:0/1171567073 wait complete. 2024-04-22T06:32:26.058 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:32:26.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.158+0000 7f9aafc81640 1 Processor -- start 2024-04-22T06:32:26.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.158+0000 7f9aafc81640 1 -- start start 2024-04-22T06:32:26.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aafc81640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 0x7f9aa8154e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aafc81640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa815e7a0 con 0x7f9aa80ca6e0 2024-04-22T06:32:26.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aafc81640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa815ea80 con 0x7f9aa80c8260 2024-04-22T06:32:26.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aafc81640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa8070ba0 con 0x7f9aa80caac0 2024-04-22T06:32:26.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aada1d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9aa80ca6e0 0x7f9aa8070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59716/0 (socket says 172.21.15.113:59716) 2024-04-22T06:32:26.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aada1d640 1 -- 172.21.15.113:0/3369289123 learned_addr learned my addr 172.21.15.113:0/3369289123 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262799265 0 0) 0x7f9aa815e7a0 con 0x7f9aa80ca6e0 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aad21c640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 0x7f9aa8154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a94003520 con 0x7f9aa80ca6e0 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1592399334 0 0) 0x7f9a94003520 con 0x7f9aa80ca6e0 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 msgr2=0x7f9aa8154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 0x7f9aa8154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 >> v1:172.21.15.145:6789/0 conn(0x7f9aa80c8260 legacy=0x7f9aa815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa815ed60 con 0x7f9aa80ca6e0 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f9aa4001670 con 0x7f9aa80ca6e0 2024-04-22T06:32:26.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aad21c640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 0x7f9aa8154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:26.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 >> v1:172.21.15.113:6789/0 conn(0x7f9aa80ca6e0 legacy=0x7f9aa8070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 0x7f9a940039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9a94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a94004d40 0x7f9a940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9400bb80 con 0x7f9a94003fd0 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9400bd30 con 0x7f9a94004d40 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9400bf30 con 0x7f9aa80caac0 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.159+0000 7f9aad21c640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9a94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.160+0000 7f9aae21e640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a94004d40 0x7f9a940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.160+0000 7f9aada1d640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 0x7f9a940039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.160+0000 7f9aad21c640 1 -- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 msgr2=0x7f9a940039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.160+0000 7f9aad21c640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80caac0 0x7f9a940039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.160+0000 7f9aad21c640 1 -- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a94004d40 msgr2=0x7f9a940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.160+0000 7f9aad21c640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a94004d40 0x7f9a940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.160+0000 7f9aad21c640 1 -- 172.21.15.113:0/3369289123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a94003520 con 0x7f9a94003fd0 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aad21c640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9a94004800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9a980098a0 tx=0x7f9a94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0ab1ad2006a536 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800f040 con 0x7f9a94003fd0 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a98004230 con 0x7f9a94003fd0 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aaca1b640 1 -- 172.21.15.113:0/3369289123 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9802d040 con 0x7f9a94003fd0 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aafc81640 1 -- 172.21.15.113:0/3369289123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 msgr2=0x7f9a94004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aafc81640 1 --2- 172.21.15.113:0/3369289123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9a94004800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9a980098a0 tx=0x7f9a94005830 comp rx=0 tx=0).stop 2024-04-22T06:32:26.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aae21e640 1 -- 172.21.15.113:0/3369289123 reap_dead start 2024-04-22T06:32:26.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aafc81640 1 -- 172.21.15.113:0/3369289123 shutdown_connections 2024-04-22T06:32:26.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aafc81640 1 -- 172.21.15.113:0/3369289123 >> 172.21.15.113:0/3369289123 conn(0x7f9aa806bd10 msgr2=0x7f9aa806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:26.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aafc81640 1 -- 172.21.15.113:0/3369289123 shutdown_connections 2024-04-22T06:32:26.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.161+0000 7f9aafc81640 1 -- 172.21.15.113:0/3369289123 wait complete. 2024-04-22T06:32:26.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.162+0000 7f9aafc81640 1 Processor -- start 2024-04-22T06:32:26.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.162+0000 7f9aafc81640 1 -- start start 2024-04-22T06:32:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aafc81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9aa80cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aafc81640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80ccfb0 0x7f9aa80cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aafc81640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9aa814fd50 0x7f9aa80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aafc81640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa80c9e30 con 0x7f9a94003fd0 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aafc81640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa815f320 con 0x7f9aa814fd50 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aafc81640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa815bb90 con 0x7f9aa80ccfb0 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aada1d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9aa80cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aada1d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9aa80cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55198/0 (socket says 172.21.15.113:55198) 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aada1d640 1 -- 172.21.15.113:0/1525515640 learned_addr learned my addr 172.21.15.113:0/1525515640 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aad21c640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80ccfb0 0x7f9aa80cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aae21e640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9aa814fd50 0x7f9aa80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aada1d640 1 -- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80ccfb0 msgr2=0x7f9aa80cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aada1d640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80ccfb0 0x7f9aa80cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aada1d640 1 -- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9aa814fd50 msgr2=0x7f9aa80cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aada1d640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9aa814fd50 0x7f9aa80cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aada1d640 1 -- 172.21.15.113:0/1525515640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa81f0ff0 con 0x7f9a94003fd0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.163+0000 7f9aae21e640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9aa814fd50 0x7f9aa80cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.164+0000 7f9aada1d640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9aa80cd870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4007370 tx=0x7f9aa4007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.164+0000 7f9a9e7fc640 1 -- 172.21.15.113:0/1525515640 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa401a070 con 0x7f9a94003fd0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.164+0000 7f9a9e7fc640 1 -- 172.21.15.113:0/1525515640 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa400f9c0 con 0x7f9a94003fd0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.164+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa8158e00 con 0x7f9a94003fd0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.164+0000 7f9a9e7fc640 1 -- 172.21.15.113:0/1525515640 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400fd70 con 0x7f9a94003fd0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.164+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa81f1270 con 0x7f9a94003fd0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.165+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa8072600 con 0x7f9a94003fd0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.165+0000 7f9a9e7fc640 1 -- 172.21.15.113:0/1525515640 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9aa401d070 con 0x7f9a94003fd0 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.165+0000 7f9a9e7fc640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9a8c06c920 0x7f9a8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.166+0000 7f9a9e7fc640 1 -- 172.21.15.113:0/1525515640 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9aa408b990 con 0x7f9a94003fd0 2024-04-22T06:32:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.166+0000 7f9aad21c640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9a8c06c920 0x7f9a8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.166+0000 7f9aad21c640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9a8c06c920 0x7f9a8c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a98035000 tx=0x7f9a98031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.170+0000 7f9a9e7fc640 1 -- 172.21.15.113:0/1525515640 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9aa8072600 con 0x7f9a94003fd0 2024-04-22T06:32:26.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.387+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9aa8068e40 con 0x7f9a94003fd0 2024-04-22T06:32:26.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.388+0000 7f9a9e7fc640 1 -- 172.21.15.113:0/1525515640 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6917 (secure 0 0 0) 0x7f9aa81f0ff0 con 0x7f9a94003fd0 2024-04-22T06:32:26.387 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:26.387 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:25.981022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4308,"mds_2":4305,"mds_3":4264,"mds_4":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":4,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"a","rank":2,"incarnation":12,"state":"up:active","state_seq":12,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:active","state_seq":11,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4259,4311,4264,4305,4308]},"id":1}]} 2024-04-22T06:32:26.387 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 17 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9a8c06c920 msgr2=0x7f9a8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9a8c06c920 0x7f9a8c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a98035000 tx=0x7f9a98031000 comp rx=0 tx=0).stop 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 msgr2=0x7f9aa80cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9aa80cd870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4007370 tx=0x7f9aa4007830 comp rx=0 tx=0).stop 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 shutdown_connections 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9aa814fd50 0x7f9aa80cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9aa80ccfb0 0x7f9aa80cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9a8c06c920 0x7f9a8c06ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 --2- 172.21.15.113:0/1525515640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a94003fd0 0x7f9aa80cd870 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 >> 172.21.15.113:0/1525515640 conn(0x7f9aa806bd10 msgr2=0x7f9aa8072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 shutdown_connections 2024-04-22T06:32:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.390+0000 7f9aafc81640 1 -- 172.21.15.113:0/1525515640 wait complete. 2024-04-22T06:32:26.402 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.501+0000 7f4174e6d640 1 Processor -- start 2024-04-22T06:32:26.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.501+0000 7f4174e6d640 1 -- start start 2024-04-22T06:32:26.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f4174e6d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41700cb440 0x7f41700caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f4174e6d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41700c9bb0 con 0x7f41700c9fa0 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f4174e6d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41700c5cc0 con 0x7f417015cdd0 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f4174e6d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f41700c5a70 con 0x7f41700cb440 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f4167fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f41700c9fa0 0x7f417015c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59718/0 (socket says 172.21.15.113:59718) 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f4167fff640 1 -- 172.21.15.113:0/3560110309 learned_addr learned my addr 172.21.15.113:0/3560110309 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f416e59c640 1 --2- 172.21.15.113:0/3560110309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41700cb440 0x7f41700caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f416dd9b640 1 -- 172.21.15.113:0/3560110309 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576992868 0 0) 0x7f41700c9bb0 con 0x7f41700c9fa0 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.502+0000 7f416dd9b640 1 -- 172.21.15.113:0/3560110309 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f415c003520 con 0x7f41700c9fa0 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.503+0000 7f416dd9b640 1 -- 172.21.15.113:0/3560110309 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267251208 0 0) 0x7f41700c5cc0 con 0x7f417015cdd0 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.503+0000 7f416dd9b640 1 -- 172.21.15.113:0/3560110309 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41700c9bb0 con 0x7f417015cdd0 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.503+0000 7f416e59c640 1 -- 172.21.15.113:0/3560110309 >> v1:172.21.15.145:6789/0 conn(0x7f417015cdd0 legacy=0x7f41701636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.503+0000 7f416e59c640 1 -- 172.21.15.113:0/3560110309 >> v1:172.21.15.113:6789/0 conn(0x7f41700c9fa0 legacy=0x7f417015c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.503+0000 7f416dd9b640 1 -- 172.21.15.113:0/3560110309 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2127962735 0 0) 0x7f415c003520 con 0x7f41700c9fa0 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.503+0000 7f416e59c640 1 -- 172.21.15.113:0/3560110309 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41700c5fa0 con 0x7f41700cb440 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f416e59c640 1 --2- 172.21.15.113:0/3560110309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41700cb440 0x7f41700caa30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f41600097d0 tx=0x7f416002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d13ee0d8293eed8f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f416dd9b640 1 -- 172.21.15.113:0/3560110309 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160037070 con 0x7f41700cb440 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f416dd9b640 1 -- 172.21.15.113:0/3560110309 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4160030510 con 0x7f41700cb440 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f416dd9b640 1 -- 172.21.15.113:0/3560110309 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158001670 con 0x7f41700cb440 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f4174e6d640 1 -- 172.21.15.113:0/3560110309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41700cb440 msgr2=0x7f41700caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f4174e6d640 1 --2- 172.21.15.113:0/3560110309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41700cb440 0x7f41700caa30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f41600097d0 tx=0x7f416002b800 comp rx=0 tx=0).stop 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f4174e6d640 1 -- 172.21.15.113:0/3560110309 shutdown_connections 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f4174e6d640 1 --2- 172.21.15.113:0/3560110309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41700cb440 0x7f41700caa30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f4174e6d640 1 -- 172.21.15.113:0/3560110309 >> 172.21.15.113:0/3560110309 conn(0x7f4170074f30 msgr2=0x7f4170075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:26.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f4174e6d640 1 -- 172.21.15.113:0/3560110309 shutdown_connections 2024-04-22T06:32:26.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.504+0000 7f4174e6d640 1 -- 172.21.15.113:0/3560110309 wait complete. 2024-04-22T06:32:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4174e6d640 1 Processor -- start 2024-04-22T06:32:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4174e6d640 1 -- start start 2024-04-22T06:32:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4174e6d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41700c9fa0 0x7f41701460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4174e6d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41700cb440 0x7f41701508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4174e6d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417015cdd0 0x7f41701eea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4174e6d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f41700c9850 con 0x7f41700cb440 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4174e6d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f41700ca720 con 0x7f41700c9fa0 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4174e6d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4170153360 con 0x7f417015cdd0 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4167fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41700cb440 0x7f41701508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4167fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41700cb440 0x7f41701508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55204/0 (socket says 172.21.15.113:55204) 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f4167fff640 1 -- 172.21.15.113:0/127524060 learned_addr learned my addr 172.21.15.113:0/127524060 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.506+0000 7f416e59c640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41700c9fa0 0x7f41701460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f416ed9d640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417015cdd0 0x7f41701eea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4167fff640 1 -- 172.21.15.113:0/127524060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417015cdd0 msgr2=0x7f41701eea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4167fff640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417015cdd0 0x7f41701eea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4167fff640 1 -- 172.21.15.113:0/127524060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41700c9fa0 msgr2=0x7f41701460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4167fff640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41700c9fa0 0x7f41701460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4167fff640 1 -- 172.21.15.113:0/127524060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41701f2eb0 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4167fff640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41700cb440 0x7f41701508b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f415800c730 tx=0x7f415800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4166ffd640 1 -- 172.21.15.113:0/127524060 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158017070 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4166ffd640 1 -- 172.21.15.113:0/127524060 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4158005ad0 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4170146a20 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4166ffd640 1 -- 172.21.15.113:0/127524060 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158007070 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.507+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41701f23d0 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.508+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4170068e40 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.508+0000 7f4166ffd640 1 -- 172.21.15.113:0/127524060 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f415801a070 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.509+0000 7f4166ffd640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f415006c8f0 0x7f415006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.509+0000 7f416e59c640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f415006c8f0 0x7f415006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.509+0000 7f4166ffd640 1 -- 172.21.15.113:0/127524060 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f415808b4e0 con 0x7f41700cb440 2024-04-22T06:32:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.509+0000 7f416e59c640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f415006c8f0 0x7f415006edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4160034000 tx=0x7f4160008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.517+0000 7f4166ffd640 1 -- 172.21.15.113:0/127524060 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4158058ec0 con 0x7f41700cb440 2024-04-22T06:32:26.616 INFO:tasks.ceph.mds.c.smithi113.stderr:2024-04-22T06:32:26.618+0000 7f042e2e7640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-22T06:32:26.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.699+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41700cae50 con 0x7f41700cb440 2024-04-22T06:32:26.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.701+0000 7f4166ffd640 1 -- 172.21.15.113:0/127524060 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f415805d1c0 con 0x7f41700cb440 2024-04-22T06:32:26.699 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:26.700 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f415006c8f0 msgr2=0x7f415006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f415006c8f0 0x7f415006edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4160034000 tx=0x7f4160008030 comp rx=0 tx=0).stop 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41700cb440 msgr2=0x7f41701508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41700cb440 0x7f41701508b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f415800c730 tx=0x7f415800cbf0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 shutdown_connections 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f417015cdd0 0x7f41701eea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f415006c8f0 0x7f415006edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41700cb440 0x7f41701508b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 --2- 172.21.15.113:0/127524060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41700c9fa0 0x7f41701460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 >> 172.21.15.113:0/127524060 conn(0x7f4170074f30 msgr2=0x7f4170075310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:26.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 shutdown_connections 2024-04-22T06:32:26.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.703+0000 7f4174e6d640 1 -- 172.21.15.113:0/127524060 wait complete. 2024-04-22T06:32:26.713 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:32:26.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.812+0000 7fd920bb2640 1 Processor -- start 2024-04-22T06:32:26.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.812+0000 7fd920bb2640 1 -- start start 2024-04-22T06:32:26.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd920bb2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c153040 0x7fd91c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd920bb2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd91c153420 0x7fd91c159320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd920bb2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91c075bc0 con 0x7fd91c0c7f80 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd920bb2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fd91c074df0 con 0x7fd91c153420 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd920bb2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd91c075040 con 0x7fd91c153040 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd91ad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd91c153420 0x7fd91c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd91ad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd91c153420 0x7fd91c159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55208/0 (socket says 172.21.15.113:55208) 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd91ad9d640 1 -- 172.21.15.113:0/47724372 learned_addr learned my addr 172.21.15.113:0/47724372 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd91a59c640 1 --2- 172.21.15.113:0/47724372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c153040 0x7fd91c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd91ad9d640 1 -- 172.21.15.113:0/47724372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c153040 msgr2=0x7fd91c0707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd91ad9d640 1 --2- 172.21.15.113:0/47724372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c153040 0x7fd91c0707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd91ad9d640 1 -- 172.21.15.113:0/47724372 >> v1:172.21.15.145:6789/0 conn(0x7fd91c0c7f80 legacy=0x7fd91c0ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.813+0000 7fd91ad9d640 1 -- 172.21.15.113:0/47724372 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c075320 con 0x7fd91c153420 2024-04-22T06:32:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.814+0000 7fd91ad9d640 1 --2- 172.21.15.113:0/47724372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c159320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd914009e50 tx=0x7fd91402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2c879ff846d64c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd91959a640 1 -- 172.21.15.113:0/47724372 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91402ca70 con 0x7fd91c153420 2024-04-22T06:32:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd91959a640 1 -- 172.21.15.113:0/47724372 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91402cc10 con 0x7fd91c153420 2024-04-22T06:32:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd91959a640 1 -- 172.21.15.113:0/47724372 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9140343f0 con 0x7fd91c153420 2024-04-22T06:32:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd920bb2640 1 -- 172.21.15.113:0/47724372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 msgr2=0x7fd91c159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd920bb2640 1 --2- 172.21.15.113:0/47724372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c159320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd914009e50 tx=0x7fd91402bed0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd920bb2640 1 -- 172.21.15.113:0/47724372 shutdown_connections 2024-04-22T06:32:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd920bb2640 1 --2- 172.21.15.113:0/47724372 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c159320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd920bb2640 1 --2- 172.21.15.113:0/47724372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c153040 0x7fd91c0707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd920bb2640 1 -- 172.21.15.113:0/47724372 >> 172.21.15.113:0/47724372 conn(0x7fd91c06bd10 msgr2=0x7fd91c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd920bb2640 1 -- 172.21.15.113:0/47724372 shutdown_connections 2024-04-22T06:32:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.815+0000 7fd920bb2640 1 -- 172.21.15.113:0/47724372 wait complete. 2024-04-22T06:32:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.816+0000 7fd920bb2640 1 Processor -- start 2024-04-22T06:32:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd920bb2640 1 -- start start 2024-04-22T06:32:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd920bb2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c7f80 0x7fd91c146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd920bb2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c153040 0x7fd91c0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd920bb2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd920bb2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c0c5500 con 0x7fd91c153420 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd920bb2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c0758e0 con 0x7fd91c153040 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd920bb2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd91c0c5680 con 0x7fd91c0c7f80 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd91ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd91ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c142230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55222/0 (socket says 172.21.15.113:55222) 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd91ad9d640 1 -- 172.21.15.113:0/3562130857 learned_addr learned my addr 172.21.15.113:0/3562130857 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd91a59c640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c7f80 0x7fd91c146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.817+0000 7fd919d9b640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c153040 0x7fd91c0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd91ad9d640 1 -- 172.21.15.113:0/3562130857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c7f80 msgr2=0x7fd91c146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd91ad9d640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c7f80 0x7fd91c146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd91ad9d640 1 -- 172.21.15.113:0/3562130857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c153040 msgr2=0x7fd91c0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:26.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd91ad9d640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c153040 0x7fd91c0ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:26.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd91ad9d640 1 -- 172.21.15.113:0/3562130857 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c144970 con 0x7fd91c153420 2024-04-22T06:32:26.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd91ad9d640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c142230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd914036040 tx=0x7fd914004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd90affd640 1 -- 172.21.15.113:0/3562130857 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914044020 con 0x7fd91c153420 2024-04-22T06:32:26.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd90affd640 1 -- 172.21.15.113:0/3562130857 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd914040690 con 0x7fd91c153420 2024-04-22T06:32:26.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91c0c90c0 con 0x7fd91c153420 2024-04-22T06:32:26.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd90affd640 1 -- 172.21.15.113:0/3562130857 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914040a80 con 0x7fd91c153420 2024-04-22T06:32:26.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.818+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91c1538d0 con 0x7fd91c153420 2024-04-22T06:32:26.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.819+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91c0c9bc0 con 0x7fd91c153420 2024-04-22T06:32:26.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.819+0000 7fd90affd640 1 -- 172.21.15.113:0/3562130857 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd914047020 con 0x7fd91c153420 2024-04-22T06:32:26.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.820+0000 7fd90affd640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd8fc06c920 0x7fd8fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:26.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.820+0000 7fd91a59c640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd8fc06c920 0x7fd8fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:26.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.820+0000 7fd90affd640 1 -- 172.21.15.113:0/3562130857 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd9140ae870 con 0x7fd91c153420 2024-04-22T06:32:26.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.820+0000 7fd91a59c640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd8fc06c920 0x7fd8fc06ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd91000a970 tx=0x7fd910008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:26.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:26.824+0000 7fd90affd640 1 -- 172.21.15.113:0/3562130857 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd91c0c9bc0 con 0x7fd91c153420 2024-04-22T06:32:27.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.044+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd91c068e40 con 0x7fd91c153420 2024-04-22T06:32:27.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.045+0000 7fd90affd640 1 -- 172.21.15.113:0/3562130857 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6917 (secure 0 0 0) 0x7fd91404e070 con 0x7fd91c153420 2024-04-22T06:32:27.043 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:27.044 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:25.981022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4308,"mds_2":4305,"mds_3":4264,"mds_4":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":4,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"a","rank":2,"incarnation":12,"state":"up:active","state_seq":12,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:active","state_seq":11,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4259,4311,4264,4305,4308]},"id":1}]} 2024-04-22T06:32:27.044 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 17 2024-04-22T06:32:27.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd8fc06c920 msgr2=0x7fd8fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:27.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd8fc06c920 0x7fd8fc06ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd91000a970 tx=0x7fd910008040 comp rx=0 tx=0).stop 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 msgr2=0x7fd91c142230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c142230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd914036040 tx=0x7fd914004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 shutdown_connections 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd8fc06c920 0x7fd8fc06ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd91c153420 0x7fd91c142230 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd91c153040 0x7fd91c0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 --2- 172.21.15.113:0/3562130857 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd91c0c7f80 0x7fd91c146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 >> 172.21.15.113:0/3562130857 conn(0x7fd91c06bd10 msgr2=0x7fd91c1597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 shutdown_connections 2024-04-22T06:32:27.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.047+0000 7fd920bb2640 1 -- 172.21.15.113:0/3562130857 wait complete. 2024-04-22T06:32:27.661 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-22T06:31:37.179004+0000', 'modified': '2024-04-22T06:32:25.981022+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4311, 'mds_1': 4308, 'mds_2': 4305, 'mds_3': 4264, 'mds_4': 4259}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4259': {'gid': 4259, 'name': 'f', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.145:6837/2093995968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6836', 'nonce': 2093995968}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 2093995968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4264': {'gid': 4264, 'name': 'd', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.145:6834/9331508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 9331508}, {'type': 'v1', 'addr': '172.21.15.145:6834', 'nonce': 9331508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4305': {'gid': 4305, 'name': 'a', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.113:6835/999776030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6834', 'nonce': 999776030}, {'type': 'v1', 'addr': '172.21.15.113:6835', 'nonce': 999776030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4308': {'gid': 4308, 'name': 'e', 'rank': 1, 'incarnation': 8, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.113:6838/1889319276', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6836', 'nonce': 1889319276}, {'type': 'v1', 'addr': '172.21.15.113:6838', 'nonce': 1889319276}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4311': {'gid': 4311, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.113:6839/4160787448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6837', 'nonce': 4160787448}, {'type': 'v1', 'addr': '172.21.15.113:6839', 'nonce': 4160787448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4311, 'qdb_cluster': [4259, 4311, 4264, 4305, 4308]} 2024-04-22T06:32:27.661 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-22T06:32:27.662 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-22T06:32:27.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.762+0000 7fce528c8640 1 Processor -- start 2024-04-22T06:32:27.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.762+0000 7fce528c8640 1 -- start start 2024-04-22T06:32:27.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce528c8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fce4c152280 0x7fce4c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce528c8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce4c0c3cb0 0x7fce4c159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce528c8640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4c15b610 con 0x7fce4c151ea0 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce528c8640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fce4c06f300 con 0x7fce4c0c3cb0 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce528c8640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fce4c06e6f0 con 0x7fce4c152280 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce50e65640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce4c0c3cb0 0x7fce4c159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce50e65640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce4c0c3cb0 0x7fce4c159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55226/0 (socket says 172.21.15.113:55226) 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce50e65640 1 -- 172.21.15.113:0/2351072023 learned_addr learned my addr 172.21.15.113:0/2351072023 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce4bfff640 1 --1- 172.21.15.113:0/2351072023 >> v1:172.21.15.113:6789/0 conn(0x7fce4c151ea0 0x7fce4c0c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:59720/0 (socket says 172.21.15.113:59720) 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/2351072023 >> v2:172.21.15.145:3300/0 conn(0x7fce4c152280 0x7fce4c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce50e65640 1 -- 172.21.15.113:0/2351072023 >> v2:172.21.15.145:3300/0 conn(0x7fce4c152280 msgr2=0x7fce4c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce50e65640 1 --2- 172.21.15.113:0/2351072023 >> v2:172.21.15.145:3300/0 conn(0x7fce4c152280 0x7fce4c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce50e65640 1 -- 172.21.15.113:0/2351072023 >> v1:172.21.15.113:6789/0 conn(0x7fce4c151ea0 legacy=0x7fce4c0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce50e65640 1 -- 172.21.15.113:0/2351072023 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c06e9d0 con 0x7fce4c0c3cb0 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce4affd640 1 -- 172.21.15.113:0/2351072023 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283312733 0 0) 0x7fce4c15b610 con 0x7fce4c151ea0 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.763+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/2351072023 >> v2:172.21.15.145:3300/0 conn(0x7fce4c152280 0x7fce4c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:27.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.764+0000 7fce50e65640 1 --2- 172.21.15.113:0/2351072023 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c0c3cb0 0x7fce4c159710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fce4c06c3e0 tx=0x7fce4402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3e21c9d543847 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:27.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.764+0000 7fce4affd640 1 -- 172.21.15.113:0/2351072023 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4402cbb0 con 0x7fce4c0c3cb0 2024-04-22T06:32:27.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.764+0000 7fce4affd640 1 -- 172.21.15.113:0/2351072023 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4402cd50 con 0x7fce4c0c3cb0 2024-04-22T06:32:27.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.764+0000 7fce4affd640 1 -- 172.21.15.113:0/2351072023 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44034610 con 0x7fce4c0c3cb0 2024-04-22T06:32:27.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.765+0000 7fce528c8640 1 -- 172.21.15.113:0/2351072023 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c0c3cb0 msgr2=0x7fce4c159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:27.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.765+0000 7fce528c8640 1 --2- 172.21.15.113:0/2351072023 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c0c3cb0 0x7fce4c159710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fce4c06c3e0 tx=0x7fce4402c010 comp rx=0 tx=0).stop 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.765+0000 7fce528c8640 1 -- 172.21.15.113:0/2351072023 shutdown_connections 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.765+0000 7fce528c8640 1 --2- 172.21.15.113:0/2351072023 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c0c3cb0 0x7fce4c159710 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.765+0000 7fce528c8640 1 --2- 172.21.15.113:0/2351072023 >> v2:172.21.15.145:3300/0 conn(0x7fce4c152280 0x7fce4c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.765+0000 7fce528c8640 1 -- 172.21.15.113:0/2351072023 >> 172.21.15.113:0/2351072023 conn(0x7fce4c0c8f00 msgr2=0x7fce4c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.765+0000 7fce528c8640 1 -- 172.21.15.113:0/2351072023 shutdown_connections 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.765+0000 7fce528c8640 1 -- 172.21.15.113:0/2351072023 wait complete. 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.766+0000 7fce528c8640 1 Processor -- start 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.766+0000 7fce528c8640 1 -- start start 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce528c8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fce4c0c3cb0 0x7fce4c072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce528c8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c151ea0 0x7fce4c073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce528c8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce4c1529a0 0x7fce4c1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce528c8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c0c8cb0 con 0x7fce4c151ea0 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce528c8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c06ef90 con 0x7fce4c1529a0 2024-04-22T06:32:27.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce528c8640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c15b2d0 con 0x7fce4c0c3cb0 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c151ea0 0x7fce4c073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c151ea0 0x7fce4c073330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55236/0 (socket says 172.21.15.113:55236) 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 -- 172.21.15.113:0/112631787 learned_addr learned my addr 172.21.15.113:0/112631787 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce50e65640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce4c1529a0 0x7fce4c1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 -- 172.21.15.113:0/112631787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fce4c0c3cb0 msgr2=0x7fce4c072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fce4c0c3cb0 0x7fce4c072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 -- 172.21.15.113:0/112631787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce4c1529a0 msgr2=0x7fce4c1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce4c1529a0 0x7fce4c1532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 -- 172.21.15.113:0/112631787 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c15af90 con 0x7fce4c151ea0 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c151ea0 0x7fce4c073330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00d800 tx=0x7fce3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce48ff9640 1 -- 172.21.15.113:0/112631787 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0096a0 con 0x7fce4c151ea0 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce48ff9640 1 -- 172.21.15.113:0/112631787 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3c019070 con 0x7fce4c151ea0 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce528c8640 1 -- 172.21.15.113:0/112631787 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c072630 con 0x7fce4c151ea0 2024-04-22T06:32:27.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce48ff9640 1 -- 172.21.15.113:0/112631787 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c009a80 con 0x7fce4c151ea0 2024-04-22T06:32:27.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.767+0000 7fce528c8640 1 -- 172.21.15.113:0/112631787 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c1ed5a0 con 0x7fce4c151ea0 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.769+0000 7fce48ff9640 1 -- 172.21.15.113:0/112631787 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce3c009c20 con 0x7fce4c151ea0 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.770+0000 7fce48ff9640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fce3806c8f0 0x7fce3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.770+0000 7fce48ff9640 1 -- 172.21.15.113:0/112631787 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fce3c08c420 con 0x7fce4c151ea0 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.770+0000 7fce4bfff640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fce3806c8f0 0x7fce3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.770+0000 7fce4bfff640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fce3806c8f0 0x7fce3806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce40007fd0 tx=0x7fce40007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.770+0000 7fce55597740 1 Processor -- start 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.770+0000 7fce55597740 1 -- start start 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce55597740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c3096f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce55597740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 0x5630c30974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce55597740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304aca0 0x5630c3072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce55597740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x5630c2fb1b10 con 0x5630c304aca0 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce55597740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5630c2f4f240 con 0x5630c308de40 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce55597740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5630c2fadad0 con 0x5630c304eec0 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce50e65640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304aca0 0x5630c3072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce50e65640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304aca0 0x5630c3072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55250/0 (socket says 172.21.15.113:55250) 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce50e65640 1 -- 172.21.15.113:0/2743617538 learned_addr learned my addr 172.21.15.113:0/2743617538 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce4bfff640 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c3096f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 0x5630c30974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce50e65640 1 -- 172.21.15.113:0/2743617538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 msgr2=0x5630c30974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce50e65640 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 0x5630c30974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce50e65640 1 -- 172.21.15.113:0/2743617538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 msgr2=0x5630c3096f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce50e65640 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c3096f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.771+0000 7fce50e65640 1 -- 172.21.15.113:0/2743617538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630c2cc42d0 con 0x5630c304aca0 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce50e65640 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304aca0 0x5630c3072ee0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fce44009f40 tx=0x7fce4402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14e736b85c0b659 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:27.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce31ffb640 1 -- 172.21.15.113:0/2743617538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4402cbb0 con 0x5630c304aca0 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce31ffb640 1 -- 172.21.15.113:0/2743617538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44003990 con 0x5630c304aca0 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce31ffb640 1 -- 172.21.15.113:0/2743617538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44003d80 con 0x5630c304aca0 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce55597740 1 -- 172.21.15.113:0/2743617538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304aca0 msgr2=0x5630c3072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce55597740 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304aca0 0x5630c3072ee0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fce44009f40 tx=0x7fce4402e000 comp rx=0 tx=0).stop 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce55597740 1 -- 172.21.15.113:0/2743617538 shutdown_connections 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce55597740 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304aca0 0x5630c3072ee0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce55597740 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 0x5630c30974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce55597740 1 --2- 172.21.15.113:0/2743617538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c3096f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce55597740 1 -- 172.21.15.113:0/2743617538 >> 172.21.15.113:0/2743617538 conn(0x5630c3049990 msgr2=0x5630c304c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.772+0000 7fce55597740 1 -- 172.21.15.113:0/2743617538 shutdown_connections 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.773+0000 7fce55597740 1 -- 172.21.15.113:0/2743617538 wait complete. 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.773+0000 7fce55597740 1 -- start start 2024-04-22T06:32:27.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.773+0000 7fce55597740 1 Processor -- start 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce55597740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c306d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce55597740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c30a2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce55597740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c30a29d0 0x5630c30644a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce55597740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x5630c304d250 con 0x5630c304eec0 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce55597740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5630c2f3a190 con 0x5630c308de40 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce55597740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5630c304d530 con 0x5630c30a29d0 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce55597740 10 client.0 _ll_register_callbacks cb 0x5630c2f358b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c306d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c306d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55266/0 (socket says 172.21.15.113:55266) 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 -- 172.21.15.113:0/1054836602 learned_addr learned my addr 172.21.15.113:0/1054836602 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c30a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce50e65640 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c30a29d0 0x5630c30644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 -- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c30a29d0 msgr2=0x5630c30644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c30a29d0 0x5630c30644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 -- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 msgr2=0x5630c30a2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c30a2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 -- 172.21.15.113:0/1054836602 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630c2d8e6b0 con 0x5630c304eec0 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce4bfff640 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c306d470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fce40005eb0 tx=0x7fce40001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686bff28f2cb7035 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.774+0000 7fce2affd640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce2affd640 1 -- 172.21.15.113:0/1054836602 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40012850 con 0x5630c304eec0 2024-04-22T06:32:27.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce2affd640 1 -- 172.21.15.113:0/1054836602 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fce400129f0 con 0x5630c304eec0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 1 -- 172.21.15.113:0/1054836602 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce44003990 con 0x5630c304eec0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce2affd640 1 -- 172.21.15.113:0/1054836602 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fce40012bf0 con 0x5630c304eec0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 10 client.4929 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 1 -- 172.21.15.113:0/1054836602 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5630c3047950 con 0x5630c304eec0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce2affd640 1 -- 172.21.15.113:0/1054836602 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44003990 con 0x5630c304eec0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce2affd640 1 -- 172.21.15.113:0/1054836602 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7fce4002e080 con 0x5630c304eec0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 10 client.4929 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 10 client.4929 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 20 client.4929 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x5630c30649e0 0x5630c309ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 4 client.4929 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce55597740 1 -- 172.21.15.113:0/1054836602 --> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630c2fbf530 con 0x5630c30649e0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.775+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x5630c30649e0 0x5630c309ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.776+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x5630c30649e0 0x5630c309ecf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a292afaa0e4d7917 server_cookie=b3aec4405ef481a5 in_seq=0 out_seq=0 2024-04-22T06:32:27.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:27.776+0000 7fce2affd640 10 client.4929 ms_handle_connect on v2:172.21.15.145:6836/2093995968 2024-04-22T06:32:30.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce2affd640 1 -- 172.21.15.113:0/1054836602 <== mds.4 v2:172.21.15.145:6836/2093995968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5630c2fbf530 con 0x5630c30649e0 2024-04-22T06:32:30.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce2affd640 10 client.4929 handle_command_reply: tid=0 2024-04-22T06:32:30.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 client.4929 shutdown 2024-04-22T06:32:30.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 -- 172.21.15.113:0/1054836602 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 msgr2=0x5630c306d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:30.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c306d470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fce40005eb0 tx=0x7fce40001080 comp rx=0 tx=0).stop 2024-04-22T06:32:30.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 -- 172.21.15.113:0/1054836602 shutdown_connections 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x5630c30649e0 0x5630c309ecf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c30a29d0 0x5630c30644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c30a2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce2affd640 0 client.4929 ms_handle_reset on v2:172.21.15.145:6836/2093995968 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 --2- 172.21.15.113:0/1054836602 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c306d470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 -- 172.21.15.113:0/1054836602 >> 172.21.15.113:0/1054836602 conn(0x5630c304aca0 msgr2=0x5630c3096ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 -- 172.21.15.113:0/1054836602 shutdown_connections 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 1 -- 172.21.15.113:0/1054836602 wait complete. 2024-04-22T06:32:30.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:30.990+0000 7fce55597740 20 client.4929 trim_cache size 0 max 16384 2024-04-22T06:32:31.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.008+0000 7fce55597740 1 Processor -- start 2024-04-22T06:32:31.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.008+0000 7fce55597740 1 -- start start 2024-04-22T06:32:31.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce55597740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 0x5630c30681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce55597740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c306c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce55597740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c3094520 0x5630c306c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce55597740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1f0c60 con 0x5630c3094520 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce55597740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5630c306dbc0 con 0x5630c308de40 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce55597740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5630c3096a90 con 0x5630c304eec0 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce50e65640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c3094520 0x5630c306c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce50e65640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c3094520 0x5630c306c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33408/0 (socket says 172.21.15.113:33408) 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce50e65640 1 -- 172.21.15.113:0/393513923 learned_addr learned my addr 172.21.15.113:0/393513923 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c306c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce4bfff640 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 0x5630c30681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce50e65640 1 -- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 msgr2=0x5630c30681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce50e65640 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 0x5630c30681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce50e65640 1 -- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 msgr2=0x5630c306c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce50e65640 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c306c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce50e65640 1 -- 172.21.15.113:0/393513923 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630c3049e60 con 0x5630c3094520 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.009+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c306c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.011 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce50e65640 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c3094520 0x5630c306c6b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fce44000f80 tx=0x7fce44009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d355cc2200e320 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce317fa640 1 -- 172.21.15.113:0/393513923 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4402ccf0 con 0x5630c3094520 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce317fa640 1 -- 172.21.15.113:0/393513923 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44003990 con 0x5630c3094520 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce317fa640 1 -- 172.21.15.113:0/393513923 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44003d80 con 0x5630c3094520 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 -- 172.21.15.113:0/393513923 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c3094520 msgr2=0x5630c306c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c3094520 0x5630c306c6b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fce44000f80 tx=0x7fce44009810 comp rx=0 tx=0).stop 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 -- 172.21.15.113:0/393513923 shutdown_connections 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c3094520 0x5630c306c6b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c308de40 0x5630c306c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 --2- 172.21.15.113:0/393513923 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c304eec0 0x5630c30681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 -- 172.21.15.113:0/393513923 >> 172.21.15.113:0/393513923 conn(0x5630c304aca0 msgr2=0x5630c30a22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 -- 172.21.15.113:0/393513923 shutdown_connections 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.010+0000 7fce55597740 1 -- 172.21.15.113:0/393513923 wait complete. 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.011+0000 7fce55597740 1 -- start start 2024-04-22T06:32:31.012 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.011+0000 7fce55597740 1 Processor -- start 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce55597740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c3093480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce55597740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c308de40 0x5630c3071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce55597740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c3067130 0x5630c308c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce55597740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x5630c309eb70 con 0x5630c304eec0 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce55597740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5630c3064df0 con 0x5630c3067130 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce55597740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5630c309f240 con 0x5630c308de40 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce55597740 10 client.0 _ll_register_callbacks cb 0x7fce400071f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c3093480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c3093480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33410/0 (socket says 172.21.15.113:33410) 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 -- 172.21.15.113:0/3862506799 learned_addr learned my addr 172.21.15.113:0/3862506799 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c308de40 0x5630c3071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce50e65640 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c3067130 0x5630c308c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 -- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c308de40 msgr2=0x5630c3071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c308de40 0x5630c3071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 -- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c3067130 msgr2=0x5630c308c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c3067130 0x5630c308c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 -- 172.21.15.113:0/3862506799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630c306c9b0 con 0x5630c304eec0 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce4bfff640 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c3093480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce40012960 tx=0x7fce40011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8c9c5592a69b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.012+0000 7fce2affd640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce2affd640 1 -- 172.21.15.113:0/3862506799 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40004bf0 con 0x5630c304eec0 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce2affd640 1 -- 172.21.15.113:0/3862506799 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fce40004d90 con 0x5630c304eec0 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 1 -- 172.21.15.113:0/3862506799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce44003990 con 0x5630c304eec0 2024-04-22T06:32:31.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce2affd640 1 -- 172.21.15.113:0/3862506799 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fce4003f050 con 0x5630c304eec0 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 10 client.4935 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 1 -- 172.21.15.113:0/3862506799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5630c310c9a0 con 0x5630c304eec0 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce2affd640 1 -- 172.21.15.113:0/3862506799 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44003990 con 0x5630c304eec0 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce2affd640 1 -- 172.21.15.113:0/3862506799 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7fce40042020 con 0x5630c304eec0 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 10 client.4935 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 10 client.4935 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 20 client.4935 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x5630c310a1e0 0x5630c3115ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 4 client.4935 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce55597740 1 -- 172.21.15.113:0/3862506799 --> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] -- command(tid 0: {"prefix": "status"}) -- 0x5630c2fb93a0 con 0x5630c310a1e0 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.013+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x5630c310a1e0 0x5630c3115ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce4b7fe640 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x5630c310a1e0 0x5630c3115ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=75e0371acf047ff6 server_cookie=ac506ea4f7e128a3 in_seq=0 out_seq=0 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce2affd640 10 client.4935 ms_handle_connect on v2:172.21.15.145:6836/2093995968 2024-04-22T06:32:31.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce2affd640 1 -- 172.21.15.113:0/3862506799 <== mds.4 v2:172.21.15.145:6836/2093995968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5630c2fb93a0 con 0x5630c310a1e0 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce2affd640 10 client.4935 handle_command_reply: tid=0 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 client.4935 shutdown 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 -- 172.21.15.113:0/3862506799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 msgr2=0x5630c3093480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c3093480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce40012960 tx=0x7fce40011000 comp rx=0 tx=0).stop 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 -- 172.21.15.113:0/3862506799 shutdown_connections 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x5630c310a1e0 0x5630c3115ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5630c3067130 0x5630c308c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5630c308de40 0x5630c3071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce2affd640 0 client.4935 ms_handle_reset on v2:172.21.15.145:6836/2093995968 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 --2- 172.21.15.113:0/3862506799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5630c304eec0 0x5630c3093480 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 -- 172.21.15.113:0/3862506799 >> 172.21.15.113:0/3862506799 conn(0x5630c304aca0 msgr2=0x5630c306d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 -- 172.21.15.113:0/3862506799 shutdown_connections 2024-04-22T06:32:31.020 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 1 -- 172.21.15.113:0/3862506799 wait complete. 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.014+0000 7fce55597740 20 client.4935 trim_cache size 0 max 16384 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 4, 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4259, 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:31.021 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 11.046233296, 2024-04-22T06:32:31.022 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:31.022 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:31.022 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:31.022 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 60.389610808999997 2024-04-22T06:32:31.022 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 -- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fce3806c8f0 msgr2=0x7fce3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fce3806c8f0 0x7fce3806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce40007fd0 tx=0x7fce40007920 comp rx=0 tx=0).stop 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 -- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c151ea0 msgr2=0x7fce4c073330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c151ea0 0x7fce4c073330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00d800 tx=0x7fce3c00dcc0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 -- 172.21.15.113:0/112631787 shutdown_connections 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce4c1529a0 0x7fce4c1532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fce3806c8f0 0x7fce3806edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce4c151ea0 0x7fce4c073330 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 --2- 172.21.15.113:0/112631787 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fce4c0c3cb0 0x7fce4c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 -- 172.21.15.113:0/112631787 >> 172.21.15.113:0/112631787 conn(0x7fce4c0c8f00 msgr2=0x7fce4c145d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 -- 172.21.15.113:0/112631787 shutdown_connections 2024-04-22T06:32:31.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.015+0000 7fce528c8640 1 -- 172.21.15.113:0/112631787 wait complete. 2024-04-22T06:32:31.025 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-22T06:32:31.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.123+0000 7f83a5fce640 1 Processor -- start 2024-04-22T06:32:31.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.123+0000 7f83a5fce640 1 -- start start 2024-04-22T06:32:31.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.123+0000 7f83a5fce640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 0x7f83a00c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.123+0000 7f83a5fce640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f83a00c8870 0x7f83a00c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.123+0000 7f83a5fce640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a0158fe0 con 0x7f83a015c4c0 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.123+0000 7f83a5fce640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f83a01592c0 con 0x7f83a00c8870 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.123+0000 7f83a5fce640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f83a01595a0 con 0x7f83a0152f70 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f83a015c4c0 0x7f83a015c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44966/0 (socket says 172.21.15.113:44966) 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839ffff640 1 -- 172.21.15.113:0/1505599496 learned_addr learned my addr 172.21.15.113:0/1505599496 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839f7fe640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 0x7f83a00c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839effd640 1 --2- 172.21.15.113:0/1505599496 >> v2:172.21.15.145:3300/0 conn(0x7f83a00c8870 0x7f83a00c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634605820 0 0) 0x7f83a0158fe0 con 0x7f83a015c4c0 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8388003520 con 0x7f83a015c4c0 2024-04-22T06:32:31.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3915490740 0 0) 0x7f8388003520 con 0x7f83a015c4c0 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 msgr2=0x7f83a00c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 0x7f83a00c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 >> v2:172.21.15.145:3300/0 conn(0x7f83a00c8870 msgr2=0x7f83a00c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 --2- 172.21.15.113:0/1505599496 >> v2:172.21.15.145:3300/0 conn(0x7f83a00c8870 0x7f83a00c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a0159880 con 0x7f83a015c4c0 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f83980019f0 con 0x7f83a015c4c0 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839f7fe640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 0x7f83a00c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 >> v1:172.21.15.113:6789/0 conn(0x7f83a015c4c0 legacy=0x7f83a015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 0x7f83880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8388003ef0 0x7f8388004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388004d40 0x7f83880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f83a01592c0 con 0x7f8388003ef0 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f83a01595a0 con 0x7f8388004d40 2024-04-22T06:32:31.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f838800b9c0 con 0x7f83a0152f70 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839effd640 1 --2- 172.21.15.113:0/1505599496 >> v2:172.21.15.145:3300/0 conn(0x7f83a00c8870 0x7f83a00c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839effd640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8388003ef0 0x7f8388004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839f7fe640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 0x7f83880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.124+0000 7f839ffff640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388004d40 0x7f83880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839effd640 1 -- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 msgr2=0x7f83880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839effd640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a0152f70 0x7f83880039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839effd640 1 -- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388004d40 msgr2=0x7f83880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839effd640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388004d40 0x7f83880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839effd640 1 -- 172.21.15.113:0/1505599496 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8388003520 con 0x7f8388003ef0 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839effd640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8388003ef0 0x7f8388004800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8394009c60 tx=0x7f8388005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40f1b02e7336fd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394039070 con 0x7f8388003ef0 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839402c950 con 0x7f8388003ef0 2024-04-22T06:32:31.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.125+0000 7f839e7fc640 1 -- 172.21.15.113:0/1505599496 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394009860 con 0x7f8388003ef0 2024-04-22T06:32:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.126+0000 7f83a5fce640 1 -- 172.21.15.113:0/1505599496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8388003ef0 msgr2=0x7f8388004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.126+0000 7f83a5fce640 1 --2- 172.21.15.113:0/1505599496 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8388003ef0 0x7f8388004800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8394009c60 tx=0x7f8388005830 comp rx=0 tx=0).stop 2024-04-22T06:32:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.126+0000 7f839ffff640 1 -- 172.21.15.113:0/1505599496 reap_dead start 2024-04-22T06:32:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.126+0000 7f83a5fce640 1 -- 172.21.15.113:0/1505599496 shutdown_connections 2024-04-22T06:32:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.126+0000 7f83a5fce640 1 -- 172.21.15.113:0/1505599496 >> 172.21.15.113:0/1505599496 conn(0x7f83a0074d50 msgr2=0x7f83a0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.126+0000 7f83a5fce640 1 -- 172.21.15.113:0/1505599496 shutdown_connections 2024-04-22T06:32:31.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.126+0000 7f83a5fce640 1 -- 172.21.15.113:0/1505599496 wait complete. 2024-04-22T06:32:31.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.127+0000 7f83a5fce640 1 Processor -- start 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.127+0000 7f83a5fce640 1 -- start start 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f83a5fce640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388003ef0 0x7f83a01ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f83a5fce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83a0158a50 0x7f83a014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f83a5fce640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a01489a0 0x7f83a0142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f83a5fce640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f83a01534d0 con 0x7f83a0158a50 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f83a5fce640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0153350 con 0x7f8388003ef0 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f83a5fce640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f83a00c5b50 con 0x7f83a01489a0 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83a0158a50 0x7f83a014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83a0158a50 0x7f83a014f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33418/0 (socket says 172.21.15.113:33418) 2024-04-22T06:32:31.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 -- 172.21.15.113:0/3207767256 learned_addr learned my addr 172.21.15.113:0/3207767256 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839f7fe640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388003ef0 0x7f83a01ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839ffff640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a01489a0 0x7f83a0142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 -- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a01489a0 msgr2=0x7f83a0142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a01489a0 0x7f83a0142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 -- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388003ef0 msgr2=0x7f83a01ef620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388003ef0 0x7f83a01ef620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 -- 172.21.15.113:0/3207767256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a0156ce0 con 0x7f83a0158a50 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839f7fe640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388003ef0 0x7f83a01ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.128+0000 7f839effd640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83a0158a50 0x7f83a014f330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8394009c60 tx=0x7f8394004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.129+0000 7f8387fff640 1 -- 172.21.15.113:0/3207767256 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394039050 con 0x7f83a0158a50 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.129+0000 7f8387fff640 1 -- 172.21.15.113:0/3207767256 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8394045070 con 0x7f83a0158a50 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.129+0000 7f83a5fce640 1 -- 172.21.15.113:0/3207767256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a0156fc0 con 0x7f83a0158a50 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.129+0000 7f8387fff640 1 -- 172.21.15.113:0/3207767256 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394009860 con 0x7f83a0158a50 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.129+0000 7f83a5fce640 1 -- 172.21.15.113:0/3207767256 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a0147320 con 0x7f83a0158a50 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.131+0000 7f8387fff640 1 -- 172.21.15.113:0/3207767256 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8394040450 con 0x7f83a0158a50 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.131+0000 7f8387fff640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f838c06c8f0 0x7f838c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.131+0000 7f8387fff640 1 -- 172.21.15.113:0/3207767256 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f83940adea0 con 0x7f83a0158a50 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.131+0000 7f839f7fe640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f838c06c8f0 0x7f838c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.131+0000 7f839f7fe640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f838c06c8f0 0x7f838c06edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8390009560 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.132+0000 7f83a8bc4740 1 Processor -- start 2024-04-22T06:32:31.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.132+0000 7f83a8bc4740 1 -- start start 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.132+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b70f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.132+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.132+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b24ca0 0x562125b4cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.132+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x562125a8bb10 con 0x562125b67e40 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.132+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562125a29240 con 0x562125b24ca0 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.132+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x562125a87ad0 con 0x562125b28ec0 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b70f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b70f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33424/0 (socket says 172.21.15.113:33424) 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 -- 172.21.15.113:0/1773027635 learned_addr learned my addr 172.21.15.113:0/1773027635 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839effd640 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839ffff640 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b24ca0 0x562125b4cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 -- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 msgr2=0x562125b714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 -- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b24ca0 msgr2=0x562125b4cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b24ca0 0x562125b4cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 -- 172.21.15.113:0/1773027635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56212579e2d0 con 0x562125b67e40 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839effd640 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f839f7fe640 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b70f60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8390014e40 tx=0x7f8390017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690f0e6512b98c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f83857fa640 1 -- 172.21.15.113:0/1773027635 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390014e70 con 0x562125b67e40 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f83857fa640 1 -- 172.21.15.113:0/1773027635 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8390029070 con 0x562125b67e40 2024-04-22T06:32:31.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.133+0000 7f83857fa640 1 -- 172.21.15.113:0/1773027635 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390024460 con 0x562125b67e40 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 -- 172.21.15.113:0/1773027635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 msgr2=0x562125b70f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b70f60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8390014e40 tx=0x7f8390017000 comp rx=0 tx=0).stop 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 -- 172.21.15.113:0/1773027635 shutdown_connections 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b24ca0 0x562125b4cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/1773027635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b70f60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 -- 172.21.15.113:0/1773027635 >> 172.21.15.113:0/1773027635 conn(0x562125b23990 msgr2=0x562125b26290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 -- 172.21.15.113:0/1773027635 shutdown_connections 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 -- 172.21.15.113:0/1773027635 wait complete. 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.134+0000 7f83a8bc4740 1 -- start start 2024-04-22T06:32:31.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f83a8bc4740 1 Processor -- start 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b28ec0 0x562125b6c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b67e40 0x562125b69f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b6d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x562125b27250 con 0x562125b6a4d0 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562125a14190 con 0x562125b28ec0 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x562125b27530 con 0x562125b67e40 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f83a8bc4740 10 client.0 _ll_register_callbacks cb 0x562125a0f8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f839ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b6d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f839ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b6d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33432/0 (socket says 172.21.15.113:33432) 2024-04-22T06:32:31.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f839ffff640 1 -- 172.21.15.113:0/3922160402 learned_addr learned my addr 172.21.15.113:0/3922160402 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f839f7fe640 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b28ec0 0x562125b6c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.135+0000 7f839effd640 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b67e40 0x562125b69f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f839ffff640 1 -- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b67e40 msgr2=0x562125b69f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f839ffff640 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b67e40 0x562125b69f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f839ffff640 1 -- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b28ec0 msgr2=0x562125b6c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f839ffff640 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b28ec0 0x562125b6c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f839ffff640 1 -- 172.21.15.113:0/3922160402 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621258686b0 con 0x562125b6a4d0 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f839f7fe640 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b28ec0 0x562125b6c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f839ffff640 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b6d230 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f83a015c8a0 tx=0x7f8398007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba72cb08a319a89 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f837e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f837e7fc640 1 -- 172.21.15.113:0/3922160402 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839800aa40 con 0x562125b6a4d0 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f837e7fc640 1 -- 172.21.15.113:0/3922160402 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f839800abe0 con 0x562125b6a4d0 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 1 -- 172.21.15.113:0/3922160402 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8390029070 con 0x562125b6a4d0 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f837e7fc640 1 -- 172.21.15.113:0/3922160402 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8398025050 con 0x562125b6a4d0 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 10 client.4947 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 1 -- 172.21.15.113:0/3922160402 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x562125b69300 con 0x562125b6a4d0 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f837e7fc640 1 -- 172.21.15.113:0/3922160402 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8390029070 con 0x562125b6a4d0 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f837e7fc640 1 -- 172.21.15.113:0/3922160402 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f8398028020 con 0x562125b6a4d0 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 10 client.4947 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 10 client.4947 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 20 client.4947 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x562125b7c2b0 0x562125b87b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 4 client.4947 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.136+0000 7f83a8bc4740 1 -- 172.21.15.113:0/3922160402 --> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562125a99530 con 0x562125b7c2b0 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.137+0000 7f839f7fe640 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x562125b7c2b0 0x562125b87b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.137+0000 7f837e7fc640 10 client.4947 ms_handle_connect on v2:172.21.15.145:6832/9331508 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.137+0000 7f839f7fe640 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x562125b7c2b0 0x562125b87b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=96cf4be9abc715e1 server_cookie=ff1c66f7c6ea8381 in_seq=0 out_seq=0 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f837e7fc640 1 -- 172.21.15.113:0/3922160402 <== mds.3 v2:172.21.15.145:6832/9331508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562125a99530 con 0x562125b7c2b0 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f837e7fc640 10 client.4947 handle_command_reply: tid=0 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 client.4947 shutdown 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 -- 172.21.15.113:0/3922160402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 msgr2=0x562125b6d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b6d230 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f83a015c8a0 tx=0x7f8398007af0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 -- 172.21.15.113:0/3922160402 shutdown_connections 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x562125b7c2b0 0x562125b87b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b6d230 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b67e40 0x562125b69f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/3922160402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b28ec0 0x562125b6c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f837e7fc640 0 client.4947 ms_handle_reset on v2:172.21.15.145:6832/9331508 2024-04-22T06:32:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 -- 172.21.15.113:0/3922160402 >> 172.21.15.113:0/3922160402 conn(0x562125b24ca0 msgr2=0x562125b27a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 -- 172.21.15.113:0/3922160402 shutdown_connections 2024-04-22T06:32:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 1 -- 172.21.15.113:0/3922160402 wait complete. 2024-04-22T06:32:31.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.138+0000 7f83a8bc4740 20 client.4947 trim_cache size 0 max 16384 2024-04-22T06:32:31.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.156+0000 7f83a8bc4740 1 Processor -- start 2024-04-22T06:32:31.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.156+0000 7f83a8bc4740 1 -- start start 2024-04-22T06:32:31.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b82470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b6c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b6a4d0 0x562125b6c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f83a01f2eb0 con 0x562125b67e40 2024-04-22T06:32:31.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562125b695e0 con 0x562125b6a4d0 2024-04-22T06:32:31.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x562125b6bd90 con 0x562125b28ec0 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b6c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b6c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33440/0 (socket says 172.21.15.113:33440) 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 -- 172.21.15.113:0/2644389370 learned_addr learned my addr 172.21.15.113:0/2644389370 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839ffff640 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b6a4d0 0x562125b6c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839f7fe640 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b82470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 -- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 msgr2=0x562125b82470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b82470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 -- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b6a4d0 msgr2=0x562125b6c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b6a4d0 0x562125b6c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 -- 172.21.15.113:0/2644389370 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562125b4c760 con 0x562125b67e40 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839f7fe640 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b82470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.157+0000 7f839effd640 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b6c390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83940abfd0 tx=0x7f839402c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83796b1d22eade3 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f8384ff9640 1 -- 172.21.15.113:0/2644389370 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83940a9020 con 0x562125b67e40 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f8384ff9640 1 -- 172.21.15.113:0/2644389370 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839403a040 con 0x562125b67e40 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f8384ff9640 1 -- 172.21.15.113:0/2644389370 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839407be40 con 0x562125b67e40 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 -- 172.21.15.113:0/2644389370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 msgr2=0x562125b6c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b6c390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83940abfd0 tx=0x7f839402c410 comp rx=0 tx=0).stop 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 -- 172.21.15.113:0/2644389370 shutdown_connections 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b6a4d0 0x562125b6c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b67e40 0x562125b6c390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/2644389370 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125b82470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 -- 172.21.15.113:0/2644389370 >> 172.21.15.113:0/2644389370 conn(0x562125b24ca0 msgr2=0x562125b6d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 -- 172.21.15.113:0/2644389370 shutdown_connections 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.158+0000 7f83a8bc4740 1 -- 172.21.15.113:0/2644389370 wait complete. 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 1 -- start start 2024-04-22T06:32:31.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 1 Processor -- start 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125be04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b67e40 0x562125b27460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b70b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x562125b7c130 con 0x562125b6a4d0 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562125b709f0 con 0x562125b67e40 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x562125b7c7e0 con 0x562125b28ec0 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.159+0000 7f83a8bc4740 10 client.0 _ll_register_callbacks cb 0x7f83980072f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125be04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b70b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125be04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:42172/0 (socket says 172.21.15.113:42172) 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839f7fe640 1 -- 172.21.15.113:0/846836562 learned_addr learned my addr 172.21.15.113:0/846836562 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839effd640 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b67e40 0x562125b27460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839ffff640 1 -- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 msgr2=0x562125be04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839ffff640 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125be04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839ffff640 1 -- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b67e40 msgr2=0x562125b27460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839ffff640 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b67e40 0x562125b27460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839ffff640 1 -- 172.21.15.113:0/846836562 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562125b6a0e0 con 0x562125b6a4d0 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839f7fe640 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125be04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f839ffff640 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b70b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83980012c0 tx=0x7f83a00c7ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ddb12199bd1514 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f837e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f837e7fc640 1 -- 172.21.15.113:0/846836562 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839801e450 con 0x562125b6a4d0 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f837e7fc640 1 -- 172.21.15.113:0/846836562 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f839801e770 con 0x562125b6a4d0 2024-04-22T06:32:31.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f83a8bc4740 1 -- 172.21.15.113:0/846836562 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839403a040 con 0x562125b6a4d0 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f837e7fc640 1 -- 172.21.15.113:0/846836562 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f839803c050 con 0x562125b6a4d0 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f83a8bc4740 10 client.4953 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f83a8bc4740 1 -- 172.21.15.113:0/846836562 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x562125b6c530 con 0x562125b6a4d0 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.160+0000 7f837e7fc640 1 -- 172.21.15.113:0/846836562 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839403a040 con 0x562125b6a4d0 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f837e7fc640 1 -- 172.21.15.113:0/846836562 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f839803f020 con 0x562125b6a4d0 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 10 client.4953 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 10 client.4953 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 20 client.4953 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x562125b64e60 0x562125bef570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 4 client.4953 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 1 -- 172.21.15.113:0/846836562 --> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] -- command(tid 0: {"prefix": "status"}) -- 0x562125a933a0 con 0x562125b64e60 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f839f7fe640 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x562125b64e60 0x562125bef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f837e7fc640 10 client.4953 ms_handle_connect on v2:172.21.15.145:6832/9331508 2024-04-22T06:32:31.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f839f7fe640 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x562125b64e60 0x562125bef570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=462d50ca7972489e server_cookie=c43f7f34b875fc77 in_seq=0 out_seq=0 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f837e7fc640 1 -- 172.21.15.113:0/846836562 <== mds.3 v2:172.21.15.145:6832/9331508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x7f8390029160 con 0x562125b64e60 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f837e7fc640 10 client.4953 handle_command_reply: tid=0 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 1 client.4953 shutdown 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 1 -- 172.21.15.113:0/846836562 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 msgr2=0x562125b70b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.161+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b70b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83980012c0 tx=0x7f83a00c7ab0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 1 -- 172.21.15.113:0/846836562 shutdown_connections 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x562125b64e60 0x562125bef570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x562125b6a4d0 0x562125b70b70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562125b67e40 0x562125b27460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 1 --2- 172.21.15.113:0/846836562 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x562125b28ec0 0x562125be04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f837e7fc640 0 client.4953 ms_handle_reset on v2:172.21.15.145:6832/9331508 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 1 -- 172.21.15.113:0/846836562 >> 172.21.15.113:0/846836562 conn(0x562125b24ca0 msgr2=0x562125b66660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 1 -- 172.21.15.113:0/846836562 shutdown_connections 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 1 -- 172.21.15.113:0/846836562 wait complete. 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a8bc4740 20 client.4953 trim_cache size 0 max 16384 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 3, 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4264, 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:31.168 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 17.213567258000001, 2024-04-22T06:32:31.169 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:31.169 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:31.169 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:31.169 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 60.540430186999998 2024-04-22T06:32:31.169 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 -- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f838c06c8f0 msgr2=0x7f838c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f838c06c8f0 0x7f838c06edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8390009560 tx=0x7f8390008040 comp rx=0 tx=0).stop 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 -- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83a0158a50 msgr2=0x7f83a014f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83a0158a50 0x7f83a014f330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8394009c60 tx=0x7f8394004730 comp rx=0 tx=0).stop 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 -- 172.21.15.113:0/3207767256 shutdown_connections 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f83a01489a0 0x7f83a0142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f838c06c8f0 0x7f838c06edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f83a0158a50 0x7f83a014f330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 --2- 172.21.15.113:0/3207767256 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8388003ef0 0x7f83a01ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 -- 172.21.15.113:0/3207767256 >> 172.21.15.113:0/3207767256 conn(0x7f83a0074d50 msgr2=0x7f83a0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 -- 172.21.15.113:0/3207767256 shutdown_connections 2024-04-22T06:32:31.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.162+0000 7f83a5fce640 1 -- 172.21.15.113:0/3207767256 wait complete. 2024-04-22T06:32:31.172 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-22T06:32:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.270+0000 7f278a7b2640 1 Processor -- start 2024-04-22T06:32:31.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.270+0000 7f278a7b2640 1 -- start start 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f278a7b2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2784144270 0x7f278415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f278a7b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f27840c8e70 0x7f2784074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f278a7b2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2784144650 con 0x7f27840c9290 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f278a7b2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f278415f4e0 con 0x7f27840c8e70 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f278a7b2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f27840ce080 con 0x7f2784144270 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f27837fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f27840c8e70 0x7f2784074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f2788d4f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f27840c9290 0x7f2784075290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44974/0 (socket says 172.21.15.113:44974) 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f2788d4f640 1 -- 172.21.15.113:0/561794987 learned_addr learned my addr 172.21.15.113:0/561794987 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:31.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.271+0000 7f27837fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f27840c8e70 0x7f2784074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33464/0 (socket says 172.21.15.113:33464) 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.272+0000 7f2783fff640 1 --2- 172.21.15.113:0/561794987 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2784144270 0x7f278415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.272+0000 7f27837fe640 1 -- 172.21.15.113:0/561794987 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2784144270 msgr2=0x7f278415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.272+0000 7f27837fe640 1 --2- 172.21.15.113:0/561794987 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2784144270 0x7f278415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.272+0000 7f27837fe640 1 -- 172.21.15.113:0/561794987 >> v1:172.21.15.113:6789/0 conn(0x7f27840c9290 legacy=0x7f2784075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.272+0000 7f2782ffd640 1 -- 172.21.15.113:0/561794987 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102074670 0 0) 0x7f2784144650 con 0x7f27840c9290 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.272+0000 7f27837fe640 1 -- 172.21.15.113:0/561794987 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278415b0b0 con 0x7f27840c8e70 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.272+0000 7f2783fff640 1 --2- 172.21.15.113:0/561794987 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2784144270 0x7f278415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.272+0000 7f27837fe640 1 --2- 172.21.15.113:0/561794987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27840c8e70 0x7f2784074d50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f27780097a0 tx=0x7f277802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366a38549588410a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f2782ffd640 1 -- 172.21.15.113:0/561794987 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778034070 con 0x7f27840c8e70 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f2782ffd640 1 -- 172.21.15.113:0/561794987 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2778030610 con 0x7f27840c8e70 2024-04-22T06:32:31.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f2782ffd640 1 -- 172.21.15.113:0/561794987 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27780309e0 con 0x7f27840c8e70 2024-04-22T06:32:31.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f278a7b2640 1 -- 172.21.15.113:0/561794987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27840c8e70 msgr2=0x7f2784074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f278a7b2640 1 --2- 172.21.15.113:0/561794987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27840c8e70 0x7f2784074d50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f27780097a0 tx=0x7f277802b960 comp rx=0 tx=0).stop 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f278a7b2640 1 -- 172.21.15.113:0/561794987 shutdown_connections 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f278a7b2640 1 --2- 172.21.15.113:0/561794987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f27840c8e70 0x7f2784074d50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f278a7b2640 1 --2- 172.21.15.113:0/561794987 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2784144270 0x7f278415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f278a7b2640 1 -- 172.21.15.113:0/561794987 >> 172.21.15.113:0/561794987 conn(0x7f278406b920 msgr2=0x7f278406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f278a7b2640 1 -- 172.21.15.113:0/561794987 shutdown_connections 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.273+0000 7f278a7b2640 1 -- 172.21.15.113:0/561794987 wait complete. 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.274+0000 7f278a7b2640 1 Processor -- start 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.274+0000 7f278a7b2640 1 -- start start 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f278a7b2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27840c8e70 0x7f27841f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f278a7b2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27840c9290 0x7f27841f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f278a7b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2784144270 0x7f27841e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f278a7b2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f278415b8e0 con 0x7f2784144270 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f278a7b2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f278415b600 con 0x7f27840c9290 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f278a7b2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f27840ce360 con 0x7f27840c8e70 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f2788d4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2784144270 0x7f27841e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f2788d4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2784144270 0x7f27841e5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33478/0 (socket says 172.21.15.113:33478) 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f2788d4f640 1 -- 172.21.15.113:0/3443782702 learned_addr learned my addr 172.21.15.113:0/3443782702 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f27837fe640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27840c9290 0x7f27841f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.275+0000 7f2783fff640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27840c8e70 0x7f27841f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2788d4f640 1 -- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27840c8e70 msgr2=0x7f27841f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2788d4f640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27840c8e70 0x7f27841f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2788d4f640 1 -- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27840c9290 msgr2=0x7f27841f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2788d4f640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27840c9290 0x7f27841f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2788d4f640 1 -- 172.21.15.113:0/3443782702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2784142570 con 0x7f2784144270 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f27837fe640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27840c9290 0x7f27841f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2783fff640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27840c8e70 0x7f27841f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2788d4f640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2784144270 0x7f27841e5ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c730 tx=0x7f277c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2780ff9640 1 -- 172.21.15.113:0/3443782702 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c018070 con 0x7f2784144270 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2780ff9640 1 -- 172.21.15.113:0/3443782702 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c00ce40 con 0x7f2784144270 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f278a7b2640 1 -- 172.21.15.113:0/3443782702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27840c4960 con 0x7f2784144270 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f2780ff9640 1 -- 172.21.15.113:0/3443782702 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c00a820 con 0x7f2784144270 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.276+0000 7f278a7b2640 1 -- 172.21.15.113:0/3443782702 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27841427e0 con 0x7f2784144270 2024-04-22T06:32:31.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.277+0000 7f2780ff9640 1 -- 172.21.15.113:0/3443782702 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f277c01b070 con 0x7f2784144270 2024-04-22T06:32:31.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.278+0000 7f2780ff9640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f277006c8f0 0x7f277006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.278+0000 7f2780ff9640 1 -- 172.21.15.113:0/3443782702 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f277c08b400 con 0x7f2784144270 2024-04-22T06:32:31.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.278+0000 7f2783fff640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f277006c8f0 0x7f277006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.278+0000 7f2783fff640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f277006c8f0 0x7f277006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f277400aa30 tx=0x7f2774008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.279+0000 7f278d3a2740 1 Processor -- start 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.279+0000 7f278d3a2740 1 -- start start 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.279+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.279+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.279+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e106ca0 0x55985e12eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.279+0000 7f278d3a2740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x55985e06db10 con 0x55985e10aec0 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.279+0000 7f278d3a2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55985e00b240 con 0x55985e106ca0 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.279+0000 7f278d3a2740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55985e069ad0 con 0x55985e149e40 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e1534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33488/0 (socket says 172.21.15.113:33488) 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 -- 172.21.15.113:0/3270763563 learned_addr learned my addr 172.21.15.113:0/3270763563 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f2788d4f640 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e106ca0 0x55985e12eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f2783fff640 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 -- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 msgr2=0x55985e152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 -- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e106ca0 msgr2=0x55985e12eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e106ca0 0x55985e12eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 -- 172.21.15.113:0/3270763563 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985dd802d0 con 0x55985e10aec0 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f2788d4f640 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e106ca0 0x55985e12eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f2783fff640 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f27837fe640 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e1534a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2778000c00 tx=0x7f2778030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedff81428b3b8f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f2769ffb640 1 -- 172.21.15.113:0/3270763563 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778048070 con 0x55985e10aec0 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f2769ffb640 1 -- 172.21.15.113:0/3270763563 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2778003610 con 0x55985e10aec0 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.280+0000 7f2769ffb640 1 -- 172.21.15.113:0/3270763563 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778034040 con 0x55985e10aec0 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 -- 172.21.15.113:0/3270763563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 msgr2=0x55985e1534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e1534a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2778000c00 tx=0x7f2778030000 comp rx=0 tx=0).stop 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 -- 172.21.15.113:0/3270763563 shutdown_connections 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e106ca0 0x55985e12eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e1534a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 --2- 172.21.15.113:0/3270763563 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 -- 172.21.15.113:0/3270763563 >> 172.21.15.113:0/3270763563 conn(0x55985e105990 msgr2=0x55985e108290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 -- 172.21.15.113:0/3270763563 shutdown_connections 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 -- 172.21.15.113:0/3270763563 wait complete. 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.281+0000 7f278d3a2740 1 -- start start 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f278d3a2740 1 Processor -- start 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e10aec0 0x55985e15e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e149e40 0x55985e151490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f278d3a2740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x55985e109250 con 0x55985e14ee80 2024-04-22T06:32:31.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f278d3a2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55985dff6190 con 0x55985e149e40 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f278d3a2740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55985e109530 con 0x55985e10aec0 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f278d3a2740 10 client.0 _ll_register_callbacks cb 0x55985dff18b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f2788d4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f2788d4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33496/0 (socket says 172.21.15.113:33496) 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.282+0000 7f2788d4f640 1 -- 172.21.15.113:0/1192181144 learned_addr learned my addr 172.21.15.113:0/1192181144 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2788d4f640 1 -- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e10aec0 msgr2=0x55985e15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f27837fe640 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e149e40 0x55985e151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2783fff640 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e10aec0 0x55985e15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2788d4f640 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e10aec0 0x55985e15e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2788d4f640 1 -- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e149e40 msgr2=0x55985e151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2788d4f640 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e149e40 0x55985e151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2788d4f640 1 -- 172.21.15.113:0/1192181144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985de4a6b0 con 0x55985e14ee80 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f27837fe640 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e149e40 0x55985e151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2788d4f640 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e143650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f277c00a430 tx=0x7f277c058f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdf4030566327da server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2762ffd640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2762ffd640 1 -- 172.21.15.113:0/1192181144 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c071170 con 0x55985e14ee80 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2762ffd640 1 -- 172.21.15.113:0/1192181144 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f277c071310 con 0x55985e14ee80 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 1 -- 172.21.15.113:0/1192181144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2778003610 con 0x55985e14ee80 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2762ffd640 1 -- 172.21.15.113:0/1192181144 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f277c089050 con 0x55985e14ee80 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 10 client.4968 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 1 -- 172.21.15.113:0/1192181144 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55985e1519d0 con 0x55985e14ee80 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2762ffd640 1 -- 172.21.15.113:0/1192181144 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2778003610 con 0x55985e14ee80 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f2762ffd640 1 -- 172.21.15.113:0/1192181144 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f277c058210 con 0x55985e14ee80 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 10 client.4968 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 10 client.4968 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-22T06:32:31.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 20 client.4968 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x55985e1036a0 0x55985e169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 4 client.4968 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.283+0000 7f278d3a2740 1 -- 172.21.15.113:0/1192181144 --> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55985e07b530 con 0x55985e1036a0 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.284+0000 7f2783fff640 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x55985e1036a0 0x55985e169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.284+0000 7f2762ffd640 10 client.4968 ms_handle_connect on v2:172.21.15.113:6834/999776030 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.284+0000 7f2783fff640 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x55985e1036a0 0x55985e169ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e81bd2d954f482f server_cookie=105b4ca2729ba0e7 in_seq=0 out_seq=0 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.284+0000 7f2762ffd640 1 -- 172.21.15.113:0/1192181144 <== mds.2 v2:172.21.15.113:6834/999776030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55985e07b530 con 0x55985e1036a0 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.284+0000 7f2762ffd640 10 client.4968 handle_command_reply: tid=0 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.284+0000 7f278d3a2740 1 client.4968 shutdown 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 -- 172.21.15.113:0/1192181144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 msgr2=0x55985e143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e143650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f277c00a430 tx=0x7f277c058f00 comp rx=0 tx=0).stop 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 -- 172.21.15.113:0/1192181144 shutdown_connections 2024-04-22T06:32:31.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x55985e1036a0 0x55985e169ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e143650 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f2762ffd640 0 client.4968 ms_handle_reset on v2:172.21.15.113:6834/999776030 2024-04-22T06:32:31.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e149e40 0x55985e151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 --2- 172.21.15.113:0/1192181144 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e10aec0 0x55985e15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 -- 172.21.15.113:0/1192181144 >> 172.21.15.113:0/1192181144 conn(0x55985e106ca0 msgr2=0x55985e149440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 -- 172.21.15.113:0/1192181144 shutdown_connections 2024-04-22T06:32:31.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 1 -- 172.21.15.113:0/1192181144 wait complete. 2024-04-22T06:32:31.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.285+0000 7f278d3a2740 20 client.4968 trim_cache size 0 max 16384 2024-04-22T06:32:31.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.303+0000 7f278d3a2740 1 Processor -- start 2024-04-22T06:32:31.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.303+0000 7f278d3a2740 1 -- start start 2024-04-22T06:32:31.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.303+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e14a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.303+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e147660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.303+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e14ee80 0x55985e147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.303+0000 7f278d3a2740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f278413f7d0 con 0x55985e10aec0 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.303+0000 7f278d3a2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55985e15eb90 con 0x55985e14ee80 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.303+0000 7f278d3a2740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55985e150d10 con 0x55985e149e40 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e14a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e14a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33498/0 (socket says 172.21.15.113:33498) 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 -- 172.21.15.113:0/4065898169 learned_addr learned my addr 172.21.15.113:0/4065898169 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 -- 172.21.15.113:0/4065898169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 msgr2=0x55985e147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 --2- 172.21.15.113:0/4065898169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 -- 172.21.15.113:0/4065898169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e14ee80 msgr2=0x55985e147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2788d4f640 1 --2- 172.21.15.113:0/4065898169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e14ee80 0x55985e147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 --2- 172.21.15.113:0/4065898169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e14ee80 0x55985e147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 -- 172.21.15.113:0/4065898169 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985e15e480 con 0x55985e10aec0 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f2783fff640 1 --2- 172.21.15.113:0/4065898169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e14a690 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f277400a810 tx=0x7f2774015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab620304b1f311b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f27697fa640 1 -- 172.21.15.113:0/4065898169 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277402e070 con 0x55985e10aec0 2024-04-22T06:32:31.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f27697fa640 1 -- 172.21.15.113:0/4065898169 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277401c040 con 0x55985e10aec0 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.304+0000 7f27697fa640 1 -- 172.21.15.113:0/4065898169 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277401b070 con 0x55985e10aec0 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 -- 172.21.15.113:0/4065898169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 msgr2=0x55985e14a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4065898169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e14a690 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f277400a810 tx=0x7f2774015000 comp rx=0 tx=0).stop 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 -- 172.21.15.113:0/4065898169 shutdown_connections 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4065898169 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e14ee80 0x55985e147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4065898169 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4065898169 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e10aec0 0x55985e14a690 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 -- 172.21.15.113:0/4065898169 >> 172.21.15.113:0/4065898169 conn(0x55985e106ca0 msgr2=0x55985e149520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 -- 172.21.15.113:0/4065898169 shutdown_connections 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 -- 172.21.15.113:0/4065898169 wait complete. 2024-04-22T06:32:31.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.305+0000 7f278d3a2740 1 -- start start 2024-04-22T06:32:31.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f278d3a2740 1 Processor -- start 2024-04-22T06:32:31.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e10aec0 0x55985e1c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f278d3a2740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e147660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f278d3a2740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x55985e103520 con 0x55985e14ee80 2024-04-22T06:32:31.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f278d3a2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55985e151be0 con 0x55985e10aec0 2024-04-22T06:32:31.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f278d3a2740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55985e103bf0 con 0x55985e149e40 2024-04-22T06:32:31.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f278d3a2740 10 client.0 _ll_register_callbacks cb 0x7f277c055060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f2788d4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f2788d4f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e147660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33508/0 (socket says 172.21.15.113:33508) 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f2788d4f640 1 -- 172.21.15.113:0/4149318082 learned_addr learned my addr 172.21.15.113:0/4149318082 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f2783fff640 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e10aec0 0x55985e1c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.306+0000 7f27837fe640 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2788d4f640 1 -- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 msgr2=0x55985e146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2788d4f640 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2788d4f640 1 -- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e10aec0 msgr2=0x55985e1c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2788d4f640 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e10aec0 0x55985e1c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2788d4f640 1 -- 172.21.15.113:0/4149318082 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985e1c8bb0 con 0x55985e14ee80 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2783fff640 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e10aec0 0x55985e1c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2788d4f640 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e147660 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f277c08b720 tx=0x7f277c08b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9f1bc6e736411a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2762ffd640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2762ffd640 1 -- 172.21.15.113:0/4149318082 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c08b0c0 con 0x55985e14ee80 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2762ffd640 1 -- 172.21.15.113:0/4149318082 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f277c078370 con 0x55985e14ee80 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 1 -- 172.21.15.113:0/4149318082 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f277401c040 con 0x55985e14ee80 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2762ffd640 1 -- 172.21.15.113:0/4149318082 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f277c08b260 con 0x55985e14ee80 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 10 client.4974 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 1 -- 172.21.15.113:0/4149318082 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55985e1406d0 con 0x55985e14ee80 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2762ffd640 1 -- 172.21.15.113:0/4149318082 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277401c040 con 0x55985e14ee80 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2762ffd640 1 -- 172.21.15.113:0/4149318082 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f277c071170 con 0x55985e14ee80 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 10 client.4974 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 10 client.4974 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 20 client.4974 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x55985e12da10 0x55985e1d1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 4 client.4974 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:31.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f278d3a2740 1 -- 172.21.15.113:0/4149318082 --> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] -- command(tid 0: {"prefix": "status"}) -- 0x55985e0753a0 con 0x55985e12da10 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.307+0000 7f2783fff640 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x55985e12da10 0x55985e1d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f2762ffd640 10 client.4974 ms_handle_connect on v2:172.21.15.113:6834/999776030 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f2783fff640 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x55985e12da10 0x55985e1d1910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee34afc5d130e7b6 server_cookie=69c26c400f99bf3a in_seq=0 out_seq=0 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f2762ffd640 1 -- 172.21.15.113:0/4149318082 <== mds.2 v2:172.21.15.113:6834/999776030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55985e0753a0 con 0x55985e12da10 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f2762ffd640 10 client.4974 handle_command_reply: tid=0 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 client.4974 shutdown 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 -- 172.21.15.113:0/4149318082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 msgr2=0x55985e147660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e147660 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f277c08b720 tx=0x7f277c08b050 comp rx=0 tx=0).stop 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 -- 172.21.15.113:0/4149318082 shutdown_connections 2024-04-22T06:32:31.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x55985e12da10 0x55985e1d1910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55985e14ee80 0x55985e147660 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f2762ffd640 0 client.4974 ms_handle_reset on v2:172.21.15.113:6834/999776030 2024-04-22T06:32:31.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55985e149e40 0x55985e146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 --2- 172.21.15.113:0/4149318082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55985e10aec0 0x55985e1c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 -- 172.21.15.113:0/4149318082 >> 172.21.15.113:0/4149318082 conn(0x55985e106ca0 msgr2=0x55985e148a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 -- 172.21.15.113:0/4149318082 shutdown_connections 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 1 -- 172.21.15.113:0/4149318082 wait complete. 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.308+0000 7f278d3a2740 20 client.4974 trim_cache size 0 max 16384 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 2, 2024-04-22T06:32:31.318 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4305, 2024-04-22T06:32:31.319 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:31.319 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:31.319 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:31.319 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 23.379094069000001, 2024-04-22T06:32:31.319 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:31.319 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:31.319 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:31.319 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 60.704033567000003 2024-04-22T06:32:31.320 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:31.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 -- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f277006c8f0 msgr2=0x7f277006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f277006c8f0 0x7f277006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f277400aa30 tx=0x7f2774008040 comp rx=0 tx=0).stop 2024-04-22T06:32:31.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 -- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2784144270 msgr2=0x7f27841e5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2784144270 0x7f27841e5ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c730 tx=0x7f277c00cbf0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 -- 172.21.15.113:0/3443782702 shutdown_connections 2024-04-22T06:32:31.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f277006c8f0 0x7f277006edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2784144270 0x7f27841e5ad0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27840c9290 0x7f27841f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 --2- 172.21.15.113:0/3443782702 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f27840c8e70 0x7f27841f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 -- 172.21.15.113:0/3443782702 >> 172.21.15.113:0/3443782702 conn(0x7f278406b920 msgr2=0x7f2784140e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 -- 172.21.15.113:0/3443782702 shutdown_connections 2024-04-22T06:32:31.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.309+0000 7f278a7b2640 1 -- 172.21.15.113:0/3443782702 wait complete. 2024-04-22T06:32:31.323 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-22T06:32:31.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.422+0000 7f1d1eb38640 1 Processor -- start 2024-04-22T06:32:31.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.422+0000 7f1d1eb38640 1 -- start start 2024-04-22T06:32:31.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.422+0000 7f1d1eb38640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d180c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.422+0000 7f1d1eb38640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1d1815cbd0 0x7f1d180c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.422+0000 7f1d1eb38640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d18158fe0 con 0x7f1d180c8870 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.422+0000 7f1d1eb38640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1d181592c0 con 0x7f1d1815cbd0 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.422+0000 7f1d1eb38640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1d181595a0 con 0x7f1d18152f70 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d17fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1d180c8870 0x7f1d1815c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44990/0 (socket says 172.21.15.113:44990) 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d17fff640 1 -- 172.21.15.113:0/3677185195 learned_addr learned my addr 172.21.15.113:0/3677185195 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/3677185195 >> v2:172.21.15.145:3300/0 conn(0x7f1d1815cbd0 0x7f1d180c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d180c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d177fe640 1 -- 172.21.15.113:0/3677185195 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015190427 0 0) 0x7f1d18158fe0 con 0x7f1d180c8870 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d177fe640 1 -- 172.21.15.113:0/3677185195 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d04003520 con 0x7f1d180c8870 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d1d0d5640 1 -- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 msgr2=0x7f1d180c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d180c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d177fe640 1 -- 172.21.15.113:0/3677185195 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 953852204 0 0) 0x7f1d04003520 con 0x7f1d180c8870 2024-04-22T06:32:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d1d0d5640 1 -- 172.21.15.113:0/3677185195 >> v1:172.21.15.113:6789/0 conn(0x7f1d180c8870 legacy=0x7f1d1815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d1d0d5640 1 -- 172.21.15.113:0/3677185195 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d18159880 con 0x7f1d1815cbd0 2024-04-22T06:32:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.423+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d180c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.424+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 0x7f1d180c6090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1d080097a0 tx=0x7f1d0802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf65f619806b0163 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.424+0000 7f1d177fe640 1 -- 172.21.15.113:0/3677185195 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08037070 con 0x7f1d1815cbd0 2024-04-22T06:32:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.424+0000 7f1d177fe640 1 -- 172.21.15.113:0/3677185195 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d08030510 con 0x7f1d1815cbd0 2024-04-22T06:32:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.424+0000 7f1d177fe640 1 -- 172.21.15.113:0/3677185195 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00001670 con 0x7f1d1815cbd0 2024-04-22T06:32:31.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.425+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 msgr2=0x7f1d180c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.425+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 0x7f1d180c6090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1d080097a0 tx=0x7f1d0802b790 comp rx=0 tx=0).stop 2024-04-22T06:32:31.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.425+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3677185195 shutdown_connections 2024-04-22T06:32:31.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.425+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 0x7f1d180c6090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.425+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3677185195 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d180c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.425+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3677185195 >> 172.21.15.113:0/3677185195 conn(0x7f1d18074d50 msgr2=0x7f1d18075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.425+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3677185195 shutdown_connections 2024-04-22T06:32:31.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.425+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3677185195 wait complete. 2024-04-22T06:32:31.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.426+0000 7f1d1eb38640 1 Processor -- start 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.426+0000 7f1d1eb38640 1 -- start start 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1eb38640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d180c8870 0x7f1d181ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1eb38640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d1815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1eb38640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 0x7f1d18158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1eb38640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181534d0 con 0x7f1d180c8870 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1eb38640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1d18153350 con 0x7f1d1815cbd0 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1eb38640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1d18073a30 con 0x7f1d18152f70 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d180c8870 0x7f1d181ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d180c8870 0x7f1d181ee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33514/0 (socket says 172.21.15.113:33514) 2024-04-22T06:32:31.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/3708967416 learned_addr learned my addr 172.21.15.113:0/3708967416 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 0x7f1d18158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d17fff640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d1815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/3708967416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 msgr2=0x7f1d1815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d1815bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/3708967416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 msgr2=0x7f1d18158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 0x7f1d18158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/3708967416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d18157020 con 0x7f1d180c8870 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d180c8870 0x7f1d181ee700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009f60 tx=0x7f1d10009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d157fa640 1 -- 172.21.15.113:0/3708967416 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10018020 con 0x7f1d180c8870 2024-04-22T06:32:31.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d157fa640 1 -- 172.21.15.113:0/3708967416 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10014680 con 0x7f1d180c8870 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3708967416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d180cb050 con 0x7f1d180c8870 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d157fa640 1 -- 172.21.15.113:0/3708967416 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10014a50 con 0x7f1d180c8870 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.427+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3708967416 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d180cb610 con 0x7f1d180c8870 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.429+0000 7f1d157fa640 1 -- 172.21.15.113:0/3708967416 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d10005d10 con 0x7f1d180c8870 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.429+0000 7f1d157fa640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1cf806c920 0x7f1cf806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.429+0000 7f1d157fa640 1 -- 172.21.15.113:0/3708967416 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1d1008cd00 con 0x7f1d180c8870 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.429+0000 7f1d17fff640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1cf806c920 0x7f1cf806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.430+0000 7f1d17fff640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1cf806c920 0x7f1cf806ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1d00001eb0 tx=0x7f1d00009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.430+0000 7f1d217fd740 1 Processor -- start 2024-04-22T06:32:31.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.430+0000 7f1d217fd740 1 -- start start 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e68382f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68336ca0 0x555e6835eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d217fd740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x555e6829db10 con 0x555e6833aec0 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d217fd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555e6823b240 con 0x555e68336ca0 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d217fd740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x555e68299ad0 con 0x555e68379e40 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683834a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33526/0 (socket says 172.21.15.113:33526) 2024-04-22T06:32:31.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 -- 172.21.15.113:0/2574015778 learned_addr learned my addr 172.21.15.113:0/2574015778 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 -- 172.21.15.113:0/2574015778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 msgr2=0x555e68382f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 --2- 172.21.15.113:0/2574015778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e68382f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 -- 172.21.15.113:0/2574015778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68336ca0 msgr2=0x555e6835eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/2574015778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68336ca0 0x555e6835eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 --2- 172.21.15.113:0/2574015778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68336ca0 0x555e6835eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 -- 172.21.15.113:0/2574015778 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e67fb02d0 con 0x555e6833aec0 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.431+0000 7f1d17fff640 1 --2- 172.21.15.113:0/2574015778 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683834a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d00005b60 tx=0x7f1d00010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab256c4d9f43092 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d0e7fc640 1 -- 172.21.15.113:0/2574015778 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00007750 con 0x555e6833aec0 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d0e7fc640 1 -- 172.21.15.113:0/2574015778 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0000dbb0 con 0x555e6833aec0 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d0e7fc640 1 -- 172.21.15.113:0/2574015778 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00020450 con 0x555e6833aec0 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 -- 172.21.15.113:0/2574015778 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 msgr2=0x555e683834a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2574015778 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683834a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d00005b60 tx=0x7f1d00010000 comp rx=0 tx=0).stop 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 -- 172.21.15.113:0/2574015778 shutdown_connections 2024-04-22T06:32:31.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2574015778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68336ca0 0x555e6835eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2574015778 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683834a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2574015778 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e68382f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 -- 172.21.15.113:0/2574015778 >> 172.21.15.113:0/2574015778 conn(0x555e68335990 msgr2=0x555e68338290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 -- 172.21.15.113:0/2574015778 shutdown_connections 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.432+0000 7f1d217fd740 1 -- 172.21.15.113:0/2574015778 wait complete. 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.433+0000 7f1d217fd740 1 -- start start 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.433+0000 7f1d217fd740 1 Processor -- start 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e68333440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68379e40 0x555e6838e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e6838e7f0 0x555e68373650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x555e68339250 con 0x555e6833aec0 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555e68226190 con 0x555e68379e40 2024-04-22T06:32:31.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x555e68339530 con 0x555e6838e7f0 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 10 client.0 _ll_register_callbacks cb 0x555e682218b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e68333440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e68333440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33542/0 (socket says 172.21.15.113:33542) 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/2011567883 learned_addr learned my addr 172.21.15.113:0/2011567883 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d17fff640 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68379e40 0x555e6838e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e6838e7f0 0x555e68373650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/2011567883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e6838e7f0 msgr2=0x555e68373650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e6838e7f0 0x555e68373650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/2011567883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68379e40 msgr2=0x555e6838e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68379e40 0x555e6838e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/2011567883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e6807a6b0 con 0x555e6833aec0 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e68333440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1d10062d70 tx=0x7f1d1005ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78829725a919a54 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1cf77fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2011567883 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10089060 con 0x555e6833aec0 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2011567883 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1d10024db0 con 0x555e6833aec0 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 1 -- 172.21.15.113:0/2011567883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d0000dbb0 con 0x555e6833aec0 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2011567883 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1d10077050 con 0x555e6833aec0 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.434+0000 7f1d217fd740 10 client.4986 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d217fd740 1 -- 172.21.15.113:0/2011567883 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555e68358630 con 0x555e6833aec0 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2011567883 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0000dbb0 con 0x555e6833aec0 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2011567883 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f1d10059b10 con 0x555e6833aec0 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d217fd740 10 client.4986 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d217fd740 10 client.4986 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d217fd740 20 client.4986 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x555e68395720 0x555e68399b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d217fd740 4 client.4986 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:31.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d217fd740 1 -- 172.21.15.113:0/2011567883 --> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e682ab530 con 0x555e68395720 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d17fff640 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x555e68395720 0x555e68399b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1d17fff640 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x555e68395720 0x555e68399b10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e308eea932bf18d server_cookie=1ce681fbcf25e624 in_seq=0 out_seq=0 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.435+0000 7f1cf77fe640 10 client.4986 ms_handle_connect on v2:172.21.15.113:6836/1889319276 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2011567883 <== mds.1 v2:172.21.15.113:6836/1889319276 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555e682ab530 con 0x555e68395720 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1cf77fe640 10 client.4986 handle_command_reply: tid=0 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 client.4986 shutdown 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 -- 172.21.15.113:0/2011567883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 msgr2=0x555e68333440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e68333440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1d10062d70 tx=0x7f1d1005ae80 comp rx=0 tx=0).stop 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 -- 172.21.15.113:0/2011567883 shutdown_connections 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x555e68395720 0x555e68399b10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e6838e7f0 0x555e68373650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68379e40 0x555e6838e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1cf77fe640 0 client.4986 ms_handle_reset on v2:172.21.15.113:6836/1889319276 2024-04-22T06:32:31.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2011567883 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e68333440 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 -- 172.21.15.113:0/2011567883 >> 172.21.15.113:0/2011567883 conn(0x555e68336ca0 msgr2=0x555e68379440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 -- 172.21.15.113:0/2011567883 shutdown_connections 2024-04-22T06:32:31.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 1 -- 172.21.15.113:0/2011567883 wait complete. 2024-04-22T06:32:31.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.436+0000 7f1d217fd740 20 client.4986 trim_cache size 0 max 16384 2024-04-22T06:32:31.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.454+0000 7f1d217fd740 1 Processor -- start 2024-04-22T06:32:31.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.454+0000 7f1d217fd740 1 -- start start 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e6837a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68382c50 0x555e6837a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d217fd740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1813f8a0 con 0x555e6833aec0 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d217fd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555e6835a2c0 con 0x555e68382c50 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d217fd740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x555e68333c30 con 0x555e68379e40 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33556/0 (socket says 172.21.15.113:33556) 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/2280968334 learned_addr learned my addr 172.21.15.113:0/2280968334 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d17fff640 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e6837a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68382c50 0x555e6837a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/2280968334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 msgr2=0x555e6837a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e6837a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/2280968334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68382c50 msgr2=0x555e6837a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68382c50 0x555e6837a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 -- 172.21.15.113:0/2280968334 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e68335300 con 0x555e6833aec0 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683382a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1d1008d020 tx=0x7f1d10072000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92179c1fcfb9e2a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.455+0000 7f1d0dffb640 1 -- 172.21.15.113:0/2280968334 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10071030 con 0x555e6833aec0 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d0dffb640 1 -- 172.21.15.113:0/2280968334 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10024db0 con 0x555e6833aec0 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d0dffb640 1 -- 172.21.15.113:0/2280968334 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10056410 con 0x555e6833aec0 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 -- 172.21.15.113:0/2280968334 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 msgr2=0x555e683382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683382a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1d1008d020 tx=0x7f1d10072000 comp rx=0 tx=0).stop 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 -- 172.21.15.113:0/2280968334 shutdown_connections 2024-04-22T06:32:31.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e68382c50 0x555e6837a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e6837a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2280968334 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e6833aec0 0x555e683382a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 -- 172.21.15.113:0/2280968334 >> 172.21.15.113:0/2280968334 conn(0x555e68336ca0 msgr2=0x555e68378bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 -- 172.21.15.113:0/2280968334 shutdown_connections 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.456+0000 7f1d217fd740 1 -- 172.21.15.113:0/2280968334 wait complete. 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.457+0000 7f1d217fd740 1 -- start start 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.457+0000 7f1d217fd740 1 Processor -- start 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e6833aec0 0x555e683562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e683f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e68382c50 0x555e683f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x555e683955a0 con 0x555e68382c50 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555e68382a20 con 0x555e6833aec0 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x555e68395c30 con 0x555e68379e40 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 10 client.0 _ll_register_callbacks cb 0x7f1d1000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e68382c50 0x555e683f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e68382c50 0x555e683f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33562/0 (socket says 172.21.15.113:33562) 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 -- 172.21.15.113:0/2947818475 learned_addr learned my addr 172.21.15.113:0/2947818475 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e6833aec0 0x555e683562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d17fff640 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e683f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 -- 172.21.15.113:0/2947818475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 msgr2=0x555e683f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e683f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 -- 172.21.15.113:0/2947818475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e6833aec0 msgr2=0x555e683562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e6833aec0 0x555e683562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 -- 172.21.15.113:0/2947818475 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e68336720 con 0x555e68382c50 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d1d0d5640 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e68382c50 0x555e683f3c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1d080098c0 tx=0x7f1d08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d3c6bd2dedd71a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1cf77fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2947818475 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08037040 con 0x555e68382c50 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2947818475 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1d08004440 con 0x555e68382c50 2024-04-22T06:32:31.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 1 -- 172.21.15.113:0/2947818475 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d10024db0 con 0x555e68382c50 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2947818475 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1d0804d050 con 0x555e68382c50 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 10 client.4992 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.458+0000 7f1d217fd740 1 -- 172.21.15.113:0/2947818475 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555e68357e30 con 0x555e68382c50 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2947818475 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10024db0 con 0x555e68382c50 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2947818475 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f1d08050020 con 0x555e68382c50 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d217fd740 10 client.4992 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d217fd740 10 client.4992 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d217fd740 20 client.4992 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x555e6837da70 0x555e684062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d217fd740 4 client.4992 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d217fd740 1 -- 172.21.15.113:0/2947818475 --> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] -- command(tid 0: {"prefix": "status"}) -- 0x555e682a53a0 con 0x555e6837da70 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x555e6837da70 0x555e684062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1cf77fe640 10 client.4992 ms_handle_connect on v2:172.21.15.113:6836/1889319276 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d1c8d4640 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x555e6837da70 0x555e684062c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e83a33ac6947f5b5 server_cookie=900faf162b233dac in_seq=0 out_seq=0 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1cf77fe640 1 -- 172.21.15.113:0/2947818475 <== mds.1 v2:172.21.15.113:6836/1889319276 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555e682a53a0 con 0x555e6837da70 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1cf77fe640 10 client.4992 handle_command_reply: tid=0 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.459+0000 7f1d217fd740 1 client.4992 shutdown 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 -- 172.21.15.113:0/2947818475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e68382c50 msgr2=0x555e683f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e68382c50 0x555e683f3c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1d080098c0 tx=0x7f1d08004730 comp rx=0 tx=0).stop 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 -- 172.21.15.113:0/2947818475 shutdown_connections 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x555e6837da70 0x555e684062c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555e68382c50 0x555e683f3c50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x555e68379e40 0x555e683f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1cf77fe640 0 client.4992 ms_handle_reset on v2:172.21.15.113:6836/1889319276 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 --2- 172.21.15.113:0/2947818475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e6833aec0 0x555e683562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 -- 172.21.15.113:0/2947818475 >> 172.21.15.113:0/2947818475 conn(0x555e68336ca0 msgr2=0x555e6837ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 -- 172.21.15.113:0/2947818475 shutdown_connections 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 1 -- 172.21.15.113:0/2947818475 wait complete. 2024-04-22T06:32:31.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d217fd740 20 client.4992 trim_cache size 0 max 16384 2024-04-22T06:32:31.468 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:31.468 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:31.468 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 1, 2024-04-22T06:32:31.468 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4308, 2024-04-22T06:32:31.468 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:31.468 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:31.468 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:31.469 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 28.760304479999999, 2024-04-22T06:32:31.469 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:31.469 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:31.469 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:31.469 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 60.852901826 2024-04-22T06:32:31.469 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:31.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1cf806c920 msgr2=0x7f1cf806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1cf806c920 0x7f1cf806ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1d00001eb0 tx=0x7f1d00009040 comp rx=0 tx=0).stop 2024-04-22T06:32:31.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d180c8870 msgr2=0x7f1d181ee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d180c8870 0x7f1d181ee700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009f60 tx=0x7f1d10009f90 comp rx=0 tx=0).stop 2024-04-22T06:32:31.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3708967416 shutdown_connections 2024-04-22T06:32:31.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d1815cbd0 0x7f1d18158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1d18152f70 0x7f1d1815bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1cf806c920 0x7f1cf806ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 --2- 172.21.15.113:0/3708967416 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1d180c8870 0x7f1d181ee700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3708967416 >> 172.21.15.113:0/3708967416 conn(0x7f1d18074d50 msgr2=0x7f1d180c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3708967416 shutdown_connections 2024-04-22T06:32:31.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.460+0000 7f1d1eb38640 1 -- 172.21.15.113:0/3708967416 wait complete. 2024-04-22T06:32:31.472 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-22T06:32:31.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.570+0000 7f3b11efd640 1 Processor -- start 2024-04-22T06:32:31.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.570+0000 7f3b11efd640 1 -- start start 2024-04-22T06:32:31.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b11efd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b0c1553a0 0x7f3b0c15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b11efd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3b0c0c9440 0x7f3b0c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b11efd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 0x7f3b0c0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b11efd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c15c0a0 con 0x7f3b0c1553a0 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b11efd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0c15efa0 con 0x7f3b0c0c9440 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b11efd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0c0c7970 con 0x7f3b0c0c8420 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b0c1553a0 0x7f3b0c15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b0c1553a0 0x7f3b0c15bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33564/0 (socket says 172.21.15.113:33564) 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0b7fe640 1 -- 172.21.15.113:0/1649370309 learned_addr learned my addr 172.21.15.113:0/1649370309 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0affd640 1 --2- 172.21.15.113:0/1649370309 >> v2:172.21.15.145:3300/0 conn(0x7f3b0c0c9440 0x7f3b0c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/1649370309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 0x7f3b0c0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0b7fe640 1 -- 172.21.15.113:0/1649370309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 msgr2=0x7f3b0c0c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/1649370309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 0x7f3b0c0c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0b7fe640 1 -- 172.21.15.113:0/1649370309 >> v2:172.21.15.145:3300/0 conn(0x7f3b0c0c9440 msgr2=0x7f3b0c06d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/1649370309 >> v2:172.21.15.145:3300/0 conn(0x7f3b0c0c9440 0x7f3b0c06d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0b7fe640 1 -- 172.21.15.113:0/1649370309 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c0c9190 con 0x7f3b0c1553a0 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.571+0000 7f3b0affd640 1 --2- 172.21.15.113:0/1649370309 >> v2:172.21.15.145:3300/0 conn(0x7f3b0c0c9440 0x7f3b0c06d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.572+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/1649370309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c1553a0 0x7f3b0c15bb60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0c99d0 tx=0x7f3afc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b5b8cd981c6420 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.572+0000 7f3b0a7fc640 1 -- 172.21.15.113:0/1649370309 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc034070 con 0x7f3b0c1553a0 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.572+0000 7f3b0a7fc640 1 -- 172.21.15.113:0/1649370309 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc030860 con 0x7f3b0c1553a0 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.572+0000 7f3b0a7fc640 1 -- 172.21.15.113:0/1649370309 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc030c30 con 0x7f3b0c1553a0 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 -- 172.21.15.113:0/1649370309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c1553a0 msgr2=0x7f3b0c15bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1649370309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c1553a0 0x7f3b0c15bb60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0c99d0 tx=0x7f3afc02b9a0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 -- 172.21.15.113:0/1649370309 shutdown_connections 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1649370309 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 0x7f3b0c0c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1649370309 >> v2:172.21.15.145:3300/0 conn(0x7f3b0c0c9440 0x7f3b0c06d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1649370309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c1553a0 0x7f3b0c15bb60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 -- 172.21.15.113:0/1649370309 >> 172.21.15.113:0/1649370309 conn(0x7f3b0c0c9a70 msgr2=0x7f3b0c0c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 -- 172.21.15.113:0/1649370309 shutdown_connections 2024-04-22T06:32:31.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.573+0000 7f3b11efd640 1 -- 172.21.15.113:0/1649370309 wait complete. 2024-04-22T06:32:31.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.574+0000 7f3b11efd640 1 Processor -- start 2024-04-22T06:32:31.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.574+0000 7f3b11efd640 1 -- start start 2024-04-22T06:32:31.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b11efd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 0x7f3b0c1f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b11efd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c0c9440 0x7f3b0c1e7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b11efd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b0c1553a0 0x7f3b0c153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b11efd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c15e670 con 0x7f3b0c0c9440 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b11efd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c0c7f20 con 0x7f3b0c1553a0 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b11efd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0c15e950 con 0x7f3b0c0c8420 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c0c9440 0x7f3b0c1e7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c0c9440 0x7f3b0c1e7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33574/0 (socket says 172.21.15.113:33574) 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 -- 172.21.15.113:0/1434333405 learned_addr learned my addr 172.21.15.113:0/1434333405 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b0c1553a0 0x7f3b0c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 0x7f3b0c1f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 -- 172.21.15.113:0/1434333405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 msgr2=0x7f3b0c1f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 0x7f3b0c1f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 -- 172.21.15.113:0/1434333405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b0c1553a0 msgr2=0x7f3b0c153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b0c1553a0 0x7f3b0c153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 -- 172.21.15.113:0/1434333405 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c1f1ce0 con 0x7f3b0c0c9440 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b0affd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c0c9440 0x7f3b0c1e7c00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000e7e0 tx=0x7f3b0000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3af3fff640 1 -- 172.21.15.113:0/1434333405 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000f040 con 0x7f3b0c0c9440 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3af3fff640 1 -- 172.21.15.113:0/1434333405 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b00004030 con 0x7f3b0c0c9440 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3af3fff640 1 -- 172.21.15.113:0/1434333405 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00004400 con 0x7f3b0c0c9440 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.575+0000 7f3b11efd640 1 -- 172.21.15.113:0/1434333405 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0c1f1440 con 0x7f3b0c0c9440 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.576+0000 7f3b11efd640 1 -- 172.21.15.113:0/1434333405 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0c1f1a00 con 0x7f3b0c0c9440 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.577+0000 7f3af3fff640 1 -- 172.21.15.113:0/1434333405 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b0000c6d0 con 0x7f3b0c0c9440 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.577+0000 7f3af3fff640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3af806c8f0 0x7f3af806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.577+0000 7f3af3fff640 1 -- 172.21.15.113:0/1434333405 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3b0008bda0 con 0x7f3b0c0c9440 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.577+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3af806c8f0 0x7f3af806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.578+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3af806c8f0 0x7f3af806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3afc036000 tx=0x7f3afc03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.578+0000 7f3b14bc7740 1 Processor -- start 2024-04-22T06:32:31.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.578+0000 7f3b14bc7740 1 -- start start 2024-04-22T06:32:31.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 0x55e46bfaaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bf5eca0 0x55e46bf86ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x55e46bec5b10 con 0x55e46bf5eca0 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e46be63240 con 0x55e46bf62ec0 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55e46bec1ad0 con 0x55e46bfa1e40 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bf5eca0 0x55e46bf86ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bf5eca0 0x55e46bf86ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33584/0 (socket says 172.21.15.113:33584) 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b0bfff640 1 -- 172.21.15.113:0/4261185382 learned_addr learned my addr 172.21.15.113:0/4261185382 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 0x55e46bfaaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.579+0000 7f3b0affd640 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3b0bfff640 1 -- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 msgr2=0x55e46bfaaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 0x55e46bfaaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3b0bfff640 1 -- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 msgr2=0x55e46bfab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3b0bfff640 1 -- 172.21.15.113:0/4261185382 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e46bbd82d0 con 0x55e46bf5eca0 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3b0affd640 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bf5eca0 0x55e46bf86ee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b04007330 tx=0x7f3b040077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf398cab19ddf3b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3af17fa640 1 -- 172.21.15.113:0/4261185382 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b040147e0 con 0x55e46bf5eca0 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3af17fa640 1 -- 172.21.15.113:0/4261185382 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0401a070 con 0x55e46bf5eca0 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.580+0000 7f3af17fa640 1 -- 172.21.15.113:0/4261185382 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04014b80 con 0x55e46bf5eca0 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 -- 172.21.15.113:0/4261185382 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bf5eca0 msgr2=0x55e46bf86ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bf5eca0 0x55e46bf86ee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b04007330 tx=0x7f3b040077f0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 -- 172.21.15.113:0/4261185382 shutdown_connections 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bf5eca0 0x55e46bf86ee0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/4261185382 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 0x55e46bfaaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 -- 172.21.15.113:0/4261185382 >> 172.21.15.113:0/4261185382 conn(0x55e46bf5d990 msgr2=0x55e46bf60290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 -- 172.21.15.113:0/4261185382 shutdown_connections 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 -- 172.21.15.113:0/4261185382 wait complete. 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 -- start start 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.581+0000 7f3b14bc7740 1 Processor -- start 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bf62ec0 0x55e46bfa3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bfa1e40 0x55e46bfa95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfaa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x55e46bf61250 con 0x55e46bfa66c0 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e46be4e190 con 0x55e46bfa1e40 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55e46bf61530 con 0x55e46bf62ec0 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b14bc7740 10 client.0 _ll_register_callbacks cb 0x55e46be498b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfaa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfaa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33594/0 (socket says 172.21.15.113:33594) 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0bfff640 1 -- 172.21.15.113:0/353896518 learned_addr learned my addr 172.21.15.113:0/353896518 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0affd640 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bfa1e40 0x55e46bfa95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bf62ec0 0x55e46bfa3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0bfff640 1 -- 172.21.15.113:0/353896518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bf62ec0 msgr2=0x55e46bfa3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bf62ec0 0x55e46bfa3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0bfff640 1 -- 172.21.15.113:0/353896518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bfa1e40 msgr2=0x55e46bfa95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bfa1e40 0x55e46bfa95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.582+0000 7f3b0bfff640 1 -- 172.21.15.113:0/353896518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e46bca26b0 con 0x55e46bfa66c0 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfaa1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3b04007830 tx=0x7f3b04004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f029717ca1c9ef server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3aea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3aea7fc640 1 -- 172.21.15.113:0/353896518 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04014e60 con 0x55e46bfa66c0 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3aea7fc640 1 -- 172.21.15.113:0/353896518 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3b04015470 con 0x55e46bfa66c0 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 1 -- 172.21.15.113:0/353896518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b0401a070 con 0x55e46bfa66c0 2024-04-22T06:32:31.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3aea7fc640 1 -- 172.21.15.113:0/353896518 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3b04031050 con 0x55e46bfa66c0 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 10 client.5004 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 1 -- 172.21.15.113:0/353896518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55e46bf5bf10 con 0x55e46bfa66c0 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3aea7fc640 1 -- 172.21.15.113:0/353896518 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0401a070 con 0x55e46bfa66c0 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3aea7fc640 1 -- 172.21.15.113:0/353896518 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f3b04034020 con 0x55e46bfa66c0 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 10 client.5004 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 10 client.5004 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 20 client.5004 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55e46bf9b190 0x55e46bfc1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 4 client.5004 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b14bc7740 1 -- 172.21.15.113:0/353896518 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e46bed3530 con 0x55e46bf9b190 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.583+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55e46bf9b190 0x55e46bfc1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3aea7fc640 10 client.5004 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55e46bf9b190 0x55e46bfc1980 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a48b172abd1227c1 server_cookie=8d55e3ac4e5771e2 in_seq=0 out_seq=0 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3aea7fc640 1 -- 172.21.15.113:0/353896518 <== mds.0 v2:172.21.15.113:6837/4160787448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e46bed3530 con 0x55e46bf9b190 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3aea7fc640 10 client.5004 handle_command_reply: tid=0 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 client.5004 shutdown 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 -- 172.21.15.113:0/353896518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 msgr2=0x55e46bfaa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfaa1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3b04007830 tx=0x7f3b04004ab0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 -- 172.21.15.113:0/353896518 shutdown_connections 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55e46bf9b190 0x55e46bfc1980 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfaa1a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bfa1e40 0x55e46bfa95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3aea7fc640 0 client.5004 ms_handle_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/353896518 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bf62ec0 0x55e46bfa3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 -- 172.21.15.113:0/353896518 >> 172.21.15.113:0/353896518 conn(0x55e46bf5eca0 msgr2=0x55e46bfaaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 -- 172.21.15.113:0/353896518 shutdown_connections 2024-04-22T06:32:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.584+0000 7f3b14bc7740 1 -- 172.21.15.113:0/353896518 wait complete. 2024-04-22T06:32:31.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.585+0000 7f3b14bc7740 20 client.5004 trim_cache size 0 max 16384 2024-04-22T06:32:31.601 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.602+0000 7f3b14bc7740 1 Processor -- start 2024-04-22T06:32:31.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.602+0000 7f3b14bc7740 1 -- start start 2024-04-22T06:32:31.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfa2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa1e40 0x55e46bfa2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa66c0 0x55e46bfa8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c1fd170 con 0x55e46bfa1e40 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e46bfa6b40 con 0x55e46bf62ec0 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55e46bfa6da0 con 0x55e46bfa66c0 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b0affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa1e40 0x55e46bfa2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b0affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa1e40 0x55e46bfa2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33604/0 (socket says 172.21.15.113:33604) 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.603+0000 7f3b0affd640 1 -- 172.21.15.113:0/3761285523 learned_addr learned my addr 172.21.15.113:0/3761285523 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa66c0 0x55e46bfa8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfa2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b0affd640 1 -- 172.21.15.113:0/3761285523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa66c0 msgr2=0x55e46bfa8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b0affd640 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa66c0 0x55e46bfa8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b0affd640 1 -- 172.21.15.113:0/3761285523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 msgr2=0x55e46bfa2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b0affd640 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfa2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b0affd640 1 -- 172.21.15.113:0/3761285523 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e46bf5dd80 con 0x55e46bfa1e40 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b0affd640 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa1e40 0x55e46bfa2cb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000efd0 tx=0x7f3b00059540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febc87a49bec7c21 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3af0ff9640 1 -- 172.21.15.113:0/3761285523 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00020040 con 0x55e46bfa1e40 2024-04-22T06:32:31.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3af0ff9640 1 -- 172.21.15.113:0/3761285523 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b00057940 con 0x55e46bfa1e40 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3af0ff9640 1 -- 172.21.15.113:0/3761285523 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00058a90 con 0x55e46bfa1e40 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b14bc7740 1 -- 172.21.15.113:0/3761285523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa1e40 msgr2=0x55e46bfa2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.604+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa1e40 0x55e46bfa2cb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000efd0 tx=0x7f3b00059540 comp rx=0 tx=0).stop 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 -- 172.21.15.113:0/3761285523 shutdown_connections 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa66c0 0x55e46bfa8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa1e40 0x55e46bfa2cb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/3761285523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bfa2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 -- 172.21.15.113:0/3761285523 >> 172.21.15.113:0/3761285523 conn(0x55e46bf5eca0 msgr2=0x55e46bfa9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 -- 172.21.15.113:0/3761285523 shutdown_connections 2024-04-22T06:32:31.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 -- 172.21.15.113:0/3761285523 wait complete. 2024-04-22T06:32:31.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 -- start start 2024-04-22T06:32:31.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.605+0000 7f3b14bc7740 1 Processor -- start 2024-04-22T06:32:31.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bf7c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 0x55e46bfa8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b14bc7740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfa7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x55e46bfb6d50 con 0x55e46bfa66c0 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e46bfb6700 con 0x55e46bf62ec0 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b14bc7740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55e46bf9b650 con 0x55e46bfa1e40 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b14bc7740 10 client.0 _ll_register_callbacks cb 0x7f3b04009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfa7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfa7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33606/0 (socket says 172.21.15.113:33606) 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 -- 172.21.15.113:0/873306859 learned_addr learned my addr 172.21.15.113:0/873306859 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0affd640 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 0x55e46bfa8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bf7c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 -- 172.21.15.113:0/873306859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 msgr2=0x55e46bfa8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 0x55e46bfa8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 -- 172.21.15.113:0/873306859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 msgr2=0x55e46bf7c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bf7c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 -- 172.21.15.113:0/873306859 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e46bf9f890 con 0x55e46bfa66c0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b0bfff640 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfa7180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3b04000f80 tx=0x7f3b0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316a4ef72f23ee62 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3aea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3aea7fc640 1 -- 172.21.15.113:0/873306859 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b040147f0 con 0x55e46bfa66c0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3aea7fc640 1 -- 172.21.15.113:0/873306859 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3b040159e0 con 0x55e46bfa66c0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.606+0000 7f3b14bc7740 1 -- 172.21.15.113:0/873306859 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b00057940 con 0x55e46bfa66c0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3aea7fc640 1 -- 172.21.15.113:0/873306859 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3b04015be0 con 0x55e46bfa66c0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 10 client.5010 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 1 -- 172.21.15.113:0/873306859 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55e46bf9e650 con 0x55e46bfa66c0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3aea7fc640 1 -- 172.21.15.113:0/873306859 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b00057940 con 0x55e46bfa66c0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3aea7fc640 1 -- 172.21.15.113:0/873306859 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f3b04034070 con 0x55e46bfa66c0 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 10 client.5010 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 10 client.5010 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-22T06:32:31.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 20 client.5010 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55e46c020c00 0x55e46c020fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 4 client.5010 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 1 -- 172.21.15.113:0/873306859 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "status"}) -- 0x55e46becd3a0 con 0x55e46c020c00 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55e46c020c00 0x55e46c020fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b0b7fe640 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55e46c020c00 0x55e46c020fe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8385f2250fa34026 server_cookie=f0637a93e47ef37f in_seq=0 out_seq=0 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3aea7fc640 10 client.5010 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3aea7fc640 1 -- 172.21.15.113:0/873306859 <== mds.0 v2:172.21.15.113:6837/4160787448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55e46becd3a0 con 0x55e46c020c00 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3aea7fc640 10 client.5010 handle_command_reply: tid=0 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.607+0000 7f3b14bc7740 1 client.5010 shutdown 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 -- 172.21.15.113:0/873306859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 msgr2=0x55e46bfa7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfa7180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3b04000f80 tx=0x7f3b0400b040 comp rx=0 tx=0).stop 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 -- 172.21.15.113:0/873306859 shutdown_connections 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55e46c020c00 0x55e46c020fe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55e46bfa66c0 0x55e46bfa7180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55e46bfa1e40 0x55e46bfa8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3aea7fc640 0 client.5010 ms_handle_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 --2- 172.21.15.113:0/873306859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e46bf62ec0 0x55e46bf7c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 -- 172.21.15.113:0/873306859 >> 172.21.15.113:0/873306859 conn(0x55e46bf5eca0 msgr2=0x55e46bf81f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 -- 172.21.15.113:0/873306859 shutdown_connections 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 1 -- 172.21.15.113:0/873306859 wait complete. 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b14bc7740 20 client.5010 trim_cache size 0 max 16384 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:31.615 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4311, 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 53.781416528000001, 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 61.000470565000001 2024-04-22T06:32:31.616 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:31.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 -- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3af806c8f0 msgr2=0x7f3af806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3af806c8f0 0x7f3af806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3afc036000 tx=0x7f3afc03b040 comp rx=0 tx=0).stop 2024-04-22T06:32:31.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 -- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c0c9440 msgr2=0x7f3b0c1e7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c0c9440 0x7f3b0c1e7c00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000e7e0 tx=0x7f3b0000eca0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 -- 172.21.15.113:0/1434333405 shutdown_connections 2024-04-22T06:32:31.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b0c1553a0 0x7f3b0c153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3af806c8f0 0x7f3af806edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b0c0c9440 0x7f3b0c1e7c00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 --2- 172.21.15.113:0/1434333405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b0c0c8420 0x7f3b0c1f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 -- 172.21.15.113:0/1434333405 >> 172.21.15.113:0/1434333405 conn(0x7f3b0c0c9a70 msgr2=0x7f3b0c0b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 -- 172.21.15.113:0/1434333405 shutdown_connections 2024-04-22T06:32:31.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.608+0000 7f3b11efd640 1 -- 172.21.15.113:0/1434333405 wait complete. 2024-04-22T06:32:31.619 INFO:teuthology.run_tasks:Running task sequential... 2024-04-22T06:32:31.629 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-22T06:32:31.629 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-22T06:32:31.630 INFO:teuthology.task.print:Enabling mgr modules 2024-04-22T06:32:31.630 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-22T06:32:31.640 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-22T06:32:31.640 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-22T06:32:31.640 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-22T06:32:31.640 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-22T06:32:31.640 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:31.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:31.641 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-04-22T06:32:31.656 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-22T06:32:31.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:31.656 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-22T06:32:31.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:31.719 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2024-04-22T06:32:31.810 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-22T06:32:31.811 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-22T06:32:31.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.909+0000 7f3de5385640 1 Processor -- start 2024-04-22T06:32:31.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.909+0000 7f3de5385640 1 -- start start 2024-04-22T06:32:31.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.909+0000 7f3de5385640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3de00b3c00 0x7f3de00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.909+0000 7f3de5385640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de01558c0 con 0x7f3de01554e0 2024-04-22T06:32:31.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.909+0000 7f3de5385640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de00cb8c0 con 0x7f3de00b5450 2024-04-22T06:32:31.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.909+0000 7f3de5385640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f3de00b4a80 con 0x7f3de00b3c00 2024-04-22T06:32:31.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.909+0000 7f3ddeffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3de01554e0 0x7f3de015f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45006/0 (socket says 172.21.15.113:45006) 2024-04-22T06:32:31.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.910+0000 7f3ddeffd640 1 -- 172.21.15.113:0/4097697632 learned_addr learned my addr 172.21.15.113:0/4097697632 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:31.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.910+0000 7f3dde7fc640 1 --2- 172.21.15.113:0/4097697632 >> v2:172.21.15.145:3300/0 conn(0x7f3de00b3c00 0x7f3de00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.910+0000 7f3dddffb640 1 -- 172.21.15.113:0/4097697632 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673249521 0 0) 0x7f3dd4001110 con 0x7f3de01554e0 2024-04-22T06:32:31.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.910+0000 7f3dddffb640 1 -- 172.21.15.113:0/4097697632 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dc8003520 con 0x7f3de01554e0 2024-04-22T06:32:31.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.910+0000 7f3dde7fc640 1 -- 172.21.15.113:0/4097697632 >> v1:172.21.15.145:6789/0 conn(0x7f3de00b5450 legacy=0x7f3de00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.910+0000 7f3dde7fc640 1 -- 172.21.15.113:0/4097697632 >> v1:172.21.15.113:6789/0 conn(0x7f3de01554e0 legacy=0x7f3de015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.910+0000 7f3dde7fc640 1 -- 172.21.15.113:0/4097697632 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de00cbba0 con 0x7f3de00b3c00 2024-04-22T06:32:31.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3dde7fc640 1 --2- 172.21.15.113:0/4097697632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b3c00 0x7f3de00b4f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00097a0 tx=0x7f3dd002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cfdcbe540b5cd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3dddffb640 1 -- 172.21.15.113:0/4097697632 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd002f810 con 0x7f3de00b3c00 2024-04-22T06:32:31.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3dddffb640 1 -- 172.21.15.113:0/4097697632 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd002f9b0 con 0x7f3de00b3c00 2024-04-22T06:32:31.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3dddffb640 1 -- 172.21.15.113:0/4097697632 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd002fd60 con 0x7f3de00b3c00 2024-04-22T06:32:31.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3de5385640 1 -- 172.21.15.113:0/4097697632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b3c00 msgr2=0x7f3de00b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3de5385640 1 --2- 172.21.15.113:0/4097697632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b3c00 0x7f3de00b4f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00097a0 tx=0x7f3dd002b9f0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3de5385640 1 -- 172.21.15.113:0/4097697632 shutdown_connections 2024-04-22T06:32:31.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3de5385640 1 --2- 172.21.15.113:0/4097697632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b3c00 0x7f3de00b4f10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3de5385640 1 -- 172.21.15.113:0/4097697632 >> 172.21.15.113:0/4097697632 conn(0x7f3de0074d50 msgr2=0x7f3de0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:31.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3de5385640 1 -- 172.21.15.113:0/4097697632 shutdown_connections 2024-04-22T06:32:31.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.911+0000 7f3de5385640 1 -- 172.21.15.113:0/4097697632 wait complete. 2024-04-22T06:32:31.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.913+0000 7f3de5385640 1 Processor -- start 2024-04-22T06:32:31.913 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.913+0000 7f3de5385640 1 -- start start 2024-04-22T06:32:31.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3de5385640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de00b3c00 0x7f3de01f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3de5385640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b5450 0x7f3de014ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3de5385640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3de01554e0 0x7f3de01f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3de5385640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3de00b4710 con 0x7f3de01554e0 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3de5385640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3de00b4430 con 0x7f3de00b5450 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3de5385640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00b3580 con 0x7f3de00b3c00 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3de01554e0 0x7f3de01f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddeffd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de00b3c00 0x7f3de01f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3de01554e0 0x7f3de01f2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33610/0 (socket says 172.21.15.113:33610) 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 -- 172.21.15.113:0/2520128234 learned_addr learned my addr 172.21.15.113:0/2520128234 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3dde7fc640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b5450 0x7f3de014ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 -- 172.21.15.113:0/2520128234 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de00b3c00 msgr2=0x7f3de01f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de00b3c00 0x7f3de01f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 -- 172.21.15.113:0/2520128234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b5450 msgr2=0x7f3de014ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:31.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b5450 0x7f3de014ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 -- 172.21.15.113:0/2520128234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de01e3830 con 0x7f3de01554e0 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddeffd640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de00b3c00 0x7f3de01f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.914+0000 7f3ddf7fe640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3de01554e0 0x7f3de01f2350 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c7d0 tx=0x7f3dd800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.915+0000 7f3dc77fe640 1 -- 172.21.15.113:0/2520128234 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8003b70 con 0x7f3de01554e0 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.915+0000 7f3dc77fe640 1 -- 172.21.15.113:0/2520128234 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd8003d30 con 0x7f3de01554e0 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.915+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de01e24d0 con 0x7f3de01554e0 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.915+0000 7f3dc77fe640 1 -- 172.21.15.113:0/2520128234 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd800aa90 con 0x7f3de01554e0 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.915+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de01e2790 con 0x7f3de01554e0 2024-04-22T06:32:31.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.915+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de0068e40 con 0x7f3de01554e0 2024-04-22T06:32:31.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.916+0000 7f3dc77fe640 1 -- 172.21.15.113:0/2520128234 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dd800ac30 con 0x7f3de01554e0 2024-04-22T06:32:31.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.916+0000 7f3dc77fe640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:31.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.916+0000 7f3dc77fe640 1 -- 172.21.15.113:0/2520128234 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3dd808bcc0 con 0x7f3de01554e0 2024-04-22T06:32:31.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.916+0000 7f3ddeffd640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:31.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.917+0000 7f3ddeffd640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40012b0 tx=0x7f3dd4007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:31.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:31.921+0000 7f3dc77fe640 1 -- 172.21.15.113:0/2520128234 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3dd8059730 con 0x7f3de01554e0 2024-04-22T06:32:32.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.134+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3de0154340 con 0x7f3de01554e0 2024-04-22T06:32:32.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.135+0000 7f3dc77fe640 1 -- 172.21.15.113:0/2520128234 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f3dd805da30 con 0x7f3de01554e0 2024-04-22T06:32:32.134 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-22T06:32:32.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.136+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3dcc06c8f0 msgr2=0x7f3dcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:32.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.136+0000 7f3de5385640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40012b0 tx=0x7f3dd4007b70 comp rx=0 tx=0).stop 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.136+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3de01554e0 msgr2=0x7f3de01f2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.136+0000 7f3de5385640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3de01554e0 0x7f3de01f2350 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c7d0 tx=0x7f3dd800cc90 comp rx=0 tx=0).stop 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.137+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 shutdown_connections 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.137+0000 7f3de5385640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.137+0000 7f3de5385640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3de01554e0 0x7f3de01f2350 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.137+0000 7f3de5385640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3de00b5450 0x7f3de014ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.137+0000 7f3de5385640 1 --2- 172.21.15.113:0/2520128234 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3de00b3c00 0x7f3de01f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.137+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 >> 172.21.15.113:0/2520128234 conn(0x7f3de0074d50 msgr2=0x7f3de00cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.137+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 shutdown_connections 2024-04-22T06:32:32.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32.137+0000 7f3de5385640 1 -- 172.21.15.113:0/2520128234 wait complete. 2024-04-22T06:32:32.147 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-22T06:32:32.147 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-22T06:32:32.147 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2024-04-22T06:32:32.147 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-22T06:32:32.147 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:32.147 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-22T06:32:32.147 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-22T06:32:32.147 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-22T06:32:32.148 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-22T06:32:32.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:32.148 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2024-04-22T06:32:32.163 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2024-04-22T06:32:32.164 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T06:32:32.164 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2024-04-22T06:32:32.164 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-22T06:32:32.164 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2024-04-22T06:32:32.164 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-22T06:32:32.164 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42688sec preferred_lft 42688sec 2024-04-22T06:32:32.164 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ddaa:4484:eadd:6c8b/64 scope link noprefixroute 2024-04-22T06:32:32.164 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-04-22T06:32:32.164 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-22T06:32:32.164 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:32:32.165 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:32:32.165 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add name ceph-brx type bridge 2024-04-22T06:32:32.165 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr flush dev ceph-brx 2024-04-22T06:32:32.165 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set ceph-brx up 2024-04-22T06:32:32.165 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-22T06:32:32.165 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:32:32.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:32:32.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:32:32.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:32.298 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-22T06:32:32.320 INFO:teuthology.orchestra.run.smithi113.stdout:1 2024-04-22T06:32:32.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:32.321 DEBUG:teuthology.orchestra.run.smithi113:> route 2024-04-22T06:32:32.377 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2024-04-22T06:32:32.378 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-22T06:32:32.378 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-22T06:32:32.378 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-22T06:32:32.378 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-22T06:32:32.378 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:32:32.378 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:32:32.378 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-22T06:32:32.378 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-22T06:32:32.378 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-22T06:32:32.378 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:32:32.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:32:32.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:32:32.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:32.501 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-04-22T06:32:32.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:32.516 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list-id 2024-04-22T06:32:32.570 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:32:32.571 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:32:32.571 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T06:32:32.571 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-22T06:32:32.571 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:32:32.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:32:32.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:32:32.686 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-22T06:32:32.686 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:32:32.686 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:32:32.686 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-22T06:32:32.686 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-22T06:32:32.686 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-22T06:32:32.686 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-22T06:32:32.686 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-22T06:32:32.686 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:32:32.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:32:32.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:32:32.793 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T06:32:32.793 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-04-22T06:32:32.794 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2024-04-22T06:32:32.794 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set dev brx.0 master ceph-brx 2024-04-22T06:32:32.794 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-04-22T06:32:32.842 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T06:32:32.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:32:32.868 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-22T06:32:32.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-22T06:32:32.868 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:32.893 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-22T06:32:32.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-22T06:32:32.893 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:32.948 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2024-04-22T06:32:33.012 DEBUG:teuthology.orchestra.run.smithi113:> cat /proc/self/mounts | awk '{print $2}' 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/proc 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/sys 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/dev 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/security 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/shm 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/pts 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/run 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/cgroup 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/pstore 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/bpf 2024-04-22T06:32:33.068 INFO:teuthology.orchestra.run.smithi113.stdout:/ 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/selinux 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/proc/sys/fs/binfmt_misc 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/hugepages 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/mqueue 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/debug 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/tracing 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-sysusers.service 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/config 2024-04-22T06:32:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/fuse/connections 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-sysctl.service 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/nfs/rpc_pipefs 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/run/user/1000 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-0 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-1 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-2 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-3 2024-04-22T06:32:33.070 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns 2024-04-22T06:32:33.071 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T06:32:33.071 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T06:32:33.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:33.072 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2024-04-22T06:32:33.126 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-22T06:32:33.126 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-22T06:32:33.168 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2024-04-22T06:32:33.191 DEBUG:teuthology.orchestra.run.smithi113:> cat /proc/self/mounts | awk '{print $2}' 2024-04-22T06:32:33.246 INFO:teuthology.orchestra.run.smithi113.stdout:/proc 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/sys 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/dev 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/security 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/shm 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/pts 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/run 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/cgroup 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/pstore 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/bpf 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/ 2024-04-22T06:32:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/selinux 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/proc/sys/fs/binfmt_misc 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/hugepages 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/dev/mqueue 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/debug 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/tracing 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-sysusers.service 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/kernel/config 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/sys/fs/fuse/connections 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-sysctl.service 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/nfs/rpc_pipefs 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/run/user/1000 2024-04-22T06:32:33.248 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph 2024-04-22T06:32:33.249 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-0 2024-04-22T06:32:33.249 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-1 2024-04-22T06:32:33.249 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-2 2024-04-22T06:32:33.249 INFO:teuthology.orchestra.run.smithi113.stdout:/var/lib/ceph/osd/ceph-3 2024-04-22T06:32:33.249 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns 2024-04-22T06:32:33.249 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T06:32:33.249 INFO:teuthology.orchestra.run.smithi113.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T06:32:33.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:33.250 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2024-04-22T06:32:33.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi113.stderr:2024-04-22T06:32:33.248+0000 7f7dd960b480 -1 init, newargv = 0x55b93f11c5b0 newargc=15 2024-04-22T06:32:33.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi113.stderr:ceph-fuse[45128]: starting ceph client 2024-04-22T06:32:33.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi113.stderr:ceph-fuse[45128]: starting fuse 2024-04-22T06:32:33.273 INFO:teuthology.orchestra.run.smithi113.stdout:43 2024-04-22T06:32:33.273 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-22T06:32:33.273 DEBUG:teuthology.orchestra.run.smithi113:> sudo stdin-killer -- python3 -c ' 2024-04-22T06:32:33.273 DEBUG:teuthology.orchestra.run.smithi113:> import glob 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> import re 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> import os 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> import subprocess 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> def _find_admin_socket(client_name): 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> files = glob.glob(asok_path) 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> # Given a non-glob path, it better be there 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> if "*" not in asok_path: 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> assert(len(files) == 1) 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> return files[0] 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> 2024-04-22T06:32:33.274 DEBUG:teuthology.orchestra.run.smithi113:> for f in files: 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> contents = proc_f.read() 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> if mountpoint in contents: 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> return f 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> print(_find_admin_socket("client.0")) 2024-04-22T06:32:33.275 DEBUG:teuthology.orchestra.run.smithi113:> ' 2024-04-22T06:32:33.389 INFO:teuthology.orchestra.run.smithi113.stdout:/var/run/ceph/ceph-client.0.45128.asok 2024-04-22T06:32:33.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T06:32:33.400 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45128.asok 2024-04-22T06:32:33.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:33.400 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45128.asok status 2024-04-22T06:32:33.531 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:33.532 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": { 2024-04-22T06:32:33.532 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_sha1": "86f7587a5a09af35f0895e1a2d08527638fae697", 2024-04-22T06:32:33.532 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_version": "ceph version 19.0.0-3156-g86f7587a (86f7587a5a09af35f0895e1a2d08527638fae697) squid (dev)", 2024-04-22T06:32:33.532 INFO:teuthology.orchestra.run.smithi113.stdout: "entity_id": "0", 2024-04-22T06:32:33.532 INFO:teuthology.orchestra.run.smithi113.stdout: "hostname": "smithi113", 2024-04-22T06:32:33.532 INFO:teuthology.orchestra.run.smithi113.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "pid": "45128", 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "root": "/" 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "dentry_count": 0, 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "dentry_pinned_count": 0, 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 5025, 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "inst": { 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "name": { 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "client", 2024-04-22T06:32:33.533 INFO:teuthology.orchestra.run.smithi113.stdout: "num": 5025 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": { 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "192.168.0.1:0", 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 984123522 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": { 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2024-04-22T06:32:33.534 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "192.168.0.1:0", 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 984123522 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: "inst_str": "client.5025 192.168.0.1:0/984123522", 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: "addr_str": "192.168.0.1:0/984123522", 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: "inode_count": 1, 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: "mds_epoch": 17, 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_epoch": 26, 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_epoch_barrier": 0, 2024-04-22T06:32:33.535 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklisted": false, 2024-04-22T06:32:33.536 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs" 2024-04-22T06:32:33.536 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:33.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:33.540 DEBUG:teuthology.orchestra.run.smithi113:> stat --file-system '--printf=%T 2024-04-22T06:32:33.541 DEBUG:teuthology.orchestra.run.smithi113:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:33.555 INFO:teuthology.orchestra.run.smithi113.stdout:fuseblk 2024-04-22T06:32:33.556 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:33.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:32:33.556 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:33.619 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-22T06:32:33.631 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:33.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.756+0000 7f44a1ac1640 1 Processor -- start 2024-04-22T06:32:33.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.756+0000 7f44a1ac1640 1 -- start start 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f44a1ac1640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f449c155230 0x7f449c071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f44a1ac1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449c06d540 con 0x7f449c15b030 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f44a1ac1640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449c15b4c0 con 0x7f449c0cb330 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f44a1ac1640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f449c0c9a80 con 0x7f449c155230 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f449c15b030 0x7f449c15ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45016/0 (socket says 172.21.15.113:45016) 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449affd640 1 -- 172.21.15.113:0/3147324393 learned_addr learned my addr 172.21.15.113:0/3147324393 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767436854 0 0) 0x7f449c06d540 con 0x7f449c15b030 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4488003520 con 0x7f449c15b030 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449b7fe640 1 --2- 172.21.15.113:0/3147324393 >> v2:172.21.15.145:3300/0 conn(0x7f449c155230 0x7f449c071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 696300326 0 0) 0x7f4488003520 con 0x7f449c15b030 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 >> v2:172.21.15.145:3300/0 conn(0x7f449c155230 msgr2=0x7f449c071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:33.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 --2- 172.21.15.113:0/3147324393 >> v2:172.21.15.145:3300/0 conn(0x7f449c155230 0x7f449c071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 >> v1:172.21.15.145:6789/0 conn(0x7f449c0cb330 legacy=0x7f449c1659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c15b7a0 con 0x7f449c15b030 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f4484001670 con 0x7f449c15b030 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 >> v1:172.21.15.113:6789/0 conn(0x7f449c15b030 legacy=0x7f449c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f4488003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4488004800 0x7f4488004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44880051c0 0x7f448800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f448800c030 con 0x7f4488004800 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f448800c1e0 con 0x7f44880039b0 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.757+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f448800c3e0 con 0x7f44880051c0 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449affd640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4488004800 0x7f4488004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449b7fe640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f4488003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:33.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449bfff640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44880051c0 0x7f448800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449b7fe640 1 -- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44880051c0 msgr2=0x7f448800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449b7fe640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f44880051c0 0x7f448800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449b7fe640 1 -- 172.21.15.113:0/3147324393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4488004800 msgr2=0x7f4488004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449b7fe640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4488004800 0x7f4488004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449b7fe640 1 -- 172.21.15.113:0/3147324393 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4488003520 con 0x7f44880039b0 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449bfff640 1 -- 172.21.15.113:0/3147324393 reap_dead start 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.758+0000 7f449affd640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4488004800 0x7f4488004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f449b7fe640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f4488003dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f448c009ac0 tx=0x7f4488005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e02ca7cda6e48a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c039070 con 0x7f44880039b0 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c02c6b0 con 0x7f44880039b0 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f449a7fc640 1 -- 172.21.15.113:0/3147324393 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c009690 con 0x7f44880039b0 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f44a1ac1640 1 -- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 msgr2=0x7f4488003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f44a1ac1640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f4488003dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f448c009ac0 tx=0x7f4488005830 comp rx=0 tx=0).stop 2024-04-22T06:32:33.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f44a1ac1640 1 -- 172.21.15.113:0/3147324393 shutdown_connections 2024-04-22T06:32:33.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f44a1ac1640 1 --2- 172.21.15.113:0/3147324393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f4488003dd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f44a1ac1640 1 -- 172.21.15.113:0/3147324393 >> 172.21.15.113:0/3147324393 conn(0x7f449c074f30 msgr2=0x7f449c075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:33.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f44a1ac1640 1 -- 172.21.15.113:0/3147324393 shutdown_connections 2024-04-22T06:32:33.762 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.759+0000 7f44a1ac1640 1 -- 172.21.15.113:0/3147324393 wait complete. 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.760+0000 7f44a1ac1640 1 Processor -- start 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f44a1ac1640 1 -- start start 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f44a1ac1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f449c1f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f44a1ac1640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f449c156290 0x7f449c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f44a1ac1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f449c158460 0x7f449c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f44a1ac1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f449c15e7c0 con 0x7f449c158460 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f44a1ac1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f449c15bd60 con 0x7f44880039b0 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f44a1ac1640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f449c155610 con 0x7f449c156290 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f449bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f449c158460 0x7f449c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f449bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f449c158460 0x7f449c156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33634/0 (socket says 172.21.15.113:33634) 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.761+0000 7f449bfff640 1 -- 172.21.15.113:0/1628300308 learned_addr learned my addr 172.21.15.113:0/1628300308 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f449affd640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f449c156290 0x7f449c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:33.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f449b7fe640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f449c1f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f449bfff640 1 -- 172.21.15.113:0/1628300308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f449c156290 msgr2=0x7f449c0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f449bfff640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f449c156290 0x7f449c0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f449bfff640 1 -- 172.21.15.113:0/1628300308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 msgr2=0x7f449c1f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f449bfff640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f449c1f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f449bfff640 1 -- 172.21.15.113:0/1628300308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c151210 con 0x7f449c158460 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f449bfff640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f449c158460 0x7f449c156d40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f449c06ce00 tx=0x7f449400fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f4493fff640 1 -- 172.21.15.113:0/1628300308 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494003970 con 0x7f449c158460 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f4493fff640 1 -- 172.21.15.113:0/1628300308 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4494018070 con 0x7f449c158460 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c1514f0 con 0x7f449c158460 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f4493fff640 1 -- 172.21.15.113:0/1628300308 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494003d70 con 0x7f449c158460 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.762+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c157f60 con 0x7f449c158460 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.763+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449c068e40 con 0x7f449c158460 2024-04-22T06:32:33.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.763+0000 7f4493fff640 1 -- 172.21.15.113:0/1628300308 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f44940050d0 con 0x7f449c158460 2024-04-22T06:32:33.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.764+0000 7f4493fff640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f447c06c920 0x7f447c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:33.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.764+0000 7f4493fff640 1 -- 172.21.15.113:0/1628300308 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f449408bac0 con 0x7f449c158460 2024-04-22T06:32:33.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.764+0000 7f449b7fe640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f447c06c920 0x7f447c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:33.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.764+0000 7f449b7fe640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f447c06c920 0x7f447c06ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f448c036000 tx=0x7f448c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:33.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.768+0000 7f4493fff640 1 -- 172.21.15.113:0/1628300308 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4494059af0 con 0x7f449c158460 2024-04-22T06:32:33.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.949+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f449c06d180 con 0x7f449c158460 2024-04-22T06:32:33.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.951+0000 7f4493fff640 1 -- 172.21.15.113:0/1628300308 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f44940593f0 con 0x7f449c158460 2024-04-22T06:32:33.950 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:33.950 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:33.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.952+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f447c06c920 msgr2=0x7f447c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:33.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.952+0000 7f44a1ac1640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f447c06c920 0x7f447c06ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f448c036000 tx=0x7f448c030000 comp rx=0 tx=0).stop 2024-04-22T06:32:33.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.952+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f449c158460 msgr2=0x7f449c156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:33.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.952+0000 7f44a1ac1640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f449c158460 0x7f449c156d40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f449c06ce00 tx=0x7f449400fb40 comp rx=0 tx=0).stop 2024-04-22T06:32:33.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.953+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 shutdown_connections 2024-04-22T06:32:33.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.953+0000 7f44a1ac1640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f447c06c920 0x7f447c06ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.953+0000 7f44a1ac1640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f449c158460 0x7f449c156d40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.953+0000 7f44a1ac1640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f449c156290 0x7f449c0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.953+0000 7f44a1ac1640 1 --2- 172.21.15.113:0/1628300308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44880039b0 0x7f449c1f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:33.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.953+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 >> 172.21.15.113:0/1628300308 conn(0x7f449c074f30 msgr2=0x7f449c0676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:33.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.953+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 shutdown_connections 2024-04-22T06:32:33.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:33.953+0000 7f44a1ac1640 1 -- 172.21.15.113:0/1628300308 wait complete. 2024-04-22T06:32:33.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:32:33.963 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:32:34.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.064+0000 7f2f15e43640 1 Processor -- start 2024-04-22T06:32:34.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.064+0000 7f2f15e43640 1 -- start start 2024-04-22T06:32:34.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f15e43640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100ca3a0 0x7f2f100c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f15e43640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2f100c8950 0x7f2f1015b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f15e43640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f100c41b0 con 0x7f2f100c8ea0 2024-04-22T06:32:34.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f15e43640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f2f1015b850 con 0x7f2f100c8950 2024-04-22T06:32:34.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f15e43640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2f100c2ac0 con 0x7f2f100ca3a0 2024-04-22T06:32:34.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f0effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100ca3a0 0x7f2f100c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f0ffff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2f100c8950 0x7f2f1015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f0f7fe640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f2f100c8ea0 0x7f2f100c81f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:48036/0 (socket says 172.21.15.113:48036) 2024-04-22T06:32:34.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f0effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100ca3a0 0x7f2f100c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:42406/0 (socket says 172.21.15.113:42406) 2024-04-22T06:32:34.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f0ffff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2f100c8950 0x7f2f1015b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:36610/0 (socket says 172.21.15.113:36610) 2024-04-22T06:32:34.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.065+0000 7f2f0f7fe640 1 -- 172.21.15.113:0/999210091 learned_addr learned my addr 172.21.15.113:0/999210091 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:34.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.066+0000 7f2f0effd640 1 -- 172.21.15.113:0/999210091 >> v2:172.21.15.145:3300/0 conn(0x7f2f100c8950 msgr2=0x7f2f1015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:34.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.066+0000 7f2f0effd640 1 --2- 172.21.15.113:0/999210091 >> v2:172.21.15.145:3300/0 conn(0x7f2f100c8950 0x7f2f1015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.066+0000 7f2f0effd640 1 -- 172.21.15.113:0/999210091 >> v1:172.21.15.145:6789/0 conn(0x7f2f100c8ea0 legacy=0x7f2f100c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.066+0000 7f2f0effd640 1 -- 172.21.15.113:0/999210091 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f100b2380 con 0x7f2f100ca3a0 2024-04-22T06:32:34.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.066+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/999210091 >> v2:172.21.15.145:3300/0 conn(0x7f2f100c8950 0x7f2f1015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:34.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f0effd640 1 --2- 172.21.15.113:0/999210091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100ca3a0 0x7f2f100c9280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097a0 tx=0x7f2f0402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db61357a287a966e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f0e7fc640 1 -- 172.21.15.113:0/999210091 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04035020 con 0x7f2f100ca3a0 2024-04-22T06:32:34.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f0e7fc640 1 -- 172.21.15.113:0/999210091 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f04031830 con 0x7f2f100ca3a0 2024-04-22T06:32:34.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f0e7fc640 1 -- 172.21.15.113:0/999210091 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04031c00 con 0x7f2f100ca3a0 2024-04-22T06:32:34.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f15e43640 1 -- 172.21.15.113:0/999210091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100ca3a0 msgr2=0x7f2f100c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f15e43640 1 --2- 172.21.15.113:0/999210091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100ca3a0 0x7f2f100c9280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097a0 tx=0x7f2f0402b8d0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f15e43640 1 -- 172.21.15.113:0/999210091 shutdown_connections 2024-04-22T06:32:34.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f15e43640 1 --2- 172.21.15.113:0/999210091 >> v2:172.21.15.145:3300/0 conn(0x7f2f100c8950 0x7f2f1015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f15e43640 1 --2- 172.21.15.113:0/999210091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100ca3a0 0x7f2f100c9280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f15e43640 1 -- 172.21.15.113:0/999210091 >> 172.21.15.113:0/999210091 conn(0x7f2f1006f5f0 msgr2=0x7f2f1006f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:34.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f15e43640 1 -- 172.21.15.113:0/999210091 shutdown_connections 2024-04-22T06:32:34.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.067+0000 7f2f15e43640 1 -- 172.21.15.113:0/999210091 wait complete. 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.068+0000 7f2f15e43640 1 Processor -- start 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f15e43640 1 -- start start 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f15e43640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f100c8950 0x7f2f101f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f15e43640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100c8ea0 0x7f2f100c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f15e43640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f100ca3a0 0x7f2f10150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f15e43640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2f100c7f10 con 0x7f2f100ca3a0 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f15e43640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f100c79e0 con 0x7f2f100c8950 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f15e43640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2f100c9f10 con 0x7f2f100c8ea0 2024-04-22T06:32:34.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f100ca3a0 0x7f2f10150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f100ca3a0 0x7f2f10150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33636/0 (socket says 172.21.15.113:33636) 2024-04-22T06:32:34.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.069+0000 7f2f0ffff640 1 -- 172.21.15.113:0/682236000 learned_addr learned my addr 172.21.15.113:0/682236000 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:34.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0f7fe640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f100c8950 0x7f2f101f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0effd640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100c8ea0 0x7f2f100c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0ffff640 1 -- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100c8ea0 msgr2=0x7f2f100c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100c8ea0 0x7f2f100c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0ffff640 1 -- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f100c8950 msgr2=0x7f2f101f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f100c8950 0x7f2f101f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0ffff640 1 -- 172.21.15.113:0/682236000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f10151440 con 0x7f2f100ca3a0 2024-04-22T06:32:34.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0f7fe640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f100c8950 0x7f2f101f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:34.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f0ffff640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f100ca3a0 0x7f2f10150200 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800efc0 tx=0x7f2f08009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2ef7fff640 1 -- 172.21.15.113:0/682236000 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08018030 con 0x7f2f100ca3a0 2024-04-22T06:32:34.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2ef7fff640 1 -- 172.21.15.113:0/682236000 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0800cd80 con 0x7f2f100ca3a0 2024-04-22T06:32:34.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f101f19b0 con 0x7f2f100ca3a0 2024-04-22T06:32:34.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2ef7fff640 1 -- 172.21.15.113:0/682236000 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08003bb0 con 0x7f2f100ca3a0 2024-04-22T06:32:34.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.070+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f101f1f70 con 0x7f2f100ca3a0 2024-04-22T06:32:34.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.071+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f100c37f0 con 0x7f2f100ca3a0 2024-04-22T06:32:34.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.072+0000 7f2ef7fff640 1 -- 172.21.15.113:0/682236000 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f08005d10 con 0x7f2f100ca3a0 2024-04-22T06:32:34.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.072+0000 7f2ef7fff640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2efc06c8f0 0x7f2efc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.072+0000 7f2ef7fff640 1 -- 172.21.15.113:0/682236000 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2f0808c910 con 0x7f2f100ca3a0 2024-04-22T06:32:34.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.072+0000 7f2f0f7fe640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2efc06c8f0 0x7f2efc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.072+0000 7f2f0f7fe640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2efc06c8f0 0x7f2efc06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f00000f60 tx=0x7f2f00009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.076+0000 7f2ef7fff640 1 -- 172.21.15.113:0/682236000 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f100c37f0 con 0x7f2f100ca3a0 2024-04-22T06:32:34.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.251+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f10068f50 con 0x7f2f100ca3a0 2024-04-22T06:32:34.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.251+0000 7f2ef7fff640 1 -- 172.21.15.113:0/682236000 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f2f08022070 con 0x7f2f100ca3a0 2024-04-22T06:32:34.251 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:32:34.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2efc06c8f0 msgr2=0x7f2efc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2efc06c8f0 0x7f2efc06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f00000f60 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2024-04-22T06:32:34.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f100ca3a0 msgr2=0x7f2f10150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f100ca3a0 0x7f2f10150200 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800efc0 tx=0x7f2f08009f90 comp rx=0 tx=0).stop 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 shutdown_connections 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2efc06c8f0 0x7f2efc06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f100ca3a0 0x7f2f10150200 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f100c8ea0 0x7f2f100c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 --2- 172.21.15.113:0/682236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f100c8950 0x7f2f101f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 >> 172.21.15.113:0/682236000 conn(0x7f2f1006f5f0 msgr2=0x7f2f101e4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 shutdown_connections 2024-04-22T06:32:34.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.254+0000 7f2f15e43640 1 -- 172.21.15.113:0/682236000 wait complete. 2024-04-22T06:32:34.264 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:32:34.364 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.364+0000 7f5ce59db640 1 Processor -- start 2024-04-22T06:32:34.364 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.364+0000 7f5ce59db640 1 -- start start 2024-04-22T06:32:34.366 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.365+0000 7f5ce59db640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce0070240 0x7f5ce00c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.366 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.365+0000 7f5ce59db640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce0159ed0 con 0x7f5ce0070620 2024-04-22T06:32:34.366 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.365+0000 7f5ce59db640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce00c5150 con 0x7f5ce00c8a70 2024-04-22T06:32:34.366 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.365+0000 7f5ce59db640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce00c5430 con 0x7f5ce0070240 2024-04-22T06:32:34.366 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.365+0000 7f5cdf7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5ce0070620 0x7f5ce015c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45020/0 (socket says 172.21.15.113:45020) 2024-04-22T06:32:34.366 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.365+0000 7f5cdf7fe640 1 -- 172.21.15.113:0/1551510139 learned_addr learned my addr 172.21.15.113:0/1551510139 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:34.366 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.365+0000 7f5cdeffd640 1 --2- 172.21.15.113:0/1551510139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce0070240 0x7f5ce00c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.366+0000 7f5cddffb640 1 -- 172.21.15.113:0/1551510139 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219062534 0 0) 0x7f5ce0159ed0 con 0x7f5ce0070620 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.366+0000 7f5cddffb640 1 -- 172.21.15.113:0/1551510139 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc8003520 con 0x7f5ce0070620 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.366+0000 7f5cddffb640 1 -- 172.21.15.113:0/1551510139 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078032442 0 0) 0x7f5ce00c5150 con 0x7f5ce00c8a70 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.366+0000 7f5cddffb640 1 -- 172.21.15.113:0/1551510139 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ce0159ed0 con 0x7f5ce00c8a70 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.366+0000 7f5cdeffd640 1 -- 172.21.15.113:0/1551510139 >> v1:172.21.15.145:6789/0 conn(0x7f5ce00c8a70 legacy=0x7f5ce00c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.366+0000 7f5cdeffd640 1 -- 172.21.15.113:0/1551510139 >> v1:172.21.15.113:6789/0 conn(0x7f5ce0070620 legacy=0x7f5ce015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.366+0000 7f5cdeffd640 1 -- 172.21.15.113:0/1551510139 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce0159110 con 0x7f5ce0070240 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5cdeffd640 1 --2- 172.21.15.113:0/1551510139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce0070240 0x7f5ce00c90a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009dc0 tx=0x7f5cd002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483422258c8c6000 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5cddffb640 1 -- 172.21.15.113:0/1551510139 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0039070 con 0x7f5ce0070240 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5cddffb640 1 -- 172.21.15.113:0/1551510139 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd002cd50 con 0x7f5ce0070240 2024-04-22T06:32:34.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5cddffb640 1 -- 172.21.15.113:0/1551510139 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0034640 con 0x7f5ce0070240 2024-04-22T06:32:34.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5ce59db640 1 -- 172.21.15.113:0/1551510139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce0070240 msgr2=0x7f5ce00c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5ce59db640 1 --2- 172.21.15.113:0/1551510139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce0070240 0x7f5ce00c90a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009dc0 tx=0x7f5cd002bfa0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5ce59db640 1 -- 172.21.15.113:0/1551510139 shutdown_connections 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5ce59db640 1 --2- 172.21.15.113:0/1551510139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce0070240 0x7f5ce00c90a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5ce59db640 1 -- 172.21.15.113:0/1551510139 >> 172.21.15.113:0/1551510139 conn(0x7f5ce006b920 msgr2=0x7f5ce006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5ce59db640 1 -- 172.21.15.113:0/1551510139 shutdown_connections 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.367+0000 7f5ce59db640 1 -- 172.21.15.113:0/1551510139 wait complete. 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.368+0000 7f5ce59db640 1 Processor -- start 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5ce59db640 1 -- start start 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5ce59db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ce0070240 0x7f5ce01490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5ce59db640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce0070620 0x7f5ce01e3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5ce59db640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce00c8a70 0x7f5ce01e4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5ce59db640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce01596d0 con 0x7f5ce0070240 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5ce59db640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce0159a40 con 0x7f5ce0070620 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5ce59db640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce015cc70 con 0x7f5ce00c8a70 2024-04-22T06:32:34.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5cdeffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ce0070240 0x7f5ce01490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5cdeffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ce0070240 0x7f5ce01490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33640/0 (socket says 172.21.15.113:33640) 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5cdeffd640 1 -- 172.21.15.113:0/2531278782 learned_addr learned my addr 172.21.15.113:0/2531278782 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.369+0000 7f5cde7fc640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce0070620 0x7f5ce01e3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cdf7fe640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce00c8a70 0x7f5ce01e4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cdeffd640 1 -- 172.21.15.113:0/2531278782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce00c8a70 msgr2=0x7f5ce01e4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cdeffd640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce00c8a70 0x7f5ce01e4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cdeffd640 1 -- 172.21.15.113:0/2531278782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce0070620 msgr2=0x7f5ce01e3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cdeffd640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce0070620 0x7f5ce01e3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cdeffd640 1 -- 172.21.15.113:0/2531278782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce014e200 con 0x7f5ce0070240 2024-04-22T06:32:34.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cdeffd640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ce0070240 0x7f5ce01490c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0037040 tx=0x7f5cd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cc7fff640 1 -- 172.21.15.113:0/2531278782 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0039050 con 0x7f5ce0070240 2024-04-22T06:32:34.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cc7fff640 1 -- 172.21.15.113:0/2531278782 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd0045070 con 0x7f5ce0070240 2024-04-22T06:32:34.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce01e2ed0 con 0x7f5ce0070240 2024-04-22T06:32:34.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5cc7fff640 1 -- 172.21.15.113:0/2531278782 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0009450 con 0x7f5ce0070240 2024-04-22T06:32:34.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.370+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce01e3170 con 0x7f5ce0070240 2024-04-22T06:32:34.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.371+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce0068f50 con 0x7f5ce0070240 2024-04-22T06:32:34.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.371+0000 7f5cc7fff640 1 -- 172.21.15.113:0/2531278782 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5cd003e830 con 0x7f5ce0070240 2024-04-22T06:32:34.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.372+0000 7f5cc7fff640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5ccc06c8f0 0x7f5ccc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.372+0000 7f5cc7fff640 1 -- 172.21.15.113:0/2531278782 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5cd00ae890 con 0x7f5ce0070240 2024-04-22T06:32:34.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.372+0000 7f5cde7fc640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5ccc06c8f0 0x7f5ccc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.372+0000 7f5cde7fc640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5ccc06c8f0 0x7f5ccc06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4007fd0 tx=0x7f5cd4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.376+0000 7f5cc7fff640 1 -- 172.21.15.113:0/2531278782 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5cd004f020 con 0x7f5ce0070240 2024-04-22T06:32:34.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.552+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5ce00c6d80 con 0x7f5ce0070240 2024-04-22T06:32:34.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.552+0000 7f5cc7fff640 1 -- 172.21.15.113:0/2531278782 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f5cd007c250 con 0x7f5ce0070240 2024-04-22T06:32:34.552 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:34.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5ccc06c8f0 msgr2=0x7f5ccc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5ccc06c8f0 0x7f5ccc06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4007fd0 tx=0x7f5cd4009040 comp rx=0 tx=0).stop 2024-04-22T06:32:34.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ce0070240 msgr2=0x7f5ce01490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ce0070240 0x7f5ce01490c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0037040 tx=0x7f5cd0004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:34.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 shutdown_connections 2024-04-22T06:32:34.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5ce00c8a70 0x7f5ce01e4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ce0070620 0x7f5ce01e3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f5ccc06c8f0 0x7f5ccc06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 --2- 172.21.15.113:0/2531278782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ce0070240 0x7f5ce01490c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 >> 172.21.15.113:0/2531278782 conn(0x7f5ce006b920 msgr2=0x7f5ce00c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:34.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 shutdown_connections 2024-04-22T06:32:34.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.554+0000 7f5ce59db640 1 -- 172.21.15.113:0/2531278782 wait complete. 2024-04-22T06:32:34.565 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:32:34.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.666+0000 7f8cf9b54640 1 Processor -- start 2024-04-22T06:32:34.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.666+0000 7f8cf9b54640 1 -- start start 2024-04-22T06:32:34.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.666+0000 7f8cf9b54640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cf40c8340 0x7f8cf40723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.666+0000 7f8cf9b54640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf40c8720 0x7f8cf4151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.666+0000 7f8cf9b54640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf4157d70 con 0x7f8cf4158b10 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.666+0000 7f8cf9b54640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf4158680 con 0x7f8cf40c8340 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.666+0000 7f8cf9b54640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf415be10 con 0x7f8cf40c8720 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.667+0000 7f8cf37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cf40c8340 0x7f8cf40723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.667+0000 7f8cf37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cf40c8340 0x7f8cf40723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33644/0 (socket says 172.21.15.113:33644) 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.667+0000 7f8cf37fe640 1 -- 172.21.15.113:0/549562359 learned_addr learned my addr 172.21.15.113:0/549562359 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.667+0000 7f8cf3fff640 1 --2- 172.21.15.113:0/549562359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf40c8720 0x7f8cf4151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.667+0000 7f8cf37fe640 1 -- 172.21.15.113:0/549562359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf40c8720 msgr2=0x7f8cf4151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.667+0000 7f8cf37fe640 1 --2- 172.21.15.113:0/549562359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf40c8720 0x7f8cf4151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.667+0000 7f8cf37fe640 1 -- 172.21.15.113:0/549562359 >> v1:172.21.15.145:6789/0 conn(0x7f8cf4158b10 legacy=0x7f8cf415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.667+0000 7f8cf37fe640 1 -- 172.21.15.113:0/549562359 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf415c0f0 con 0x7f8cf40c8340 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf37fe640 1 --2- 172.21.15.113:0/549562359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8340 0x7f8cf40723b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009870 tx=0x7f8ce802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f97a88abd18486d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf27fc640 1 -- 172.21.15.113:0/549562359 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8034070 con 0x7f8cf40c8340 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf27fc640 1 -- 172.21.15.113:0/549562359 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce8030840 con 0x7f8cf40c8340 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf27fc640 1 -- 172.21.15.113:0/549562359 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8030c10 con 0x7f8cf40c8340 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf9b54640 1 -- 172.21.15.113:0/549562359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8340 msgr2=0x7f8cf40723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/549562359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8340 0x7f8cf40723b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009870 tx=0x7f8ce802b980 comp rx=0 tx=0).stop 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf9b54640 1 -- 172.21.15.113:0/549562359 shutdown_connections 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/549562359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf40c8720 0x7f8cf4151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/549562359 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8340 0x7f8cf40723b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf9b54640 1 -- 172.21.15.113:0/549562359 >> 172.21.15.113:0/549562359 conn(0x7f8cf406d660 msgr2=0x7f8cf4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:34.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf9b54640 1 -- 172.21.15.113:0/549562359 shutdown_connections 2024-04-22T06:32:34.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.668+0000 7f8cf9b54640 1 -- 172.21.15.113:0/549562359 wait complete. 2024-04-22T06:32:34.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.669+0000 7f8cf9b54640 1 Processor -- start 2024-04-22T06:32:34.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf9b54640 1 -- start start 2024-04-22T06:32:34.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf9b54640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cf40c8340 0x7f8cf41f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf9b54640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8720 0x7f8cf40c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf9b54640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf4158b10 0x7f8cf41540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf9b54640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf40728f0 con 0x7f8cf40c8720 2024-04-22T06:32:34.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf9b54640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4158310 con 0x7f8cf40c8340 2024-04-22T06:32:34.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf9b54640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf415ba70 con 0x7f8cf4158b10 2024-04-22T06:32:34.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8720 0x7f8cf40c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8720 0x7f8cf40c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33646/0 (socket says 172.21.15.113:33646) 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.670+0000 7f8cf2ffd640 1 -- 172.21.15.113:0/1107217517 learned_addr learned my addr 172.21.15.113:0/1107217517 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf3fff640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf4158b10 0x7f8cf41540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf37fe640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cf40c8340 0x7f8cf41f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf2ffd640 1 -- 172.21.15.113:0/1107217517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf4158b10 msgr2=0x7f8cf41540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf2ffd640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf4158b10 0x7f8cf41540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf2ffd640 1 -- 172.21.15.113:0/1107217517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cf40c8340 msgr2=0x7f8cf41f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf2ffd640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cf40c8340 0x7f8cf41f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf2ffd640 1 -- 172.21.15.113:0/1107217517 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf4152c80 con 0x7f8cf40c8720 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf2ffd640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8720 0x7f8cf40c7230 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400c3f0 tx=0x7f8ce400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cdbfff640 1 -- 172.21.15.113:0/1107217517 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40052d0 con 0x7f8cf40c8720 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cdbfff640 1 -- 172.21.15.113:0/1107217517 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce4005490 con 0x7f8cf40c8720 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf4152f60 con 0x7f8cf40c8720 2024-04-22T06:32:34.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cdbfff640 1 -- 172.21.15.113:0/1107217517 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4007260 con 0x7f8cf40c8720 2024-04-22T06:32:34.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.671+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf4153540 con 0x7f8cf40c8720 2024-04-22T06:32:34.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.672+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf4068f50 con 0x7f8cf40c8720 2024-04-22T06:32:34.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.673+0000 7f8cdbfff640 1 -- 172.21.15.113:0/1107217517 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ce4007400 con 0x7f8cf40c8720 2024-04-22T06:32:34.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.673+0000 7f8cdbfff640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8ce006c920 0x7f8ce006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.673+0000 7f8cf37fe640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8ce006c920 0x7f8ce006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.673+0000 7f8cdbfff640 1 -- 172.21.15.113:0/1107217517 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8ce408b480 con 0x7f8cf40c8720 2024-04-22T06:32:34.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.673+0000 7f8cf37fe640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8ce006c920 0x7f8ce006ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8036000 tx=0x7f8ce803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.677+0000 7f8cdbfff640 1 -- 172.21.15.113:0/1107217517 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ce4059420 con 0x7f8cf40c8720 2024-04-22T06:32:34.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.854+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8cf4074ee0 con 0x7f8cf40c8720 2024-04-22T06:32:34.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.854+0000 7f8cdbfff640 1 -- 172.21.15.113:0/1107217517 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f8ce4058d20 con 0x7f8cf40c8720 2024-04-22T06:32:34.854 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:32:34.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8ce006c920 msgr2=0x7f8ce006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8ce006c920 0x7f8ce006ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8036000 tx=0x7f8ce803b040 comp rx=0 tx=0).stop 2024-04-22T06:32:34.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8720 msgr2=0x7f8cf40c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8720 0x7f8cf40c7230 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400c3f0 tx=0x7f8ce400c8b0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 shutdown_connections 2024-04-22T06:32:34.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cf4158b10 0x7f8cf41540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8ce006c920 0x7f8ce006ede0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf40c8720 0x7f8cf40c7230 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 --2- 172.21.15.113:0/1107217517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cf40c8340 0x7f8cf41f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.856+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 >> 172.21.15.113:0/1107217517 conn(0x7f8cf406d660 msgr2=0x7f8cf414da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:34.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.857+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 shutdown_connections 2024-04-22T06:32:34.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.857+0000 7f8cf9b54640 1 -- 172.21.15.113:0/1107217517 wait complete. 2024-04-22T06:32:34.867 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:32:34.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.968+0000 7fa43fad9640 1 Processor -- start 2024-04-22T06:32:34.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.968+0000 7fa43fad9640 1 -- start start 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43fad9640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa4380c8340 0x7fa4380723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43fad9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa438151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43fad9640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa438157d70 con 0x7fa438158b10 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43fad9640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fa438158680 con 0x7fa4380c8340 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43fad9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa43815be10 con 0x7fa4380c8720 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43d875640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa4380c8340 0x7fa4380723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43e076640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa438151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43d875640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa4380c8340 0x7fa4380723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:36662/0 (socket says 172.21.15.113:36662) 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43e076640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa438151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:42442/0 (socket says 172.21.15.113:42442) 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43d875640 1 -- 172.21.15.113:0/662559656 learned_addr learned my addr 172.21.15.113:0/662559656 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:34.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.969+0000 7fa43d074640 1 --1- 172.21.15.113:0/662559656 >> v1:172.21.15.145:6789/0 conn(0x7fa438158b10 0x7fa43815b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:48068/0 (socket says 172.21.15.113:48068) 2024-04-22T06:32:34.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.970+0000 7fa43e076640 1 -- 172.21.15.113:0/662559656 >> v2:172.21.15.145:3300/0 conn(0x7fa4380c8340 msgr2=0x7fa4380723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:34.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.970+0000 7fa43e076640 1 --2- 172.21.15.113:0/662559656 >> v2:172.21.15.145:3300/0 conn(0x7fa4380c8340 0x7fa4380723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.970+0000 7fa43e076640 1 -- 172.21.15.113:0/662559656 >> v1:172.21.15.145:6789/0 conn(0x7fa438158b10 legacy=0x7fa43815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.970+0000 7fa43e076640 1 -- 172.21.15.113:0/662559656 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43815c0f0 con 0x7fa4380c8720 2024-04-22T06:32:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.970+0000 7fa43e076640 1 --2- 172.21.15.113:0/662559656 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa438151b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa4300097a0 tx=0x7fa43002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cecba25ffaf7745c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43c873640 1 -- 172.21.15.113:0/662559656 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430035020 con 0x7fa4380c8720 2024-04-22T06:32:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43c873640 1 -- 172.21.15.113:0/662559656 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa430031830 con 0x7fa4380c8720 2024-04-22T06:32:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43c873640 1 -- 172.21.15.113:0/662559656 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430031c00 con 0x7fa4380c8720 2024-04-22T06:32:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43fad9640 1 -- 172.21.15.113:0/662559656 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 msgr2=0x7fa438151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43fad9640 1 --2- 172.21.15.113:0/662559656 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa438151b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa4300097a0 tx=0x7fa43002b8d0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43fad9640 1 -- 172.21.15.113:0/662559656 shutdown_connections 2024-04-22T06:32:34.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43fad9640 1 --2- 172.21.15.113:0/662559656 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa438151b10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43fad9640 1 --2- 172.21.15.113:0/662559656 >> v2:172.21.15.145:3300/0 conn(0x7fa4380c8340 0x7fa4380723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43fad9640 1 -- 172.21.15.113:0/662559656 >> 172.21.15.113:0/662559656 conn(0x7fa43806d660 msgr2=0x7fa438074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:34.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43fad9640 1 -- 172.21.15.113:0/662559656 shutdown_connections 2024-04-22T06:32:34.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.971+0000 7fa43fad9640 1 -- 172.21.15.113:0/662559656 wait complete. 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.972+0000 7fa43fad9640 1 Processor -- start 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.972+0000 7fa43fad9640 1 -- start start 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43fad9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4380c8340 0x7fa4381ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43fad9640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa4380ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43fad9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa438158b10 0x7fa4380cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43fad9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380728f0 con 0x7fa438158b10 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43fad9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa438158310 con 0x7fa4380c8340 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43fad9640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa43815ba70 con 0x7fa4380c8720 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43e076640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa438158b10 0x7fa4380cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43e076640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa438158b10 0x7fa4380cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33650/0 (socket says 172.21.15.113:33650) 2024-04-22T06:32:34.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43e076640 1 -- 172.21.15.113:0/2620369850 learned_addr learned my addr 172.21.15.113:0/2620369850 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43d875640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4380c8340 0x7fa4381ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43d074640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa4380ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43e076640 1 -- 172.21.15.113:0/2620369850 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 msgr2=0x7fa4380ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43e076640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa4380ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43e076640 1 -- 172.21.15.113:0/2620369850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4380c8340 msgr2=0x7fa4381ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43e076640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4380c8340 0x7fa4381ed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.973+0000 7fa43e076640 1 -- 172.21.15.113:0/2620369850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa438151010 con 0x7fa438158b10 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.974+0000 7fa43e076640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa438158b10 0x7fa4380cccf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa4300098c0 tx=0x7fa4300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.974+0000 7fa42e7fc640 1 -- 172.21.15.113:0/2620369850 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430035040 con 0x7fa438158b10 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.974+0000 7fa42e7fc640 1 -- 172.21.15.113:0/2620369850 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43003f070 con 0x7fa438158b10 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.974+0000 7fa42e7fc640 1 -- 172.21.15.113:0/2620369850 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43003ba80 con 0x7fa438158b10 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.974+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4380c6fb0 con 0x7fa438158b10 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.974+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4380cbc50 con 0x7fa438158b10 2024-04-22T06:32:34.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.975+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa438071c60 con 0x7fa438158b10 2024-04-22T06:32:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.975+0000 7fa42e7fc640 1 -- 172.21.15.113:0/2620369850 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa430038020 con 0x7fa438158b10 2024-04-22T06:32:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.976+0000 7fa42e7fc640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41c06c8f0 0x7fa41c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.976+0000 7fa42e7fc640 1 -- 172.21.15.113:0/2620369850 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa4300adb70 con 0x7fa438158b10 2024-04-22T06:32:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.976+0000 7fa43d875640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41c06c8f0 0x7fa41c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:34.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.976+0000 7fa43d875640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41c06c8f0 0x7fa41c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4340113e0 tx=0x7fa43400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:34.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:34.980+0000 7fa42e7fc640 1 -- 172.21.15.113:0/2620369850 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa438071c60 con 0x7fa438158b10 2024-04-22T06:32:35.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.158+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa438074d50 con 0x7fa438158b10 2024-04-22T06:32:35.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.159+0000 7fa42e7fc640 1 -- 172.21.15.113:0/2620369850 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fa438074d50 con 0x7fa438158b10 2024-04-22T06:32:35.158 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41c06c8f0 msgr2=0x7fa41c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41c06c8f0 0x7fa41c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4340113e0 tx=0x7fa43400b040 comp rx=0 tx=0).stop 2024-04-22T06:32:35.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa438158b10 msgr2=0x7fa4380cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa438158b10 0x7fa4380cccf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa4300098c0 tx=0x7fa4300046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 shutdown_connections 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41c06c8f0 0x7fa41c06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa438158b10 0x7fa4380cccf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa4380c8720 0x7fa4380ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 --2- 172.21.15.113:0/2620369850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4380c8340 0x7fa4381ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 >> 172.21.15.113:0/2620369850 conn(0x7fa43806d660 msgr2=0x7fa438156880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 shutdown_connections 2024-04-22T06:32:35.161 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.161+0000 7fa43fad9640 1 -- 172.21.15.113:0/2620369850 wait complete. 2024-04-22T06:32:35.171 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:35.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.268+0000 7fc1ba0e4640 1 Processor -- start 2024-04-22T06:32:35.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.268+0000 7fc1ba0e4640 1 -- start start 2024-04-22T06:32:35.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.269+0000 7fc1ba0e4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1b4151b70 0x7fc1b40cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.269+0000 7fc1ba0e4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b40c3ed0 con 0x7fc1b40c4870 2024-04-22T06:32:35.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.269+0000 7fc1ba0e4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b4157880 con 0x7fc1b40c3900 2024-04-22T06:32:35.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.269+0000 7fc1ba0e4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b4158640 con 0x7fc1b4151b70 2024-04-22T06:32:35.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.269+0000 7fc1b37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1b4151b70 0x7fc1b40cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.269+0000 7fc1b2ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc1b40c4870 0x7fc1b40c4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45028/0 (socket says 172.21.15.113:45028) 2024-04-22T06:32:35.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.269+0000 7fc1b2ffd640 1 -- 172.21.15.113:0/3433570688 learned_addr learned my addr 172.21.15.113:0/3433570688 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:35.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.270+0000 7fc1b37fe640 1 -- 172.21.15.113:0/3433570688 >> v1:172.21.15.145:6789/0 conn(0x7fc1b40c3900 legacy=0x7fc1b40c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.270+0000 7fc1b37fe640 1 -- 172.21.15.113:0/3433570688 >> v1:172.21.15.113:6789/0 conn(0x7fc1b40c4870 legacy=0x7fc1b40c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.270+0000 7fc1b27fc640 1 -- 172.21.15.113:0/3433570688 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343326149 0 0) 0x7fc1b40c3ed0 con 0x7fc1b40c4870 2024-04-22T06:32:35.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.270+0000 7fc1b37fe640 1 -- 172.21.15.113:0/3433570688 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b4157b60 con 0x7fc1b4151b70 2024-04-22T06:32:35.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.270+0000 7fc1b37fe640 1 --2- 172.21.15.113:0/3433570688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b4151b70 0x7fc1b40cbec0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40097a0 tx=0x7fc1a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438f623ee6b9ad76 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.270+0000 7fc1b27fc640 1 -- 172.21.15.113:0/3433570688 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4034070 con 0x7fc1b4151b70 2024-04-22T06:32:35.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.270+0000 7fc1b27fc640 1 -- 172.21.15.113:0/3433570688 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4030610 con 0x7fc1b4151b70 2024-04-22T06:32:35.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.270+0000 7fc1b27fc640 1 -- 172.21.15.113:0/3433570688 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40309e0 con 0x7fc1b4151b70 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.271+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/3433570688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b4151b70 msgr2=0x7fc1b40cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.271+0000 7fc1ba0e4640 1 --2- 172.21.15.113:0/3433570688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b4151b70 0x7fc1b40cbec0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40097a0 tx=0x7fc1a402b960 comp rx=0 tx=0).stop 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.271+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/3433570688 shutdown_connections 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.271+0000 7fc1ba0e4640 1 --2- 172.21.15.113:0/3433570688 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b4151b70 0x7fc1b40cbec0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.271+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/3433570688 >> 172.21.15.113:0/3433570688 conn(0x7fc1b406d610 msgr2=0x7fc1b4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.271+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/3433570688 shutdown_connections 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.271+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/3433570688 wait complete. 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.272+0000 7fc1ba0e4640 1 Processor -- start 2024-04-22T06:32:35.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.272+0000 7fc1ba0e4640 1 -- start start 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1ba0e4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1b40c3900 0x7fc1b413d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1ba0e4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b40c4870 0x7fc1b413f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1ba0e4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1b4151b70 0x7fc1b40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1ba0e4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b40c54d0 con 0x7fc1b40c4870 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1ba0e4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b41581b0 con 0x7fc1b40c3900 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1ba0e4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b41f3120 con 0x7fc1b4151b70 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b40c4870 0x7fc1b413f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b40c4870 0x7fc1b413f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33678/0 (socket says 172.21.15.113:33678) 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b2ffd640 1 -- 172.21.15.113:0/1380882052 learned_addr learned my addr 172.21.15.113:0/1380882052 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b37fe640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1b40c3900 0x7fc1b413d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b3fff640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1b4151b70 0x7fc1b40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b2ffd640 1 -- 172.21.15.113:0/1380882052 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1b4151b70 msgr2=0x7fc1b40c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b2ffd640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1b4151b70 0x7fc1b40c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b2ffd640 1 -- 172.21.15.113:0/1380882052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1b40c3900 msgr2=0x7fc1b413d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b2ffd640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1b40c3900 0x7fc1b413d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.273+0000 7fc1b2ffd640 1 -- 172.21.15.113:0/1380882052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b4150ec0 con 0x7fc1b40c4870 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.274+0000 7fc1b2ffd640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b40c4870 0x7fc1b413f060 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800c4d0 tx=0x7fc1a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.274+0000 7fc19bfff640 1 -- 172.21.15.113:0/1380882052 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8018070 con 0x7fc1b40c4870 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.274+0000 7fc19bfff640 1 -- 172.21.15.113:0/1380882052 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a80074e0 con 0x7fc1b40c4870 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.274+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b41f2360 con 0x7fc1b40c4870 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.274+0000 7fc19bfff640 1 -- 172.21.15.113:0/1380882052 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8004a20 con 0x7fc1b40c4870 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.274+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41f2920 con 0x7fc1b40c4870 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.275+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b40cd370 con 0x7fc1b40c4870 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.275+0000 7fc19bfff640 1 -- 172.21.15.113:0/1380882052 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1a801b070 con 0x7fc1b40c4870 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.275+0000 7fc19bfff640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1a006c920 0x7fc1a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.276+0000 7fc1b37fe640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1a006c920 0x7fc1a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.276+0000 7fc19bfff640 1 -- 172.21.15.113:0/1380882052 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc1a808b200 con 0x7fc1b40c4870 2024-04-22T06:32:35.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.276+0000 7fc1b37fe640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1a006c920 0x7fc1a006ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4036000 tx=0x7fc1a4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.280+0000 7fc19bfff640 1 -- 172.21.15.113:0/1380882052 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc1b40cd370 con 0x7fc1b40c4870 2024-04-22T06:32:35.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.458+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1b4068e40 con 0x7fc1b40c4870 2024-04-22T06:32:35.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.459+0000 7fc19bfff640 1 -- 172.21.15.113:0/1380882052 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7fc1a8058b50 con 0x7fc1b40c4870 2024-04-22T06:32:35.458 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:35.458 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:35.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1a006c920 msgr2=0x7fc1a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1a006c920 0x7fc1a006ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4036000 tx=0x7fc1a4008030 comp rx=0 tx=0).stop 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b40c4870 msgr2=0x7fc1b413f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b40c4870 0x7fc1b413f060 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800c4d0 tx=0x7fc1a800c990 comp rx=0 tx=0).stop 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 shutdown_connections 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1b4151b70 0x7fc1b40c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1a006c920 0x7fc1a006ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1b40c4870 0x7fc1b413f060 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 --2- 172.21.15.113:0/1380882052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1b40c3900 0x7fc1b413d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 >> 172.21.15.113:0/1380882052 conn(0x7fc1b406d610 msgr2=0x7fc1b40cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 shutdown_connections 2024-04-22T06:32:35.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.461+0000 7fc1ba0e4640 1 -- 172.21.15.113:0/1380882052 wait complete. 2024-04-22T06:32:35.471 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:32:35.472 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:32:35.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.573+0000 7fdd7705c640 1 Processor -- start 2024-04-22T06:32:35.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.573+0000 7fdd7705c640 1 -- start start 2024-04-22T06:32:35.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.573+0000 7fdd7705c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdd700d0820 0x7fdd700d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd7705c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd700c5c80 con 0x7fdd7015b070 2024-04-22T06:32:35.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd7705c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd700d1170 con 0x7fdd701553c0 2024-04-22T06:32:35.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd7705c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7015e660 con 0x7fdd700d0820 2024-04-22T06:32:35.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd755f9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdd700d0820 0x7fdd700d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd6ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fdd7015b070 0x7fdd700cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45042/0 (socket says 172.21.15.113:45042) 2024-04-22T06:32:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd6ffff640 1 -- 172.21.15.113:0/238214507 learned_addr learned my addr 172.21.15.113:0/238214507 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd755f9640 1 -- 172.21.15.113:0/238214507 >> v1:172.21.15.145:6789/0 conn(0x7fdd701553c0 legacy=0x7fdd7015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd755f9640 1 -- 172.21.15.113:0/238214507 >> v1:172.21.15.113:6789/0 conn(0x7fdd7015b070 legacy=0x7fdd700cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd755f9640 1 -- 172.21.15.113:0/238214507 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7015b5d0 con 0x7fdd700d0820 2024-04-22T06:32:35.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.574+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/238214507 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953329822 0 0) 0x7fdd700c5c80 con 0x7fdd7015b070 2024-04-22T06:32:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd755f9640 1 --2- 172.21.15.113:0/238214507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700d0c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009d90 tx=0x7fdd6802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d999882a7738c12 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/238214507 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68039070 con 0x7fdd700d0820 2024-04-22T06:32:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/238214507 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6802cd00 con 0x7fdd700d0820 2024-04-22T06:32:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd6f7fe640 1 -- 172.21.15.113:0/238214507 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68034660 con 0x7fdd700d0820 2024-04-22T06:32:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd7705c640 1 -- 172.21.15.113:0/238214507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 msgr2=0x7fdd700d0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd7705c640 1 --2- 172.21.15.113:0/238214507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700d0c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009d90 tx=0x7fdd6802bf50 comp rx=0 tx=0).stop 2024-04-22T06:32:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd7705c640 1 -- 172.21.15.113:0/238214507 shutdown_connections 2024-04-22T06:32:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd7705c640 1 --2- 172.21.15.113:0/238214507 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700d0c30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd7705c640 1 -- 172.21.15.113:0/238214507 >> 172.21.15.113:0/238214507 conn(0x7fdd70072360 msgr2=0x7fdd70074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.575+0000 7fdd7705c640 1 -- 172.21.15.113:0/238214507 shutdown_connections 2024-04-22T06:32:35.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.576+0000 7fdd7705c640 1 -- 172.21.15.113:0/238214507 wait complete. 2024-04-22T06:32:35.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.577+0000 7fdd7705c640 1 Processor -- start 2024-04-22T06:32:35.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.577+0000 7fdd7705c640 1 -- start start 2024-04-22T06:32:35.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.577+0000 7fdd7705c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.577+0000 7fdd7705c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd701553c0 0x7fdd70150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.577+0000 7fdd7705c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015b070 0x7fdd7014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.577+0000 7fdd7705c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7015bb90 con 0x7fdd700d0820 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.577+0000 7fdd7705c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdd701557a0 con 0x7fdd7015b070 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.577+0000 7fdd7705c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7015be70 con 0x7fdd701553c0 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33692/0 (socket says 172.21.15.113:33692) 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 -- 172.21.15.113:0/1053119132 learned_addr learned my addr 172.21.15.113:0/1053119132 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd755f9640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015b070 0x7fdd7014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd6ffff640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd701553c0 0x7fdd70150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 -- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd701553c0 msgr2=0x7fdd70150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd701553c0 0x7fdd70150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 -- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015b070 msgr2=0x7fdd7014d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015b070 0x7fdd7014d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 -- 172.21.15.113:0/1053119132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd701e3d00 con 0x7fdd700d0820 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd755f9640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015b070 0x7fdd7014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:35.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd74df8640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700cf980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c450 tx=0x7fdd5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd6d7fa640 1 -- 172.21.15.113:0/1053119132 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd580052d0 con 0x7fdd700d0820 2024-04-22T06:32:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd6d7fa640 1 -- 172.21.15.113:0/1053119132 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd58005490 con 0x7fdd700d0820 2024-04-22T06:32:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd6d7fa640 1 -- 172.21.15.113:0/1053119132 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58003880 con 0x7fdd700d0820 2024-04-22T06:32:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd701e3fe0 con 0x7fdd700d0820 2024-04-22T06:32:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.578+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd701f2500 con 0x7fdd700d0820 2024-04-22T06:32:35.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.579+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd70068f50 con 0x7fdd700d0820 2024-04-22T06:32:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.580+0000 7fdd6d7fa640 1 -- 172.21.15.113:0/1053119132 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd58003a20 con 0x7fdd700d0820 2024-04-22T06:32:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.580+0000 7fdd6d7fa640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdd5006c8f0 0x7fdd5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.580+0000 7fdd6d7fa640 1 -- 172.21.15.113:0/1053119132 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fdd5808bbf0 con 0x7fdd700d0820 2024-04-22T06:32:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.580+0000 7fdd6ffff640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdd5006c8f0 0x7fdd5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.580+0000 7fdd6ffff640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdd5006c8f0 0x7fdd5006edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd600010e0 tx=0x7fdd60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.584+0000 7fdd6d7fa640 1 -- 172.21.15.113:0/1053119132 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd58059c20 con 0x7fdd700d0820 2024-04-22T06:32:35.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.758+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd700cc0e0 con 0x7fdd700d0820 2024-04-22T06:32:35.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.758+0000 7fdd6d7fa640 1 -- 172.21.15.113:0/1053119132 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fdd58059520 con 0x7fdd700d0820 2024-04-22T06:32:35.758 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:32:35.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdd5006c8f0 msgr2=0x7fdd5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdd5006c8f0 0x7fdd5006edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd600010e0 tx=0x7fdd60009040 comp rx=0 tx=0).stop 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 msgr2=0x7fdd700cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700cf980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c450 tx=0x7fdd5800c910 comp rx=0 tx=0).stop 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 shutdown_connections 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdd7015b070 0x7fdd7014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdd701553c0 0x7fdd70150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fdd5006c8f0 0x7fdd5006edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 --2- 172.21.15.113:0/1053119132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdd700d0820 0x7fdd700cf980 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 >> 172.21.15.113:0/1053119132 conn(0x7fdd70072360 msgr2=0x7fdd700c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 shutdown_connections 2024-04-22T06:32:35.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.760+0000 7fdd7705c640 1 -- 172.21.15.113:0/1053119132 wait complete. 2024-04-22T06:32:35.770 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:32:35.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.870+0000 7f24af90e640 1 Processor -- start 2024-04-22T06:32:35.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.870+0000 7f24af90e640 1 -- start start 2024-04-22T06:32:35.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f24af90e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f24a80cb9a0 0x7f24a8154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f24af90e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a806fa90 con 0x7f24a80cb5c0 2024-04-22T06:32:35.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f24af90e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a806fd30 con 0x7f24a80cae40 2024-04-22T06:32:35.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f24af90e640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f24a80c9d90 con 0x7f24a80cb9a0 2024-04-22T06:32:35.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f24ad6aa640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f24a80cb5c0 0x7f24a806f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45056/0 (socket says 172.21.15.113:45056) 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f24ad6aa640 1 -- 172.21.15.113:0/4222065395 learned_addr learned my addr 172.21.15.113:0/4222065395 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f24adeab640 1 --2- 172.21.15.113:0/4222065395 >> v2:172.21.15.145:3300/0 conn(0x7f24a80cb9a0 0x7f24a8154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f249ffff640 1 -- 172.21.15.113:0/4222065395 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212821010 0 0) 0x7f24a806fa90 con 0x7f24a80cb5c0 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.871+0000 7f249ffff640 1 -- 172.21.15.113:0/4222065395 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2494003520 con 0x7f24a80cb5c0 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.872+0000 7f249ffff640 1 -- 172.21.15.113:0/4222065395 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107001111 0 0) 0x7f24a806fd30 con 0x7f24a80cae40 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.872+0000 7f249ffff640 1 -- 172.21.15.113:0/4222065395 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24a806fa90 con 0x7f24a80cae40 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.872+0000 7f24adeab640 1 -- 172.21.15.113:0/4222065395 >> v1:172.21.15.145:6789/0 conn(0x7f24a80cae40 legacy=0x7f24a815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.872+0000 7f24adeab640 1 -- 172.21.15.113:0/4222065395 >> v1:172.21.15.113:6789/0 conn(0x7f24a80cb5c0 legacy=0x7f24a806f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.872+0000 7f249ffff640 1 -- 172.21.15.113:0/4222065395 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 714021436 0 0) 0x7f2494003520 con 0x7f24a80cb5c0 2024-04-22T06:32:35.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.872+0000 7f24adeab640 1 -- 172.21.15.113:0/4222065395 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a80ca070 con 0x7f24a80cb9a0 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.872+0000 7f24adeab640 1 --2- 172.21.15.113:0/4222065395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cb9a0 0x7f24a8154a60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24a00097d0 tx=0x7f24a002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd0e45b173cdcf84 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f249ffff640 1 -- 172.21.15.113:0/4222065395 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0038070 con 0x7f24a80cb9a0 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f249ffff640 1 -- 172.21.15.113:0/4222065395 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a0031500 con 0x7f24a80cb9a0 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f249ffff640 1 -- 172.21.15.113:0/4222065395 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a40019f0 con 0x7f24a80cb9a0 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f24af90e640 1 -- 172.21.15.113:0/4222065395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cb9a0 msgr2=0x7f24a8154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f24af90e640 1 --2- 172.21.15.113:0/4222065395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cb9a0 0x7f24a8154a60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24a00097d0 tx=0x7f24a002b820 comp rx=0 tx=0).stop 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f24af90e640 1 -- 172.21.15.113:0/4222065395 shutdown_connections 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f24af90e640 1 --2- 172.21.15.113:0/4222065395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cb9a0 0x7f24a8154a60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f24af90e640 1 -- 172.21.15.113:0/4222065395 >> 172.21.15.113:0/4222065395 conn(0x7f24a8074d50 msgr2=0x7f24a8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f24af90e640 1 -- 172.21.15.113:0/4222065395 shutdown_connections 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.873+0000 7f24af90e640 1 -- 172.21.15.113:0/4222065395 wait complete. 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.874+0000 7f24af90e640 1 Processor -- start 2024-04-22T06:32:35.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.874+0000 7f24af90e640 1 -- start start 2024-04-22T06:32:35.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24af90e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cae40 0x7f24a80c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24af90e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24a80cb5c0 0x7f24a814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24af90e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24a80cb9a0 0x7f24a814c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24af90e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f24a80ca910 con 0x7f24a80cb9a0 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24af90e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f24a80ca630 con 0x7f24a80cae40 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24af90e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f24a806c450 con 0x7f24a80cb5c0 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24adeab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24a80cb9a0 0x7f24a814c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24adeab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24a80cb9a0 0x7f24a814c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33708/0 (socket says 172.21.15.113:33708) 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24adeab640 1 -- 172.21.15.113:0/155977439 learned_addr learned my addr 172.21.15.113:0/155977439 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24ad6aa640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cae40 0x7f24a80c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24acea9640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24a80cb5c0 0x7f24a814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24adeab640 1 -- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24a80cb5c0 msgr2=0x7f24a814bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24adeab640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24a80cb5c0 0x7f24a814bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24adeab640 1 -- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cae40 msgr2=0x7f24a80c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24adeab640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cae40 0x7f24a80c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24adeab640 1 -- 172.21.15.113:0/155977439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a8155a90 con 0x7f24a80cb9a0 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.875+0000 7f24acea9640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24a80cb5c0 0x7f24a814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.876+0000 7f24adeab640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24a80cb9a0 0x7f24a814c1c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f24a002be30 tx=0x7f24a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.876+0000 7f249dffb640 1 -- 172.21.15.113:0/155977439 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0043070 con 0x7f24a80cb9a0 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.876+0000 7f249dffb640 1 -- 172.21.15.113:0/155977439 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a003f870 con 0x7f24a80cb9a0 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.876+0000 7f249dffb640 1 -- 172.21.15.113:0/155977439 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0038040 con 0x7f24a80cb9a0 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.876+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a81f4ad0 con 0x7f24a80cb9a0 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.876+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a81f4db0 con 0x7f24a80cb9a0 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.877+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a814fcf0 con 0x7f24a80cb9a0 2024-04-22T06:32:35.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.877+0000 7f249dffb640 1 -- 172.21.15.113:0/155977439 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24a0046070 con 0x7f24a80cb9a0 2024-04-22T06:32:35.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.878+0000 7f249dffb640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f248c06c8f0 0x7f248c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:35.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.878+0000 7f24ad6aa640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f248c06c8f0 0x7f248c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:35.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.878+0000 7f249dffb640 1 -- 172.21.15.113:0/155977439 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f24a00adbe0 con 0x7f24a80cb9a0 2024-04-22T06:32:35.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.878+0000 7f24ad6aa640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f248c06c8f0 0x7f248c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24a4001350 tx=0x7f24a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:35.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:35.882+0000 7f249dffb640 1 -- 172.21.15.113:0/155977439 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24a814fcf0 con 0x7f24a80cb9a0 2024-04-22T06:32:36.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.058+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f24a806ca70 con 0x7f24a80cb9a0 2024-04-22T06:32:36.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.058+0000 7f249dffb640 1 -- 172.21.15.113:0/155977439 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f24a806ca70 con 0x7f24a80cb9a0 2024-04-22T06:32:36.057 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f248c06c8f0 msgr2=0x7f248c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f248c06c8f0 0x7f248c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24a4001350 tx=0x7f24a4009040 comp rx=0 tx=0).stop 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24a80cb9a0 msgr2=0x7f24a814c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24a80cb9a0 0x7f24a814c1c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f24a002be30 tx=0x7f24a00046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 shutdown_connections 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f248c06c8f0 0x7f248c06edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24a80cb9a0 0x7f24a814c1c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f24a80cb5c0 0x7f24a814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 --2- 172.21.15.113:0/155977439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f24a80cae40 0x7f24a80c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 >> 172.21.15.113:0/155977439 conn(0x7f24a8074d50 msgr2=0x7f24a81524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 shutdown_connections 2024-04-22T06:32:36.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.060+0000 7f24af90e640 1 -- 172.21.15.113:0/155977439 wait complete. 2024-04-22T06:32:36.070 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:32:36.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.171+0000 7f35ac9b2640 1 Processor -- start 2024-04-22T06:32:36.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.171+0000 7f35ac9b2640 1 -- start start 2024-04-22T06:32:36.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35ac9b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f35a8158b10 0x7f35a815b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35ac9b2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a8157d70 con 0x7f35a80c8340 2024-04-22T06:32:36.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35ac9b2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a815be10 con 0x7f35a80c8720 2024-04-22T06:32:36.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35ac9b2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f35a8158680 con 0x7f35a8158b10 2024-04-22T06:32:36.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35a5d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f35a8158b10 0x7f35a815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35a659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f35a80c8340 0x7f35a80723b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45064/0 (socket says 172.21.15.113:45064) 2024-04-22T06:32:36.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35a659c640 1 -- 172.21.15.113:0/3809044652 learned_addr learned my addr 172.21.15.113:0/3809044652 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:36.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35a5d9b640 1 -- 172.21.15.113:0/3809044652 >> v1:172.21.15.145:6789/0 conn(0x7f35a80c8720 legacy=0x7f35a8151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35a5d9b640 1 -- 172.21.15.113:0/3809044652 >> v1:172.21.15.113:6789/0 conn(0x7f35a80c8340 legacy=0x7f35a80723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35a559a640 1 -- 172.21.15.113:0/3809044652 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122171237 0 0) 0x7f35a8157d70 con 0x7f35a80c8340 2024-04-22T06:32:36.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.172+0000 7f35a5d9b640 1 -- 172.21.15.113:0/3809044652 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a815c0f0 con 0x7f35a8158b10 2024-04-22T06:32:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.173+0000 7f35a5d9b640 1 --2- 172.21.15.113:0/3809044652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a8158b10 0x7f35a815b360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f35a8158800 tx=0x7f359c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e834852dff6b820 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.173+0000 7f35a559a640 1 -- 172.21.15.113:0/3809044652 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c035020 con 0x7f35a8158b10 2024-04-22T06:32:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.173+0000 7f35a559a640 1 -- 172.21.15.113:0/3809044652 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c031830 con 0x7f35a8158b10 2024-04-22T06:32:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.173+0000 7f35a559a640 1 -- 172.21.15.113:0/3809044652 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c031c00 con 0x7f35a8158b10 2024-04-22T06:32:36.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.174+0000 7f35ac9b2640 1 -- 172.21.15.113:0/3809044652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a8158b10 msgr2=0x7f35a815b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.174+0000 7f35ac9b2640 1 --2- 172.21.15.113:0/3809044652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a8158b10 0x7f35a815b360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f35a8158800 tx=0x7f359c02b8d0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.174+0000 7f35ac9b2640 1 -- 172.21.15.113:0/3809044652 shutdown_connections 2024-04-22T06:32:36.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.174+0000 7f35ac9b2640 1 --2- 172.21.15.113:0/3809044652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a8158b10 0x7f35a815b360 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.174+0000 7f35ac9b2640 1 -- 172.21.15.113:0/3809044652 >> 172.21.15.113:0/3809044652 conn(0x7f35a806d660 msgr2=0x7f35a8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:36.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.174+0000 7f35ac9b2640 1 -- 172.21.15.113:0/3809044652 shutdown_connections 2024-04-22T06:32:36.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.174+0000 7f35ac9b2640 1 -- 172.21.15.113:0/3809044652 wait complete. 2024-04-22T06:32:36.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.175+0000 7f35ac9b2640 1 Processor -- start 2024-04-22T06:32:36.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.175+0000 7f35ac9b2640 1 -- start start 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35ac9b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a80c8340 0x7f35a814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35ac9b2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35a80c8720 0x7f35a80cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35ac9b2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35a8158b10 0x7f35a80cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35ac9b2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f35a8152220 con 0x7f35a80c8340 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35ac9b2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f35a8158310 con 0x7f35a8158b10 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35ac9b2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f35a81523a0 con 0x7f35a80c8720 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a80c8340 0x7f35a814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a80c8340 0x7f35a814f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33728/0 (socket says 172.21.15.113:33728) 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 -- 172.21.15.113:0/2567635358 learned_addr learned my addr 172.21.15.113:0/2567635358 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a6d9d640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35a8158b10 0x7f35a80cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 -- 172.21.15.113:0/2567635358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35a80c8720 msgr2=0x7f35a80cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35a80c8720 0x7f35a80cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 -- 172.21.15.113:0/2567635358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35a8158b10 msgr2=0x7f35a80cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35a8158b10 0x7f35a80cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 -- 172.21.15.113:0/2567635358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a81f2bc0 con 0x7f35a80c8340 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a6d9d640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35a8158b10 0x7f35a80cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35a659c640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a80c8340 0x7f35a814f7f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c890 tx=0x7f35a000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f3596ffd640 1 -- 172.21.15.113:0/2567635358 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0018070 con 0x7f35a80c8340 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f3596ffd640 1 -- 172.21.15.113:0/2567635358 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a000a640 con 0x7f35a80c8340 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a81f28e0 con 0x7f35a80c8340 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.176+0000 7f3596ffd640 1 -- 172.21.15.113:0/2567635358 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a000aa30 con 0x7f35a80c8340 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.177+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a80cbbf0 con 0x7f35a80c8340 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.177+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a8068f50 con 0x7f35a80c8340 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.178+0000 7f3596ffd640 1 -- 172.21.15.113:0/2567635358 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35a001b070 con 0x7f35a80c8340 2024-04-22T06:32:36.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.178+0000 7f3596ffd640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358806c920 0x7f358806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.178+0000 7f3596ffd640 1 -- 172.21.15.113:0/2567635358 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f35a008b510 con 0x7f35a80c8340 2024-04-22T06:32:36.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.178+0000 7f35a5d9b640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358806c920 0x7f358806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.179+0000 7f35a5d9b640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358806c920 0x7f358806ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f359c036000 tx=0x7f359c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.183+0000 7f3596ffd640 1 -- 172.21.15.113:0/2567635358 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f35a00595d0 con 0x7f35a80c8340 2024-04-22T06:32:36.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.357+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f35a8071830 con 0x7f35a80c8340 2024-04-22T06:32:36.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.357+0000 7f3596ffd640 1 -- 172.21.15.113:0/2567635358 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f35a0058ed0 con 0x7f35a80c8340 2024-04-22T06:32:36.357 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358806c920 msgr2=0x7f358806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358806c920 0x7f358806ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f359c036000 tx=0x7f359c030000 comp rx=0 tx=0).stop 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a80c8340 msgr2=0x7f35a814f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a80c8340 0x7f35a814f7f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c890 tx=0x7f35a000cd50 comp rx=0 tx=0).stop 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 shutdown_connections 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35a8158b10 0x7f35a80cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35a80c8720 0x7f35a80cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358806c920 0x7f358806ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 --2- 172.21.15.113:0/2567635358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35a80c8340 0x7f35a814f7f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 >> 172.21.15.113:0/2567635358 conn(0x7f35a806d660 msgr2=0x7f35a8150940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:36.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 shutdown_connections 2024-04-22T06:32:36.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.359+0000 7f35ac9b2640 1 -- 172.21.15.113:0/2567635358 wait complete. 2024-04-22T06:32:36.369 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:32:36.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.471+0000 7fec4cd5f640 1 Processor -- start 2024-04-22T06:32:36.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.471+0000 7fec4cd5f640 1 -- start start 2024-04-22T06:32:36.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4cd5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec4806cc00 0x7fec4815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4cd5f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cfe0 0x7fec48154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4cd5f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fec480cbc00 0x7fec48155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4cd5f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fec480cd140 con 0x7fec4806cc00 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4cd5f640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fec4815f500 con 0x7fec480cbc00 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4cd5f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fec4815b190 con 0x7fec4806cfe0 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec4806cc00 0x7fec4815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4659c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fec4806cc00 0x7fec4815efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33736/0 (socket says 172.21.15.113:33736) 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4659c640 1 -- 172.21.15.113:0/1277942077 learned_addr learned my addr 172.21.15.113:0/1277942077 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec46d9d640 1 --2- 172.21.15.113:0/1277942077 >> v2:172.21.15.145:3300/0 conn(0x7fec480cbc00 0x7fec48155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec45d9b640 1 --2- 172.21.15.113:0/1277942077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cfe0 0x7fec48154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4659c640 1 -- 172.21.15.113:0/1277942077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cfe0 msgr2=0x7fec48154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4659c640 1 --2- 172.21.15.113:0/1277942077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cfe0 0x7fec48154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4659c640 1 -- 172.21.15.113:0/1277942077 >> v2:172.21.15.145:3300/0 conn(0x7fec480cbc00 msgr2=0x7fec48155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4659c640 1 --2- 172.21.15.113:0/1277942077 >> v2:172.21.15.145:3300/0 conn(0x7fec480cbc00 0x7fec48155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec4659c640 1 -- 172.21.15.113:0/1277942077 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4815b470 con 0x7fec4806cc00 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.472+0000 7fec46d9d640 1 --2- 172.21.15.113:0/1277942077 >> v2:172.21.15.145:3300/0 conn(0x7fec480cbc00 0x7fec48155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.473+0000 7fec4659c640 1 --2- 172.21.15.113:0/1277942077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cc00 0x7fec4815efc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fec480caf10 tx=0x7fec4002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68332b9e4e4a02b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.473+0000 7fec4559a640 1 -- 172.21.15.113:0/1277942077 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4002cb00 con 0x7fec4806cc00 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.473+0000 7fec4559a640 1 -- 172.21.15.113:0/1277942077 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4002cca0 con 0x7fec4806cc00 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.473+0000 7fec4559a640 1 -- 172.21.15.113:0/1277942077 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec40034610 con 0x7fec4806cc00 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 -- 172.21.15.113:0/1277942077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cc00 msgr2=0x7fec4815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/1277942077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cc00 0x7fec4815efc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fec480caf10 tx=0x7fec4002bf60 comp rx=0 tx=0).stop 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 -- 172.21.15.113:0/1277942077 shutdown_connections 2024-04-22T06:32:36.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/1277942077 >> v2:172.21.15.145:3300/0 conn(0x7fec480cbc00 0x7fec48155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/1277942077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cfe0 0x7fec48154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/1277942077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cc00 0x7fec4815efc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 -- 172.21.15.113:0/1277942077 >> 172.21.15.113:0/1277942077 conn(0x7fec48075570 msgr2=0x7fec48073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:36.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 -- 172.21.15.113:0/1277942077 shutdown_connections 2024-04-22T06:32:36.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.474+0000 7fec4cd5f640 1 -- 172.21.15.113:0/1277942077 wait complete. 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.475+0000 7fec4cd5f640 1 Processor -- start 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.475+0000 7fec4cd5f640 1 -- start start 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4cd5f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cc00 0x7fec4815de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4cd5f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cfe0 0x7fec480ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4cd5f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec480cbc00 0x7fec481f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4cd5f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fec4815bd10 con 0x7fec4806cfe0 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4cd5f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fec4815ba30 con 0x7fec480cbc00 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4cd5f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fec480ccbe0 con 0x7fec4806cc00 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cfe0 0x7fec480ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cfe0 0x7fec480ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33738/0 (socket says 172.21.15.113:33738) 2024-04-22T06:32:36.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 -- 172.21.15.113:0/3326318397 learned_addr learned my addr 172.21.15.113:0/3326318397 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec46d9d640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec480cbc00 0x7fec481f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4659c640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cc00 0x7fec4815de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 -- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cc00 msgr2=0x7fec4815de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cc00 0x7fec4815de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 -- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec480cbc00 msgr2=0x7fec481f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec480cbc00 0x7fec481f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 -- 172.21.15.113:0/3326318397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec480ca780 con 0x7fec4806cfe0 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec46d9d640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec480cbc00 0x7fec481f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec45d9b640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cfe0 0x7fec480ceee0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c820 tx=0x7fec3c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec36ffd640 1 -- 172.21.15.113:0/3326318397 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c015070 con 0x7fec4806cfe0 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec36ffd640 1 -- 172.21.15.113:0/3326318397 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c004220 con 0x7fec4806cfe0 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec36ffd640 1 -- 172.21.15.113:0/3326318397 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c00ce10 con 0x7fec4806cfe0 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec480b6350 con 0x7fec4806cfe0 2024-04-22T06:32:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.476+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec480caa20 con 0x7fec4806cfe0 2024-04-22T06:32:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.477+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec480cc2b0 con 0x7fec4806cfe0 2024-04-22T06:32:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.478+0000 7fec36ffd640 1 -- 172.21.15.113:0/3326318397 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec3c007830 con 0x7fec4806cfe0 2024-04-22T06:32:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.478+0000 7fec36ffd640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fec2806c920 0x7fec2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.478+0000 7fec36ffd640 1 -- 172.21.15.113:0/3326318397 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fec3c08be20 con 0x7fec4806cfe0 2024-04-22T06:32:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.478+0000 7fec4659c640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fec2806c920 0x7fec2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.479+0000 7fec4659c640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fec2806c920 0x7fec2806ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fec40035000 tx=0x7fec40030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.483+0000 7fec36ffd640 1 -- 172.21.15.113:0/3326318397 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec3c059dc0 con 0x7fec4806cfe0 2024-04-22T06:32:36.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.654+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fec48068f50 con 0x7fec4806cfe0 2024-04-22T06:32:36.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.654+0000 7fec36ffd640 1 -- 172.21.15.113:0/3326318397 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fec3c0596c0 con 0x7fec4806cfe0 2024-04-22T06:32:36.654 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:36.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fec2806c920 msgr2=0x7fec2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fec2806c920 0x7fec2806ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fec40035000 tx=0x7fec40030000 comp rx=0 tx=0).stop 2024-04-22T06:32:36.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cfe0 msgr2=0x7fec480ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cfe0 0x7fec480ceee0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c820 tx=0x7fec3c00cce0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 shutdown_connections 2024-04-22T06:32:36.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec480cbc00 0x7fec481f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fec2806c920 0x7fec2806ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fec4806cfe0 0x7fec480ceee0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 --2- 172.21.15.113:0/3326318397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec4806cc00 0x7fec4815de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 >> 172.21.15.113:0/3326318397 conn(0x7fec48075570 msgr2=0x7fec480d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:36.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 shutdown_connections 2024-04-22T06:32:36.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.656+0000 7fec4cd5f640 1 -- 172.21.15.113:0/3326318397 wait complete. 2024-04-22T06:32:36.666 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-22T06:32:36.667 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:32:36.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.764+0000 7f8750443640 1 Processor -- start 2024-04-22T06:32:36.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.764+0000 7f8750443640 1 -- start start 2024-04-22T06:32:36.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f8750443640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8748155230 0x7f8748071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f8750443640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815b030 0x7f874815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f8750443640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874806d540 con 0x7f874815f220 2024-04-22T06:32:36.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f8750443640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f87480c9a80 con 0x7f8748155230 2024-04-22T06:32:36.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f8750443640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f874815b4c0 con 0x7f874815b030 2024-04-22T06:32:36.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874e1df640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8748155230 0x7f8748071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874d9de640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815b030 0x7f874815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874e1df640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8748155230 0x7f8748071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.113:36718/0 (socket says 172.21.15.113:36718) 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874e1df640 1 -- 172.21.15.113:0/2315811950 learned_addr learned my addr 172.21.15.113:0/2315811950 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874e1df640 1 -- 172.21.15.113:0/2315811950 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815b030 msgr2=0x7f874815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874e1df640 1 --2- 172.21.15.113:0/2315811950 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815b030 0x7f874815ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874e1df640 1 -- 172.21.15.113:0/2315811950 >> v1:172.21.15.145:6789/0 conn(0x7f874815f220 legacy=0x7f87480cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874e1df640 1 -- 172.21.15.113:0/2315811950 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874815b7a0 con 0x7f8748155230 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874d1dd640 1 -- 172.21.15.113:0/2315811950 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731622290 0 0) 0x7f874806d540 con 0x7f874815f220 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.765+0000 7f874d9de640 1 --2- 172.21.15.113:0/2315811950 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815b030 0x7f874815ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:36.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.766+0000 7f874e1df640 1 --2- 172.21.15.113:0/2315811950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8748155230 0x7f8748071060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8744009870 tx=0x7f874402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d99f6909fad7ea9b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.766+0000 7f874d1dd640 1 -- 172.21.15.113:0/2315811950 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744034070 con 0x7f8748155230 2024-04-22T06:32:36.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.766+0000 7f874d1dd640 1 -- 172.21.15.113:0/2315811950 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8744030840 con 0x7f8748155230 2024-04-22T06:32:36.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.766+0000 7f874d1dd640 1 -- 172.21.15.113:0/2315811950 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744030c10 con 0x7f8748155230 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.767+0000 7f8750443640 1 -- 172.21.15.113:0/2315811950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8748155230 msgr2=0x7f8748071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.767+0000 7f8750443640 1 --2- 172.21.15.113:0/2315811950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8748155230 0x7f8748071060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8744009870 tx=0x7f874402b980 comp rx=0 tx=0).stop 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.767+0000 7f8750443640 1 -- 172.21.15.113:0/2315811950 shutdown_connections 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.767+0000 7f8750443640 1 --2- 172.21.15.113:0/2315811950 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815b030 0x7f874815ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.767+0000 7f8750443640 1 --2- 172.21.15.113:0/2315811950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8748155230 0x7f8748071060 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.767+0000 7f8750443640 1 -- 172.21.15.113:0/2315811950 >> 172.21.15.113:0/2315811950 conn(0x7f8748074f30 msgr2=0x7f8748075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.767+0000 7f8750443640 1 -- 172.21.15.113:0/2315811950 shutdown_connections 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.767+0000 7f8750443640 1 -- 172.21.15.113:0/2315811950 wait complete. 2024-04-22T06:32:36.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.768+0000 7f8750443640 1 Processor -- start 2024-04-22T06:32:36.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.768+0000 7f8750443640 1 -- start start 2024-04-22T06:32:36.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f8750443640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8748155230 0x7f87481e7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f8750443640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815f220 0x7f87481e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f8750443640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87481e5410 0x7f87480ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f8750443640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f874815e7c0 con 0x7f8748155230 2024-04-22T06:32:36.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f8750443640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f874815bd60 con 0x7f87481e5410 2024-04-22T06:32:36.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f8750443640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f87480715a0 con 0x7f874815f220 2024-04-22T06:32:36.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8748155230 0x7f87481e7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8748155230 0x7f87481e7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33748/0 (socket says 172.21.15.113:33748) 2024-04-22T06:32:36.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 -- 172.21.15.113:0/2767630435 learned_addr learned my addr 172.21.15.113:0/2767630435 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:36.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e9e0640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87481e5410 0x7f87480ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874d9de640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815f220 0x7f87481e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 -- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815f220 msgr2=0x7f87481e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815f220 0x7f87481e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 -- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87481e5410 msgr2=0x7f87480ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87481e5410 0x7f87480ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 -- 172.21.15.113:0/2767630435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87480ccfc0 con 0x7f8748155230 2024-04-22T06:32:36.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e9e0640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87481e5410 0x7f87480ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:36.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.769+0000 7f874e1df640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8748155230 0x7f87481e7d10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f87440090b0 tx=0x7f87440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.770+0000 7f873effd640 1 -- 172.21.15.113:0/2767630435 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744034040 con 0x7f8748155230 2024-04-22T06:32:36.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.770+0000 7f873effd640 1 -- 172.21.15.113:0/2767630435 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f874403ab90 con 0x7f8748155230 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.770+0000 7f873effd640 1 -- 172.21.15.113:0/2767630435 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744004030 con 0x7f8748155230 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.770+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87480c56d0 con 0x7f8748155230 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.770+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87480cd230 con 0x7f8748155230 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.770+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8748068e40 con 0x7f8748155230 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.771+0000 7f873effd640 1 -- 172.21.15.113:0/2767630435 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8744037070 con 0x7f8748155230 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.771+0000 7f873effd640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f872c06c920 0x7f872c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.771+0000 7f873effd640 1 -- 172.21.15.113:0/2767630435 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f87440add50 con 0x7f8748155230 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.771+0000 7f874d9de640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f872c06c920 0x7f872c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:36.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.772+0000 7f874d9de640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f872c06c920 0x7f872c06ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8738009560 tx=0x7f8738008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:36.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.776+0000 7f873effd640 1 -- 172.21.15.113:0/2767630435 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87440b1030 con 0x7f8748155230 2024-04-22T06:32:36.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.947+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f874806d180 con 0x7f872c06c920 2024-04-22T06:32:36.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.954+0000 7f873effd640 1 -- 172.21.15.113:0/2767630435 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332634 (secure 0 0 0) 0x7f874806d180 con 0x7f872c06c920 2024-04-22T06:32:36.958 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:36.960 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:32:36.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f872c06c920 msgr2=0x7f872c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f872c06c920 0x7f872c06ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8738009560 tx=0x7f8738008040 comp rx=0 tx=0).stop 2024-04-22T06:32:36.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8748155230 msgr2=0x7f87481e7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8748155230 0x7f87481e7d10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f87440090b0 tx=0x7f87440046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 shutdown_connections 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87481e5410 0x7f87480ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f874815f220 0x7f87481e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f872c06c920 0x7f872c06ede0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 --2- 172.21.15.113:0/2767630435 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8748155230 0x7f87481e7d10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 >> 172.21.15.113:0/2767630435 conn(0x7f8748074f30 msgr2=0x7f8748152090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 shutdown_connections 2024-04-22T06:32:36.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:36.958+0000 7f8750443640 1 -- 172.21.15.113:0/2767630435 wait complete. 2024-04-22T06:32:36.968 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-04-22T06:32:34.981453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219720,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755000,"statfs":{"total":773094113280,"available":772869120000,"internally_reserved":0,"allocated":3678208,"data_stored":2119239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002568"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979849+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:32:24.979849+0000","last_peered":"2024-04-22T06:32:24.979849+0000","last_clean":"2024-04-22T06:32:24.979849+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:32:24.979849+0000","last_undegraded":"2024-04-22T06:32:24.979849+0000","last_fullsized":"2024-04-22T06:32:24.979849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966555+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:32:18.966555+0000","last_peered":"2024-04-22T06:32:18.966555+0000","last_clean":"2024-04-22T06:32:18.966555+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:32:18.966555+0000","last_undegraded":"2024-04-22T06:32:18.966555+0000","last_fullsized":"2024-04-22T06:32:18.966555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965851+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:32:18.965851+0000","last_peered":"2024-04-22T06:32:18.965851+0000","last_clean":"2024-04-22T06:32:18.965851+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:32:18.965851+0000","last_undegraded":"2024-04-22T06:32:18.965851+0000","last_fullsized":"2024-04-22T06:32:18.965851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966745+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:32:18.966745+0000","last_peered":"2024-04-22T06:32:18.966745+0000","last_clean":"2024-04-22T06:32:18.966745+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:32:18.966745+0000","last_undegraded":"2024-04-22T06:32:18.966745+0000","last_fullsized":"2024-04-22T06:32:18.966745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981681+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:32:18.981681+0000","last_peered":"2024-04-22T06:32:18.981681+0000","last_clean":"2024-04-22T06:32:18.981681+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:32:18.981681+0000","last_undegraded":"2024-04-22T06:32:18.981681+0000","last_fullsized":"2024-04-22T06:32:18.981681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149424+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:32:19.149424+0000","last_peered":"2024-04-22T06:32:19.149424+0000","last_clean":"2024-04-22T06:32:19.149424+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:32:19.149424+0000","last_undegraded":"2024-04-22T06:32:19.149424+0000","last_fullsized":"2024-04-22T06:32:19.149424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982683+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:32:24.982683+0000","last_peered":"2024-04-22T06:32:24.982683+0000","last_clean":"2024-04-22T06:32:24.982683+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:32:24.982683+0000","last_undegraded":"2024-04-22T06:32:24.982683+0000","last_fullsized":"2024-04-22T06:32:24.982683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151734+0000","last_change":"2024-04-22T06:32:19.150976+0000","last_active":"2024-04-22T06:32:19.151734+0000","last_peered":"2024-04-22T06:32:19.151734+0000","last_clean":"2024-04-22T06:32:19.151734+0000","last_became_active":"2024-04-22T06:32:19.150701+0000","last_became_peered":"2024-04-22T06:32:19.150701+0000","last_unstale":"2024-04-22T06:32:19.151734+0000","last_undegraded":"2024-04-22T06:32:19.151734+0000","last_fullsized":"2024-04-22T06:32:19.151734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:03:07.842684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149873+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:32:19.149873+0000","last_peered":"2024-04-22T06:32:19.149873+0000","last_clean":"2024-04-22T06:32:19.149873+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:32:19.149873+0000","last_undegraded":"2024-04-22T06:32:19.149873+0000","last_fullsized":"2024-04-22T06:32:19.149873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979700+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:32:24.979700+0000","last_peered":"2024-04-22T06:32:24.979700+0000","last_clean":"2024-04-22T06:32:24.979700+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:32:24.979700+0000","last_undegraded":"2024-04-22T06:32:24.979700+0000","last_fullsized":"2024-04-22T06:32:24.979700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967622+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:32:18.967622+0000","last_peered":"2024-04-22T06:32:18.967622+0000","last_clean":"2024-04-22T06:32:18.967622+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:32:18.967622+0000","last_undegraded":"2024-04-22T06:32:18.967622+0000","last_fullsized":"2024-04-22T06:32:18.967622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149778+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:32:19.149778+0000","last_peered":"2024-04-22T06:32:19.149778+0000","last_clean":"2024-04-22T06:32:19.149778+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:32:19.149778+0000","last_undegraded":"2024-04-22T06:32:19.149778+0000","last_fullsized":"2024-04-22T06:32:19.149778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966853+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:32:18.966853+0000","last_peered":"2024-04-22T06:32:18.966853+0000","last_clean":"2024-04-22T06:32:18.966853+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:32:18.966853+0000","last_undegraded":"2024-04-22T06:32:18.966853+0000","last_fullsized":"2024-04-22T06:32:18.966853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294409+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:32:19.294409+0000","last_peered":"2024-04-22T06:32:19.294409+0000","last_clean":"2024-04-22T06:32:19.294409+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:32:19.294409+0000","last_undegraded":"2024-04-22T06:32:19.294409+0000","last_fullsized":"2024-04-22T06:32:19.294409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150210+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:32:19.150210+0000","last_peered":"2024-04-22T06:32:19.150210+0000","last_clean":"2024-04-22T06:32:19.150210+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:32:19.150210+0000","last_undegraded":"2024-04-22T06:32:19.150210+0000","last_fullsized":"2024-04-22T06:32:19.150210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966124+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:32:18.966124+0000","last_peered":"2024-04-22T06:32:18.966124+0000","last_clean":"2024-04-22T06:32:18.966124+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:32:18.966124+0000","last_undegraded":"2024-04-22T06:32:18.966124+0000","last_fullsized":"2024-04-22T06:32:18.966124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969749+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:32:18.969749+0000","last_peered":"2024-04-22T06:32:18.969749+0000","last_clean":"2024-04-22T06:32:18.969749+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:32:18.969749+0000","last_undegraded":"2024-04-22T06:32:18.969749+0000","last_fullsized":"2024-04-22T06:32:18.969749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150005+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:32:19.150005+0000","last_peered":"2024-04-22T06:32:19.150005+0000","last_clean":"2024-04-22T06:32:19.150005+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:32:19.150005+0000","last_undegraded":"2024-04-22T06:32:19.150005+0000","last_fullsized":"2024-04-22T06:32:19.150005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966111+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:32:18.966111+0000","last_peered":"2024-04-22T06:32:18.966111+0000","last_clean":"2024-04-22T06:32:18.966111+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:32:18.966111+0000","last_undegraded":"2024-04-22T06:32:18.966111+0000","last_fullsized":"2024-04-22T06:32:18.966111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978562+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:32:24.978562+0000","last_peered":"2024-04-22T06:32:24.978562+0000","last_clean":"2024-04-22T06:32:24.978562+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:32:24.978562+0000","last_undegraded":"2024-04-22T06:32:24.978562+0000","last_fullsized":"2024-04-22T06:32:24.978562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969457+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:32:18.969457+0000","last_peered":"2024-04-22T06:32:18.969457+0000","last_clean":"2024-04-22T06:32:18.969457+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:32:18.969457+0000","last_undegraded":"2024-04-22T06:32:18.969457+0000","last_fullsized":"2024-04-22T06:32:18.969457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149852+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:32:19.149852+0000","last_peered":"2024-04-22T06:32:19.149852+0000","last_clean":"2024-04-22T06:32:19.149852+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:32:19.149852+0000","last_undegraded":"2024-04-22T06:32:19.149852+0000","last_fullsized":"2024-04-22T06:32:19.149852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.293907+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:32:19.293907+0000","last_peered":"2024-04-22T06:32:19.293907+0000","last_clean":"2024-04-22T06:32:19.293907+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:32:19.293907+0000","last_undegraded":"2024-04-22T06:32:19.293907+0000","last_fullsized":"2024-04-22T06:32:19.293907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150066+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:32:19.150066+0000","last_peered":"2024-04-22T06:32:19.150066+0000","last_clean":"2024-04-22T06:32:19.150066+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:32:19.150066+0000","last_undegraded":"2024-04-22T06:32:19.150066+0000","last_fullsized":"2024-04-22T06:32:19.150066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981653+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:32:18.981653+0000","last_peered":"2024-04-22T06:32:18.981653+0000","last_clean":"2024-04-22T06:32:18.981653+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:32:18.981653+0000","last_undegraded":"2024-04-22T06:32:18.981653+0000","last_fullsized":"2024-04-22T06:32:18.981653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.981798+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:32:24.981798+0000","last_peered":"2024-04-22T06:32:24.981798+0000","last_clean":"2024-04-22T06:32:24.981798+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:32:24.981798+0000","last_undegraded":"2024-04-22T06:32:24.981798+0000","last_fullsized":"2024-04-22T06:32:24.981798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149673+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:32:19.149673+0000","last_peered":"2024-04-22T06:32:19.149673+0000","last_clean":"2024-04-22T06:32:19.149673+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:32:19.149673+0000","last_undegraded":"2024-04-22T06:32:19.149673+0000","last_fullsized":"2024-04-22T06:32:19.149673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966813+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:32:18.966813+0000","last_peered":"2024-04-22T06:32:18.966813+0000","last_clean":"2024-04-22T06:32:18.966813+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:32:18.966813+0000","last_undegraded":"2024-04-22T06:32:18.966813+0000","last_fullsized":"2024-04-22T06:32:18.966813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969615+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:32:18.969615+0000","last_peered":"2024-04-22T06:32:18.969615+0000","last_clean":"2024-04-22T06:32:18.969615+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:32:18.969615+0000","last_undegraded":"2024-04-22T06:32:18.969615+0000","last_fullsized":"2024-04-22T06:32:18.969615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965797+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:32:18.965797+0000","last_peered":"2024-04-22T06:32:18.965797+0000","last_clean":"2024-04-22T06:32:18.965797+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:32:18.965797+0000","last_undegraded":"2024-04-22T06:32:18.965797+0000","last_fullsized":"2024-04-22T06:32:18.965797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969571+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:32:18.969571+0000","last_peered":"2024-04-22T06:32:18.969571+0000","last_clean":"2024-04-22T06:32:18.969571+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:32:18.969571+0000","last_undegraded":"2024-04-22T06:32:18.969571+0000","last_fullsized":"2024-04-22T06:32:18.969571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294699+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:32:19.294699+0000","last_peered":"2024-04-22T06:32:19.294699+0000","last_clean":"2024-04-22T06:32:19.294699+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:32:19.294699+0000","last_undegraded":"2024-04-22T06:32:19.294699+0000","last_fullsized":"2024-04-22T06:32:19.294699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981307+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:32:18.981307+0000","last_peered":"2024-04-22T06:32:18.981307+0000","last_clean":"2024-04-22T06:32:18.981307+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:32:18.981307+0000","last_undegraded":"2024-04-22T06:32:18.981307+0000","last_fullsized":"2024-04-22T06:32:18.981307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967531+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:32:18.967531+0000","last_peered":"2024-04-22T06:32:18.967531+0000","last_clean":"2024-04-22T06:32:18.967531+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:32:18.967531+0000","last_undegraded":"2024-04-22T06:32:18.967531+0000","last_fullsized":"2024-04-22T06:32:18.967531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969637+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:32:18.969637+0000","last_peered":"2024-04-22T06:32:18.969637+0000","last_clean":"2024-04-22T06:32:18.969637+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:32:18.969637+0000","last_undegraded":"2024-04-22T06:32:18.969637+0000","last_fullsized":"2024-04-22T06:32:18.969637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969213+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:32:18.969213+0000","last_peered":"2024-04-22T06:32:18.969213+0000","last_clean":"2024-04-22T06:32:18.969213+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:32:18.969213+0000","last_undegraded":"2024-04-22T06:32:18.969213+0000","last_fullsized":"2024-04-22T06:32:18.969213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150313+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:32:19.150313+0000","last_peered":"2024-04-22T06:32:19.150313+0000","last_clean":"2024-04-22T06:32:19.150313+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:32:19.150313+0000","last_undegraded":"2024-04-22T06:32:19.150313+0000","last_fullsized":"2024-04-22T06:32:19.150313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978693+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:32:24.978693+0000","last_peered":"2024-04-22T06:32:24.978693+0000","last_clean":"2024-04-22T06:32:24.978693+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:32:24.978693+0000","last_undegraded":"2024-04-22T06:32:24.978693+0000","last_fullsized":"2024-04-22T06:32:24.978693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969492+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:32:18.969492+0000","last_peered":"2024-04-22T06:32:18.969492+0000","last_clean":"2024-04-22T06:32:18.969492+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:32:18.969492+0000","last_undegraded":"2024-04-22T06:32:18.969492+0000","last_fullsized":"2024-04-22T06:32:18.969492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968986+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:32:18.968986+0000","last_peered":"2024-04-22T06:32:18.968986+0000","last_clean":"2024-04-22T06:32:18.968986+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:32:18.968986+0000","last_undegraded":"2024-04-22T06:32:18.968986+0000","last_fullsized":"2024-04-22T06:32:18.968986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978504+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:32:24.978504+0000","last_peered":"2024-04-22T06:32:24.978504+0000","last_clean":"2024-04-22T06:32:24.978504+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:32:24.978504+0000","last_undegraded":"2024-04-22T06:32:24.978504+0000","last_fullsized":"2024-04-22T06:32:24.978504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969478+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:32:18.969478+0000","last_peered":"2024-04-22T06:32:18.969478+0000","last_clean":"2024-04-22T06:32:18.969478+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:32:18.969478+0000","last_undegraded":"2024-04-22T06:32:18.969478+0000","last_fullsized":"2024-04-22T06:32:18.969478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981002+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:32:18.981002+0000","last_peered":"2024-04-22T06:32:18.981002+0000","last_clean":"2024-04-22T06:32:18.981002+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:32:18.981002+0000","last_undegraded":"2024-04-22T06:32:18.981002+0000","last_fullsized":"2024-04-22T06:32:18.981002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294057+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:32:19.294057+0000","last_peered":"2024-04-22T06:32:19.294057+0000","last_clean":"2024-04-22T06:32:19.294057+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:32:19.294057+0000","last_undegraded":"2024-04-22T06:32:19.294057+0000","last_fullsized":"2024-04-22T06:32:19.294057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981530+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:32:18.981530+0000","last_peered":"2024-04-22T06:32:18.981530+0000","last_clean":"2024-04-22T06:32:18.981530+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:32:18.981530+0000","last_undegraded":"2024-04-22T06:32:18.981530+0000","last_fullsized":"2024-04-22T06:32:18.981530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966072+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:32:18.966072+0000","last_peered":"2024-04-22T06:32:18.966072+0000","last_clean":"2024-04-22T06:32:18.966072+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:32:18.966072+0000","last_undegraded":"2024-04-22T06:32:18.966072+0000","last_fullsized":"2024-04-22T06:32:18.966072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967351+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:32:18.967351+0000","last_peered":"2024-04-22T06:32:18.967351+0000","last_clean":"2024-04-22T06:32:18.967351+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:32:18.967351+0000","last_undegraded":"2024-04-22T06:32:18.967351+0000","last_fullsized":"2024-04-22T06:32:18.967351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294046+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:32:19.294046+0000","last_peered":"2024-04-22T06:32:19.294046+0000","last_clean":"2024-04-22T06:32:19.294046+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:32:19.294046+0000","last_undegraded":"2024-04-22T06:32:19.294046+0000","last_fullsized":"2024-04-22T06:32:19.294046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968137+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:32:18.968137+0000","last_peered":"2024-04-22T06:32:18.968137+0000","last_clean":"2024-04-22T06:32:18.968137+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:32:18.968137+0000","last_undegraded":"2024-04-22T06:32:18.968137+0000","last_fullsized":"2024-04-22T06:32:18.968137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294428+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:32:19.294428+0000","last_peered":"2024-04-22T06:32:19.294428+0000","last_clean":"2024-04-22T06:32:19.294428+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:32:19.294428+0000","last_undegraded":"2024-04-22T06:32:19.294428+0000","last_fullsized":"2024-04-22T06:32:19.294428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968415+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:32:18.968415+0000","last_peered":"2024-04-22T06:32:18.968415+0000","last_clean":"2024-04-22T06:32:18.968415+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:32:18.968415+0000","last_undegraded":"2024-04-22T06:32:18.968415+0000","last_fullsized":"2024-04-22T06:32:18.968415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966730+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:32:18.966730+0000","last_peered":"2024-04-22T06:32:18.966730+0000","last_clean":"2024-04-22T06:32:18.966730+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:32:18.966730+0000","last_undegraded":"2024-04-22T06:32:18.966730+0000","last_fullsized":"2024-04-22T06:32:18.966730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967818+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:32:18.967818+0000","last_peered":"2024-04-22T06:32:18.967818+0000","last_clean":"2024-04-22T06:32:18.967818+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:32:18.967818+0000","last_undegraded":"2024-04-22T06:32:18.967818+0000","last_fullsized":"2024-04-22T06:32:18.967818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969689+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:32:18.969689+0000","last_peered":"2024-04-22T06:32:18.969689+0000","last_clean":"2024-04-22T06:32:18.969689+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:32:18.969689+0000","last_undegraded":"2024-04-22T06:32:18.969689+0000","last_fullsized":"2024-04-22T06:32:18.969689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981441+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:32:18.981441+0000","last_peered":"2024-04-22T06:32:18.981441+0000","last_clean":"2024-04-22T06:32:18.981441+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:32:18.981441+0000","last_undegraded":"2024-04-22T06:32:18.981441+0000","last_fullsized":"2024-04-22T06:32:18.981441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151685+0000","last_change":"2024-04-22T06:32:19.151055+0000","last_active":"2024-04-22T06:32:19.151685+0000","last_peered":"2024-04-22T06:32:19.151685+0000","last_clean":"2024-04-22T06:32:19.151685+0000","last_became_active":"2024-04-22T06:32:19.150732+0000","last_became_peered":"2024-04-22T06:32:19.150732+0000","last_unstale":"2024-04-22T06:32:19.151685+0000","last_undegraded":"2024-04-22T06:32:19.151685+0000","last_fullsized":"2024-04-22T06:32:19.151685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:52:54.156456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.975775+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:32:24.975775+0000","last_peered":"2024-04-22T06:32:24.975775+0000","last_clean":"2024-04-22T06:32:24.975775+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:32:24.975775+0000","last_undegraded":"2024-04-22T06:32:24.975775+0000","last_fullsized":"2024-04-22T06:32:24.975775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966483+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:32:18.966483+0000","last_peered":"2024-04-22T06:32:18.966483+0000","last_clean":"2024-04-22T06:32:18.966483+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:32:18.966483+0000","last_undegraded":"2024-04-22T06:32:18.966483+0000","last_fullsized":"2024-04-22T06:32:18.966483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294596+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:32:19.294596+0000","last_peered":"2024-04-22T06:32:19.294596+0000","last_clean":"2024-04-22T06:32:19.294596+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:32:19.294596+0000","last_undegraded":"2024-04-22T06:32:19.294596+0000","last_fullsized":"2024-04-22T06:32:19.294596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150264+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:32:19.150264+0000","last_peered":"2024-04-22T06:32:19.150264+0000","last_clean":"2024-04-22T06:32:19.150264+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:32:19.150264+0000","last_undegraded":"2024-04-22T06:32:19.150264+0000","last_fullsized":"2024-04-22T06:32:19.150264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149416+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:32:19.149416+0000","last_peered":"2024-04-22T06:32:19.149416+0000","last_clean":"2024-04-22T06:32:19.149416+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:32:19.149416+0000","last_undegraded":"2024-04-22T06:32:19.149416+0000","last_fullsized":"2024-04-22T06:32:19.149416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294298+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:32:19.294298+0000","last_peered":"2024-04-22T06:32:19.294298+0000","last_clean":"2024-04-22T06:32:19.294298+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:32:19.294298+0000","last_undegraded":"2024-04-22T06:32:19.294298+0000","last_fullsized":"2024-04-22T06:32:19.294298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968595+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:32:18.968595+0000","last_peered":"2024-04-22T06:32:18.968595+0000","last_clean":"2024-04-22T06:32:18.968595+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:32:18.968595+0000","last_undegraded":"2024-04-22T06:32:18.968595+0000","last_fullsized":"2024-04-22T06:32:18.968595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981432+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:32:18.981432+0000","last_peered":"2024-04-22T06:32:18.981432+0000","last_clean":"2024-04-22T06:32:18.981432+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:32:18.981432+0000","last_undegraded":"2024-04-22T06:32:18.981432+0000","last_fullsized":"2024-04-22T06:32:18.981432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967559+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:32:18.967559+0000","last_peered":"2024-04-22T06:32:18.967559+0000","last_clean":"2024-04-22T06:32:18.967559+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:32:18.967559+0000","last_undegraded":"2024-04-22T06:32:18.967559+0000","last_fullsized":"2024-04-22T06:32:18.967559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967066+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:32:18.967066+0000","last_peered":"2024-04-22T06:32:18.967066+0000","last_clean":"2024-04-22T06:32:18.967066+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:32:18.967066+0000","last_undegraded":"2024-04-22T06:32:18.967066+0000","last_fullsized":"2024-04-22T06:32:18.967066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966623+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:32:18.966623+0000","last_peered":"2024-04-22T06:32:18.966623+0000","last_clean":"2024-04-22T06:32:18.966623+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:32:18.966623+0000","last_undegraded":"2024-04-22T06:32:18.966623+0000","last_fullsized":"2024-04-22T06:32:18.966623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294251+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:32:19.294251+0000","last_peered":"2024-04-22T06:32:19.294251+0000","last_clean":"2024-04-22T06:32:19.294251+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:32:19.294251+0000","last_undegraded":"2024-04-22T06:32:19.294251+0000","last_fullsized":"2024-04-22T06:32:19.294251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967610+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:32:18.967610+0000","last_peered":"2024-04-22T06:32:18.967610+0000","last_clean":"2024-04-22T06:32:18.967610+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:32:18.967610+0000","last_undegraded":"2024-04-22T06:32:18.967610+0000","last_fullsized":"2024-04-22T06:32:18.967610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966452+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:32:18.966452+0000","last_peered":"2024-04-22T06:32:18.966452+0000","last_clean":"2024-04-22T06:32:18.966452+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:32:18.966452+0000","last_undegraded":"2024-04-22T06:32:18.966452+0000","last_fullsized":"2024-04-22T06:32:18.966452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981284+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:32:18.981284+0000","last_peered":"2024-04-22T06:32:18.981284+0000","last_clean":"2024-04-22T06:32:18.981284+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:32:18.981284+0000","last_undegraded":"2024-04-22T06:32:18.981284+0000","last_fullsized":"2024-04-22T06:32:18.981284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.976916+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:32:24.976916+0000","last_peered":"2024-04-22T06:32:24.976916+0000","last_clean":"2024-04-22T06:32:24.976916+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:32:24.976916+0000","last_undegraded":"2024-04-22T06:32:24.976916+0000","last_fullsized":"2024-04-22T06:32:24.976916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967410+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:32:18.967410+0000","last_peered":"2024-04-22T06:32:18.967410+0000","last_clean":"2024-04-22T06:32:18.967410+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:32:18.967410+0000","last_undegraded":"2024-04-22T06:32:18.967410+0000","last_fullsized":"2024-04-22T06:32:18.967410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294312+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:32:19.294312+0000","last_peered":"2024-04-22T06:32:19.294312+0000","last_clean":"2024-04-22T06:32:19.294312+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:32:19.294312+0000","last_undegraded":"2024-04-22T06:32:19.294312+0000","last_fullsized":"2024-04-22T06:32:19.294312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.261148+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:32:33.261148+0000","last_peered":"2024-04-22T06:32:33.261148+0000","last_clean":"2024-04-22T06:32:33.261148+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:32:33.261148+0000","last_undegraded":"2024-04-22T06:32:33.261148+0000","last_fullsized":"2024-04-22T06:32:33.261148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969452+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:32:18.969452+0000","last_peered":"2024-04-22T06:32:18.969452+0000","last_clean":"2024-04-22T06:32:18.969452+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:32:18.969452+0000","last_undegraded":"2024-04-22T06:32:18.969452+0000","last_fullsized":"2024-04-22T06:32:18.969452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150153+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:32:19.150153+0000","last_peered":"2024-04-22T06:32:19.150153+0000","last_clean":"2024-04-22T06:32:19.150153+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:32:19.150153+0000","last_undegraded":"2024-04-22T06:32:19.150153+0000","last_fullsized":"2024-04-22T06:32:19.150153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969410+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:32:18.969410+0000","last_peered":"2024-04-22T06:32:18.969410+0000","last_clean":"2024-04-22T06:32:18.969410+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:32:18.969410+0000","last_undegraded":"2024-04-22T06:32:18.969410+0000","last_fullsized":"2024-04-22T06:32:18.969410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150044+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:32:19.150044+0000","last_peered":"2024-04-22T06:32:19.150044+0000","last_clean":"2024-04-22T06:32:19.150044+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:32:19.150044+0000","last_undegraded":"2024-04-22T06:32:19.150044+0000","last_fullsized":"2024-04-22T06:32:19.150044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981777+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:32:18.981777+0000","last_peered":"2024-04-22T06:32:18.981777+0000","last_clean":"2024-04-22T06:32:18.981777+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:32:18.981777+0000","last_undegraded":"2024-04-22T06:32:18.981777+0000","last_fullsized":"2024-04-22T06:32:18.981777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979367+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:32:24.979367+0000","last_peered":"2024-04-22T06:32:24.979367+0000","last_clean":"2024-04-22T06:32:24.979367+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:32:24.979367+0000","last_undegraded":"2024-04-22T06:32:24.979367+0000","last_fullsized":"2024-04-22T06:32:24.979367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965918+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:32:18.965918+0000","last_peered":"2024-04-22T06:32:18.965918+0000","last_clean":"2024-04-22T06:32:18.965918+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:32:18.965918+0000","last_undegraded":"2024-04-22T06:32:18.965918+0000","last_fullsized":"2024-04-22T06:32:18.965918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967599+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:32:18.967599+0000","last_peered":"2024-04-22T06:32:18.967599+0000","last_clean":"2024-04-22T06:32:18.967599+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:32:18.967599+0000","last_undegraded":"2024-04-22T06:32:18.967599+0000","last_fullsized":"2024-04-22T06:32:18.967599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968898+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:32:18.968898+0000","last_peered":"2024-04-22T06:32:18.968898+0000","last_clean":"2024-04-22T06:32:18.968898+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:32:18.968898+0000","last_undegraded":"2024-04-22T06:32:18.968898+0000","last_fullsized":"2024-04-22T06:32:18.968898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965891+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:32:18.965891+0000","last_peered":"2024-04-22T06:32:18.965891+0000","last_clean":"2024-04-22T06:32:18.965891+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:32:18.965891+0000","last_undegraded":"2024-04-22T06:32:18.965891+0000","last_fullsized":"2024-04-22T06:32:18.965891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981056+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:32:18.981056+0000","last_peered":"2024-04-22T06:32:18.981056+0000","last_clean":"2024-04-22T06:32:18.981056+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:32:18.981056+0000","last_undegraded":"2024-04-22T06:32:18.981056+0000","last_fullsized":"2024-04-22T06:32:18.981056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968899+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:32:18.968899+0000","last_peered":"2024-04-22T06:32:18.968899+0000","last_clean":"2024-04-22T06:32:18.968899+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:32:18.968899+0000","last_undegraded":"2024-04-22T06:32:18.968899+0000","last_fullsized":"2024-04-22T06:32:18.968899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966973+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:32:18.966973+0000","last_peered":"2024-04-22T06:32:18.966973+0000","last_clean":"2024-04-22T06:32:18.966973+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:32:18.966973+0000","last_undegraded":"2024-04-22T06:32:18.966973+0000","last_fullsized":"2024-04-22T06:32:18.966973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.982812+0000","last_change":"2024-04-22T06:32:18.982812+0000","last_active":"2024-04-22T06:32:18.982812+0000","last_peered":"2024-04-22T06:32:18.982812+0000","last_clean":"2024-04-22T06:32:18.982812+0000","last_became_active":"2024-04-22T06:32:18.982355+0000","last_became_peered":"2024-04-22T06:32:18.982355+0000","last_unstale":"2024-04-22T06:32:18.982812+0000","last_undegraded":"2024-04-22T06:32:18.982812+0000","last_fullsized":"2024-04-22T06:32:18.982812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:01:41.368881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966015+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:32:18.966015+0000","last_peered":"2024-04-22T06:32:18.966015+0000","last_clean":"2024-04-22T06:32:18.966015+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:32:18.966015+0000","last_undegraded":"2024-04-22T06:32:18.966015+0000","last_fullsized":"2024-04-22T06:32:18.966015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966324+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:32:18.966324+0000","last_peered":"2024-04-22T06:32:18.966324+0000","last_clean":"2024-04-22T06:32:18.966324+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:32:18.966324+0000","last_undegraded":"2024-04-22T06:32:18.966324+0000","last_fullsized":"2024-04-22T06:32:18.966324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967052+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:32:18.967052+0000","last_peered":"2024-04-22T06:32:18.967052+0000","last_clean":"2024-04-22T06:32:18.967052+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:32:18.967052+0000","last_undegraded":"2024-04-22T06:32:18.967052+0000","last_fullsized":"2024-04-22T06:32:18.967052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981529+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:32:18.981529+0000","last_peered":"2024-04-22T06:32:18.981529+0000","last_clean":"2024-04-22T06:32:18.981529+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:32:18.981529+0000","last_undegraded":"2024-04-22T06:32:18.981529+0000","last_fullsized":"2024-04-22T06:32:18.981529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.982586+0000","last_change":"2024-04-22T06:32:18.982586+0000","last_active":"2024-04-22T06:32:18.982586+0000","last_peered":"2024-04-22T06:32:18.982586+0000","last_clean":"2024-04-22T06:32:18.982586+0000","last_became_active":"2024-04-22T06:32:18.982159+0000","last_became_peered":"2024-04-22T06:32:18.982159+0000","last_unstale":"2024-04-22T06:32:18.982586+0000","last_undegraded":"2024-04-22T06:32:18.982586+0000","last_fullsized":"2024-04-22T06:32:18.982586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:37.104899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966312+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:32:18.966312+0000","last_peered":"2024-04-22T06:32:18.966312+0000","last_clean":"2024-04-22T06:32:18.966312+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:32:18.966312+0000","last_undegraded":"2024-04-22T06:32:18.966312+0000","last_fullsized":"2024-04-22T06:32:18.966312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149928+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:32:19.149928+0000","last_peered":"2024-04-22T06:32:19.149928+0000","last_clean":"2024-04-22T06:32:19.149928+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:32:19.149928+0000","last_undegraded":"2024-04-22T06:32:19.149928+0000","last_fullsized":"2024-04-22T06:32:19.149928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151801+0000","last_change":"2024-04-22T06:32:19.151801+0000","last_active":"2024-04-22T06:32:19.151801+0000","last_peered":"2024-04-22T06:32:19.151801+0000","last_clean":"2024-04-22T06:32:19.151801+0000","last_became_active":"2024-04-22T06:32:19.151353+0000","last_became_peered":"2024-04-22T06:32:19.151353+0000","last_unstale":"2024-04-22T06:32:19.151801+0000","last_undegraded":"2024-04-22T06:32:19.151801+0000","last_fullsized":"2024-04-22T06:32:19.151801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:11.699970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967391+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:32:18.967391+0000","last_peered":"2024-04-22T06:32:18.967391+0000","last_clean":"2024-04-22T06:32:18.967391+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:32:18.967391+0000","last_undegraded":"2024-04-22T06:32:18.967391+0000","last_fullsized":"2024-04-22T06:32:18.967391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967847+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:32:18.967847+0000","last_peered":"2024-04-22T06:32:18.967847+0000","last_clean":"2024-04-22T06:32:18.967847+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:32:18.967847+0000","last_undegraded":"2024-04-22T06:32:18.967847+0000","last_fullsized":"2024-04-22T06:32:18.967847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967467+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:32:18.967467+0000","last_peered":"2024-04-22T06:32:18.967467+0000","last_clean":"2024-04-22T06:32:18.967467+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:32:18.967467+0000","last_undegraded":"2024-04-22T06:32:18.967467+0000","last_fullsized":"2024-04-22T06:32:18.967467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981470+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:32:18.981470+0000","last_peered":"2024-04-22T06:32:18.981470+0000","last_clean":"2024-04-22T06:32:18.981470+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:32:18.981470+0000","last_undegraded":"2024-04-22T06:32:18.981470+0000","last_fullsized":"2024-04-22T06:32:18.981470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966631+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:32:18.966631+0000","last_peered":"2024-04-22T06:32:18.966631+0000","last_clean":"2024-04-22T06:32:18.966631+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:32:18.966631+0000","last_undegraded":"2024-04-22T06:32:18.966631+0000","last_fullsized":"2024-04-22T06:32:18.966631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969267+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:32:18.969267+0000","last_peered":"2024-04-22T06:32:18.969267+0000","last_clean":"2024-04-22T06:32:18.969267+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:32:18.969267+0000","last_undegraded":"2024-04-22T06:32:18.969267+0000","last_fullsized":"2024-04-22T06:32:18.969267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968549+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:32:18.968549+0000","last_peered":"2024-04-22T06:32:18.968549+0000","last_clean":"2024-04-22T06:32:18.968549+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:32:18.968549+0000","last_undegraded":"2024-04-22T06:32:18.968549+0000","last_fullsized":"2024-04-22T06:32:18.968549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.153901+0000","last_change":"2024-04-22T06:32:19.151471+0000","last_active":"2024-04-22T06:32:19.153901+0000","last_peered":"2024-04-22T06:32:19.153901+0000","last_clean":"2024-04-22T06:32:19.153901+0000","last_became_active":"2024-04-22T06:32:19.151207+0000","last_became_peered":"2024-04-22T06:32:19.151207+0000","last_unstale":"2024-04-22T06:32:19.153901+0000","last_undegraded":"2024-04-22T06:32:19.153901+0000","last_fullsized":"2024-04-22T06:32:19.153901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:37:11.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966603+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:32:18.966603+0000","last_peered":"2024-04-22T06:32:18.966603+0000","last_clean":"2024-04-22T06:32:18.966603+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:32:18.966603+0000","last_undegraded":"2024-04-22T06:32:18.966603+0000","last_fullsized":"2024-04-22T06:32:18.966603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966400+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:32:18.966400+0000","last_peered":"2024-04-22T06:32:18.966400+0000","last_clean":"2024-04-22T06:32:18.966400+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:32:18.966400+0000","last_undegraded":"2024-04-22T06:32:18.966400+0000","last_fullsized":"2024-04-22T06:32:18.966400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967375+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:32:18.967375+0000","last_peered":"2024-04-22T06:32:18.967375+0000","last_clean":"2024-04-22T06:32:18.967375+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:32:18.967375+0000","last_undegraded":"2024-04-22T06:32:18.967375+0000","last_fullsized":"2024-04-22T06:32:18.967375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981387+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:32:18.981387+0000","last_peered":"2024-04-22T06:32:18.981387+0000","last_clean":"2024-04-22T06:32:18.981387+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:32:18.981387+0000","last_undegraded":"2024-04-22T06:32:18.981387+0000","last_fullsized":"2024-04-22T06:32:18.981387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967995+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:32:18.967995+0000","last_peered":"2024-04-22T06:32:18.967995+0000","last_clean":"2024-04-22T06:32:18.967995+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:32:18.967995+0000","last_undegraded":"2024-04-22T06:32:18.967995+0000","last_fullsized":"2024-04-22T06:32:18.967995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294571+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:32:19.294571+0000","last_peered":"2024-04-22T06:32:19.294571+0000","last_clean":"2024-04-22T06:32:19.294571+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:32:19.294571+0000","last_undegraded":"2024-04-22T06:32:19.294571+0000","last_fullsized":"2024-04-22T06:32:19.294571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968088+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:32:18.968088+0000","last_peered":"2024-04-22T06:32:18.968088+0000","last_clean":"2024-04-22T06:32:18.968088+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:32:18.968088+0000","last_undegraded":"2024-04-22T06:32:18.968088+0000","last_fullsized":"2024-04-22T06:32:18.968088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967971+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:32:18.967971+0000","last_peered":"2024-04-22T06:32:18.967971+0000","last_clean":"2024-04-22T06:32:18.967971+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:32:18.967971+0000","last_undegraded":"2024-04-22T06:32:18.967971+0000","last_fullsized":"2024-04-22T06:32:18.967971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.984067+0000","last_change":"2024-04-22T06:32:18.981673+0000","last_active":"2024-04-22T06:32:18.984067+0000","last_peered":"2024-04-22T06:32:18.984067+0000","last_clean":"2024-04-22T06:32:18.984067+0000","last_became_active":"2024-04-22T06:32:18.981385+0000","last_became_peered":"2024-04-22T06:32:18.981385+0000","last_unstale":"2024-04-22T06:32:18.984067+0000","last_undegraded":"2024-04-22T06:32:18.984067+0000","last_fullsized":"2024-04-22T06:32:18.984067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:12:05.631449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969001+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:32:18.969001+0000","last_peered":"2024-04-22T06:32:18.969001+0000","last_clean":"2024-04-22T06:32:18.969001+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:32:18.969001+0000","last_undegraded":"2024-04-22T06:32:18.969001+0000","last_fullsized":"2024-04-22T06:32:18.969001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981198+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:32:18.981198+0000","last_peered":"2024-04-22T06:32:18.981198+0000","last_clean":"2024-04-22T06:32:18.981198+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:32:18.981198+0000","last_undegraded":"2024-04-22T06:32:18.981198+0000","last_fullsized":"2024-04-22T06:32:18.981198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966096+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:32:18.966096+0000","last_peered":"2024-04-22T06:32:18.966096+0000","last_clean":"2024-04-22T06:32:18.966096+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:32:18.966096+0000","last_undegraded":"2024-04-22T06:32:18.966096+0000","last_fullsized":"2024-04-22T06:32:18.966096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150236+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:32:19.150236+0000","last_peered":"2024-04-22T06:32:19.150236+0000","last_clean":"2024-04-22T06:32:19.150236+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:32:19.150236+0000","last_undegraded":"2024-04-22T06:32:19.150236+0000","last_fullsized":"2024-04-22T06:32:19.150236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968293+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:32:18.968293+0000","last_peered":"2024-04-22T06:32:18.968293+0000","last_clean":"2024-04-22T06:32:18.968293+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:32:18.968293+0000","last_undegraded":"2024-04-22T06:32:18.968293+0000","last_fullsized":"2024-04-22T06:32:18.968293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968508+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:32:18.968508+0000","last_peered":"2024-04-22T06:32:18.968508+0000","last_clean":"2024-04-22T06:32:18.968508+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:32:18.968508+0000","last_undegraded":"2024-04-22T06:32:18.968508+0000","last_fullsized":"2024-04-22T06:32:18.968508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294864+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:32:19.294864+0000","last_peered":"2024-04-22T06:32:19.294864+0000","last_clean":"2024-04-22T06:32:19.294864+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:32:19.294864+0000","last_undegraded":"2024-04-22T06:32:19.294864+0000","last_fullsized":"2024-04-22T06:32:19.294864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965909+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:32:18.965909+0000","last_peered":"2024-04-22T06:32:18.965909+0000","last_clean":"2024-04-22T06:32:18.965909+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:32:18.965909+0000","last_undegraded":"2024-04-22T06:32:18.965909+0000","last_fullsized":"2024-04-22T06:32:18.965909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294097+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:32:19.294097+0000","last_peered":"2024-04-22T06:32:19.294097+0000","last_clean":"2024-04-22T06:32:19.294097+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:32:19.294097+0000","last_undegraded":"2024-04-22T06:32:19.294097+0000","last_fullsized":"2024-04-22T06:32:19.294097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967270+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:32:18.967270+0000","last_peered":"2024-04-22T06:32:18.967270+0000","last_clean":"2024-04-22T06:32:18.967270+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:32:18.967270+0000","last_undegraded":"2024-04-22T06:32:18.967270+0000","last_fullsized":"2024-04-22T06:32:18.967270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294227+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:32:19.294227+0000","last_peered":"2024-04-22T06:32:19.294227+0000","last_clean":"2024-04-22T06:32:19.294227+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:32:19.294227+0000","last_undegraded":"2024-04-22T06:32:19.294227+0000","last_fullsized":"2024-04-22T06:32:19.294227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967631+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:32:18.967631+0000","last_peered":"2024-04-22T06:32:18.967631+0000","last_clean":"2024-04-22T06:32:18.967631+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:32:18.967631+0000","last_undegraded":"2024-04-22T06:32:18.967631+0000","last_fullsized":"2024-04-22T06:32:18.967631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981168+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:32:18.981168+0000","last_peered":"2024-04-22T06:32:18.981168+0000","last_clean":"2024-04-22T06:32:18.981168+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:32:18.981168+0000","last_undegraded":"2024-04-22T06:32:18.981168+0000","last_fullsized":"2024-04-22T06:32:18.981168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969514+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:32:18.969514+0000","last_peered":"2024-04-22T06:32:18.969514+0000","last_clean":"2024-04-22T06:32:18.969514+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:32:18.969514+0000","last_undegraded":"2024-04-22T06:32:18.969514+0000","last_fullsized":"2024-04-22T06:32:18.969514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294781+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:32:19.294781+0000","last_peered":"2024-04-22T06:32:19.294781+0000","last_clean":"2024-04-22T06:32:19.294781+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:32:19.294781+0000","last_undegraded":"2024-04-22T06:32:19.294781+0000","last_fullsized":"2024-04-22T06:32:19.294781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":119909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":115823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:32:36.974 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:32:37.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.106+0000 7f337c463640 1 Processor -- start 2024-04-22T06:32:37.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.107+0000 7f337c463640 1 -- start start 2024-04-22T06:32:37.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.107+0000 7f337c463640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f33740caac0 0x7f3374154e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.107+0000 7f337c463640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337415e7a0 con 0x7f33740ca6e0 2024-04-22T06:32:37.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.107+0000 7f337c463640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337415ea80 con 0x7f33740c8260 2024-04-22T06:32:37.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.107+0000 7f337c463640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f3374070ba0 con 0x7f33740caac0 2024-04-22T06:32:37.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.108+0000 7f33799fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f33740caac0 0x7f3374154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.108+0000 7f337a1ff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f33740ca6e0 0x7f3374070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45080/0 (socket says 172.21.15.113:45080) 2024-04-22T06:32:37.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.108+0000 7f337a1ff640 1 -- 172.21.15.113:0/2399261461 learned_addr learned my addr 172.21.15.113:0/2399261461 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:37.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.108+0000 7f33799fe640 1 -- 172.21.15.113:0/2399261461 >> v1:172.21.15.145:6789/0 conn(0x7f33740c8260 legacy=0x7f337415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.108+0000 7f33799fe640 1 -- 172.21.15.113:0/2399261461 >> v1:172.21.15.113:6789/0 conn(0x7f33740ca6e0 legacy=0x7f3374070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.108+0000 7f33799fe640 1 -- 172.21.15.113:0/2399261461 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337415ed60 con 0x7f33740caac0 2024-04-22T06:32:37.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.109+0000 7f33799fe640 1 --2- 172.21.15.113:0/2399261461 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f3374154e60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f33640097a0 tx=0x7f336402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6aa5c3fba76d72f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.109+0000 7f33791fd640 1 -- 172.21.15.113:0/2399261461 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336402f810 con 0x7f33740caac0 2024-04-22T06:32:37.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.109+0000 7f33791fd640 1 -- 172.21.15.113:0/2399261461 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336402f9b0 con 0x7f33740caac0 2024-04-22T06:32:37.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.109+0000 7f33791fd640 1 -- 172.21.15.113:0/2399261461 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336402fd80 con 0x7f33740caac0 2024-04-22T06:32:37.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.109+0000 7f337c463640 1 -- 172.21.15.113:0/2399261461 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 msgr2=0x7f3374154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.109+0000 7f337c463640 1 --2- 172.21.15.113:0/2399261461 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f3374154e60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f33640097a0 tx=0x7f336402b9f0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.110+0000 7f337c463640 1 -- 172.21.15.113:0/2399261461 shutdown_connections 2024-04-22T06:32:37.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.110+0000 7f337c463640 1 --2- 172.21.15.113:0/2399261461 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f3374154e60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.110+0000 7f337c463640 1 -- 172.21.15.113:0/2399261461 >> 172.21.15.113:0/2399261461 conn(0x7f337406bd10 msgr2=0x7f337406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:37.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.110+0000 7f337c463640 1 -- 172.21.15.113:0/2399261461 shutdown_connections 2024-04-22T06:32:37.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.110+0000 7f337c463640 1 -- 172.21.15.113:0/2399261461 wait complete. 2024-04-22T06:32:37.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337c463640 1 Processor -- start 2024-04-22T06:32:37.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337c463640 1 -- start start 2024-04-22T06:32:37.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337c463640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33740c8260 0x7f33741501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337c463640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33740ca6e0 0x7f33741e5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337c463640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f33741e5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337c463640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f33740c9e30 con 0x7f33740caac0 2024-04-22T06:32:37.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337c463640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f337415f320 con 0x7f33740ca6e0 2024-04-22T06:32:37.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337c463640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f337415bb90 con 0x7f33740c8260 2024-04-22T06:32:37.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.111+0000 7f337aa00640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f33741e5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337aa00640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f33741e5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33760/0 (socket says 172.21.15.113:33760) 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337aa00640 1 -- 172.21.15.113:0/2152240722 learned_addr learned my addr 172.21.15.113:0/2152240722 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f33799fe640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33740ca6e0 0x7f33741e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337a1ff640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33740c8260 0x7f33741501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337aa00640 1 -- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33740c8260 msgr2=0x7f33741501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337aa00640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33740c8260 0x7f33741501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337aa00640 1 -- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33740ca6e0 msgr2=0x7f33741e5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337aa00640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33740ca6e0 0x7f33741e5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337aa00640 1 -- 172.21.15.113:0/2152240722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33741f1330 con 0x7f33740caac0 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f33799fe640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33740ca6e0 0x7f33741e5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337aa00640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f33741e5a90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c7a0 tx=0x7f336c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f336affd640 1 -- 172.21.15.113:0/2152240722 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c003b70 con 0x7f33740caac0 2024-04-22T06:32:37.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f336affd640 1 -- 172.21.15.113:0/2152240722 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c003d30 con 0x7f33740caac0 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33741f4910 con 0x7f33740caac0 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f336affd640 1 -- 172.21.15.113:0/2152240722 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c00aa90 con 0x7f33740caac0 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.112+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33741f4ed0 con 0x7f33740caac0 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.113+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3374068e40 con 0x7f33740caac0 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.114+0000 7f336affd640 1 -- 172.21.15.113:0/2152240722 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f336c00ac30 con 0x7f33740caac0 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.114+0000 7f336affd640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f335806c8f0 0x7f335806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.114+0000 7f337a1ff640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f335806c8f0 0x7f335806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.114+0000 7f336affd640 1 -- 172.21.15.113:0/2152240722 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f336c08bef0 con 0x7f33740caac0 2024-04-22T06:32:37.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.115+0000 7f337a1ff640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f335806c8f0 0x7f335806edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3370005880 tx=0x7f3370009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.118+0000 7f336affd640 1 -- 172.21.15.113:0/2152240722 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f336c059f20 con 0x7f33740caac0 2024-04-22T06:32:37.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.289+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33741f46c0 con 0x7f335806c8f0 2024-04-22T06:32:37.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.296+0000 7f336affd640 1 -- 172.21.15.113:0/2152240722 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332634 (secure 0 0 0) 0x7f33741f46c0 con 0x7f335806c8f0 2024-04-22T06:32:37.299 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:37.301 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f335806c8f0 msgr2=0x7f335806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f335806c8f0 0x7f335806edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3370005880 tx=0x7f3370009040 comp rx=0 tx=0).stop 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 msgr2=0x7f33741e5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f33741e5a90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c7a0 tx=0x7f336c00cc60 comp rx=0 tx=0).stop 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 shutdown_connections 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f335806c8f0 0x7f335806edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33740caac0 0x7f33741e5a90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f33740ca6e0 0x7f33741e5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 --2- 172.21.15.113:0/2152240722 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f33740c8260 0x7f33741501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 >> 172.21.15.113:0/2152240722 conn(0x7f337406bd10 msgr2=0x7f337415b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:37.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 shutdown_connections 2024-04-22T06:32:37.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.300+0000 7f337c463640 1 -- 172.21.15.113:0/2152240722 wait complete. 2024-04-22T06:32:37.310 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-22T06:32:36.981977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219720,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755000,"statfs":{"total":773094113280,"available":772869120000,"internally_reserved":0,"allocated":3678208,"data_stored":2119239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002841"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979849+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:32:24.979849+0000","last_peered":"2024-04-22T06:32:24.979849+0000","last_clean":"2024-04-22T06:32:24.979849+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:32:24.979849+0000","last_undegraded":"2024-04-22T06:32:24.979849+0000","last_fullsized":"2024-04-22T06:32:24.979849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966555+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:32:18.966555+0000","last_peered":"2024-04-22T06:32:18.966555+0000","last_clean":"2024-04-22T06:32:18.966555+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:32:18.966555+0000","last_undegraded":"2024-04-22T06:32:18.966555+0000","last_fullsized":"2024-04-22T06:32:18.966555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965851+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:32:18.965851+0000","last_peered":"2024-04-22T06:32:18.965851+0000","last_clean":"2024-04-22T06:32:18.965851+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:32:18.965851+0000","last_undegraded":"2024-04-22T06:32:18.965851+0000","last_fullsized":"2024-04-22T06:32:18.965851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966745+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:32:18.966745+0000","last_peered":"2024-04-22T06:32:18.966745+0000","last_clean":"2024-04-22T06:32:18.966745+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:32:18.966745+0000","last_undegraded":"2024-04-22T06:32:18.966745+0000","last_fullsized":"2024-04-22T06:32:18.966745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981681+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:32:18.981681+0000","last_peered":"2024-04-22T06:32:18.981681+0000","last_clean":"2024-04-22T06:32:18.981681+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:32:18.981681+0000","last_undegraded":"2024-04-22T06:32:18.981681+0000","last_fullsized":"2024-04-22T06:32:18.981681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149424+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:32:19.149424+0000","last_peered":"2024-04-22T06:32:19.149424+0000","last_clean":"2024-04-22T06:32:19.149424+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:32:19.149424+0000","last_undegraded":"2024-04-22T06:32:19.149424+0000","last_fullsized":"2024-04-22T06:32:19.149424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982683+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:32:24.982683+0000","last_peered":"2024-04-22T06:32:24.982683+0000","last_clean":"2024-04-22T06:32:24.982683+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:32:24.982683+0000","last_undegraded":"2024-04-22T06:32:24.982683+0000","last_fullsized":"2024-04-22T06:32:24.982683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151734+0000","last_change":"2024-04-22T06:32:19.150976+0000","last_active":"2024-04-22T06:32:19.151734+0000","last_peered":"2024-04-22T06:32:19.151734+0000","last_clean":"2024-04-22T06:32:19.151734+0000","last_became_active":"2024-04-22T06:32:19.150701+0000","last_became_peered":"2024-04-22T06:32:19.150701+0000","last_unstale":"2024-04-22T06:32:19.151734+0000","last_undegraded":"2024-04-22T06:32:19.151734+0000","last_fullsized":"2024-04-22T06:32:19.151734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:03:07.842684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149873+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:32:19.149873+0000","last_peered":"2024-04-22T06:32:19.149873+0000","last_clean":"2024-04-22T06:32:19.149873+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:32:19.149873+0000","last_undegraded":"2024-04-22T06:32:19.149873+0000","last_fullsized":"2024-04-22T06:32:19.149873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979700+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:32:24.979700+0000","last_peered":"2024-04-22T06:32:24.979700+0000","last_clean":"2024-04-22T06:32:24.979700+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:32:24.979700+0000","last_undegraded":"2024-04-22T06:32:24.979700+0000","last_fullsized":"2024-04-22T06:32:24.979700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967622+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:32:18.967622+0000","last_peered":"2024-04-22T06:32:18.967622+0000","last_clean":"2024-04-22T06:32:18.967622+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:32:18.967622+0000","last_undegraded":"2024-04-22T06:32:18.967622+0000","last_fullsized":"2024-04-22T06:32:18.967622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149778+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:32:19.149778+0000","last_peered":"2024-04-22T06:32:19.149778+0000","last_clean":"2024-04-22T06:32:19.149778+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:32:19.149778+0000","last_undegraded":"2024-04-22T06:32:19.149778+0000","last_fullsized":"2024-04-22T06:32:19.149778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966853+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:32:18.966853+0000","last_peered":"2024-04-22T06:32:18.966853+0000","last_clean":"2024-04-22T06:32:18.966853+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:32:18.966853+0000","last_undegraded":"2024-04-22T06:32:18.966853+0000","last_fullsized":"2024-04-22T06:32:18.966853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294409+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:32:19.294409+0000","last_peered":"2024-04-22T06:32:19.294409+0000","last_clean":"2024-04-22T06:32:19.294409+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:32:19.294409+0000","last_undegraded":"2024-04-22T06:32:19.294409+0000","last_fullsized":"2024-04-22T06:32:19.294409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150210+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:32:19.150210+0000","last_peered":"2024-04-22T06:32:19.150210+0000","last_clean":"2024-04-22T06:32:19.150210+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:32:19.150210+0000","last_undegraded":"2024-04-22T06:32:19.150210+0000","last_fullsized":"2024-04-22T06:32:19.150210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966124+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:32:18.966124+0000","last_peered":"2024-04-22T06:32:18.966124+0000","last_clean":"2024-04-22T06:32:18.966124+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:32:18.966124+0000","last_undegraded":"2024-04-22T06:32:18.966124+0000","last_fullsized":"2024-04-22T06:32:18.966124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969749+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:32:18.969749+0000","last_peered":"2024-04-22T06:32:18.969749+0000","last_clean":"2024-04-22T06:32:18.969749+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:32:18.969749+0000","last_undegraded":"2024-04-22T06:32:18.969749+0000","last_fullsized":"2024-04-22T06:32:18.969749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150005+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:32:19.150005+0000","last_peered":"2024-04-22T06:32:19.150005+0000","last_clean":"2024-04-22T06:32:19.150005+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:32:19.150005+0000","last_undegraded":"2024-04-22T06:32:19.150005+0000","last_fullsized":"2024-04-22T06:32:19.150005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966111+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:32:18.966111+0000","last_peered":"2024-04-22T06:32:18.966111+0000","last_clean":"2024-04-22T06:32:18.966111+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:32:18.966111+0000","last_undegraded":"2024-04-22T06:32:18.966111+0000","last_fullsized":"2024-04-22T06:32:18.966111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978562+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:32:24.978562+0000","last_peered":"2024-04-22T06:32:24.978562+0000","last_clean":"2024-04-22T06:32:24.978562+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:32:24.978562+0000","last_undegraded":"2024-04-22T06:32:24.978562+0000","last_fullsized":"2024-04-22T06:32:24.978562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969457+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:32:18.969457+0000","last_peered":"2024-04-22T06:32:18.969457+0000","last_clean":"2024-04-22T06:32:18.969457+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:32:18.969457+0000","last_undegraded":"2024-04-22T06:32:18.969457+0000","last_fullsized":"2024-04-22T06:32:18.969457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149852+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:32:19.149852+0000","last_peered":"2024-04-22T06:32:19.149852+0000","last_clean":"2024-04-22T06:32:19.149852+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:32:19.149852+0000","last_undegraded":"2024-04-22T06:32:19.149852+0000","last_fullsized":"2024-04-22T06:32:19.149852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.293907+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:32:19.293907+0000","last_peered":"2024-04-22T06:32:19.293907+0000","last_clean":"2024-04-22T06:32:19.293907+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:32:19.293907+0000","last_undegraded":"2024-04-22T06:32:19.293907+0000","last_fullsized":"2024-04-22T06:32:19.293907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150066+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:32:19.150066+0000","last_peered":"2024-04-22T06:32:19.150066+0000","last_clean":"2024-04-22T06:32:19.150066+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:32:19.150066+0000","last_undegraded":"2024-04-22T06:32:19.150066+0000","last_fullsized":"2024-04-22T06:32:19.150066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981653+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:32:18.981653+0000","last_peered":"2024-04-22T06:32:18.981653+0000","last_clean":"2024-04-22T06:32:18.981653+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:32:18.981653+0000","last_undegraded":"2024-04-22T06:32:18.981653+0000","last_fullsized":"2024-04-22T06:32:18.981653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.981798+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:32:24.981798+0000","last_peered":"2024-04-22T06:32:24.981798+0000","last_clean":"2024-04-22T06:32:24.981798+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:32:24.981798+0000","last_undegraded":"2024-04-22T06:32:24.981798+0000","last_fullsized":"2024-04-22T06:32:24.981798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149673+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:32:19.149673+0000","last_peered":"2024-04-22T06:32:19.149673+0000","last_clean":"2024-04-22T06:32:19.149673+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:32:19.149673+0000","last_undegraded":"2024-04-22T06:32:19.149673+0000","last_fullsized":"2024-04-22T06:32:19.149673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966813+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:32:18.966813+0000","last_peered":"2024-04-22T06:32:18.966813+0000","last_clean":"2024-04-22T06:32:18.966813+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:32:18.966813+0000","last_undegraded":"2024-04-22T06:32:18.966813+0000","last_fullsized":"2024-04-22T06:32:18.966813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969615+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:32:18.969615+0000","last_peered":"2024-04-22T06:32:18.969615+0000","last_clean":"2024-04-22T06:32:18.969615+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:32:18.969615+0000","last_undegraded":"2024-04-22T06:32:18.969615+0000","last_fullsized":"2024-04-22T06:32:18.969615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965797+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:32:18.965797+0000","last_peered":"2024-04-22T06:32:18.965797+0000","last_clean":"2024-04-22T06:32:18.965797+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:32:18.965797+0000","last_undegraded":"2024-04-22T06:32:18.965797+0000","last_fullsized":"2024-04-22T06:32:18.965797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969571+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:32:18.969571+0000","last_peered":"2024-04-22T06:32:18.969571+0000","last_clean":"2024-04-22T06:32:18.969571+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:32:18.969571+0000","last_undegraded":"2024-04-22T06:32:18.969571+0000","last_fullsized":"2024-04-22T06:32:18.969571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294699+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:32:19.294699+0000","last_peered":"2024-04-22T06:32:19.294699+0000","last_clean":"2024-04-22T06:32:19.294699+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:32:19.294699+0000","last_undegraded":"2024-04-22T06:32:19.294699+0000","last_fullsized":"2024-04-22T06:32:19.294699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981307+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:32:18.981307+0000","last_peered":"2024-04-22T06:32:18.981307+0000","last_clean":"2024-04-22T06:32:18.981307+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:32:18.981307+0000","last_undegraded":"2024-04-22T06:32:18.981307+0000","last_fullsized":"2024-04-22T06:32:18.981307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967531+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:32:18.967531+0000","last_peered":"2024-04-22T06:32:18.967531+0000","last_clean":"2024-04-22T06:32:18.967531+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:32:18.967531+0000","last_undegraded":"2024-04-22T06:32:18.967531+0000","last_fullsized":"2024-04-22T06:32:18.967531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969637+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:32:18.969637+0000","last_peered":"2024-04-22T06:32:18.969637+0000","last_clean":"2024-04-22T06:32:18.969637+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:32:18.969637+0000","last_undegraded":"2024-04-22T06:32:18.969637+0000","last_fullsized":"2024-04-22T06:32:18.969637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969213+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:32:18.969213+0000","last_peered":"2024-04-22T06:32:18.969213+0000","last_clean":"2024-04-22T06:32:18.969213+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:32:18.969213+0000","last_undegraded":"2024-04-22T06:32:18.969213+0000","last_fullsized":"2024-04-22T06:32:18.969213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150313+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:32:19.150313+0000","last_peered":"2024-04-22T06:32:19.150313+0000","last_clean":"2024-04-22T06:32:19.150313+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:32:19.150313+0000","last_undegraded":"2024-04-22T06:32:19.150313+0000","last_fullsized":"2024-04-22T06:32:19.150313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978693+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:32:24.978693+0000","last_peered":"2024-04-22T06:32:24.978693+0000","last_clean":"2024-04-22T06:32:24.978693+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:32:24.978693+0000","last_undegraded":"2024-04-22T06:32:24.978693+0000","last_fullsized":"2024-04-22T06:32:24.978693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969492+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:32:18.969492+0000","last_peered":"2024-04-22T06:32:18.969492+0000","last_clean":"2024-04-22T06:32:18.969492+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:32:18.969492+0000","last_undegraded":"2024-04-22T06:32:18.969492+0000","last_fullsized":"2024-04-22T06:32:18.969492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968986+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:32:18.968986+0000","last_peered":"2024-04-22T06:32:18.968986+0000","last_clean":"2024-04-22T06:32:18.968986+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:32:18.968986+0000","last_undegraded":"2024-04-22T06:32:18.968986+0000","last_fullsized":"2024-04-22T06:32:18.968986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978504+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:32:24.978504+0000","last_peered":"2024-04-22T06:32:24.978504+0000","last_clean":"2024-04-22T06:32:24.978504+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:32:24.978504+0000","last_undegraded":"2024-04-22T06:32:24.978504+0000","last_fullsized":"2024-04-22T06:32:24.978504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969478+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:32:18.969478+0000","last_peered":"2024-04-22T06:32:18.969478+0000","last_clean":"2024-04-22T06:32:18.969478+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:32:18.969478+0000","last_undegraded":"2024-04-22T06:32:18.969478+0000","last_fullsized":"2024-04-22T06:32:18.969478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981002+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:32:18.981002+0000","last_peered":"2024-04-22T06:32:18.981002+0000","last_clean":"2024-04-22T06:32:18.981002+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:32:18.981002+0000","last_undegraded":"2024-04-22T06:32:18.981002+0000","last_fullsized":"2024-04-22T06:32:18.981002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294057+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:32:19.294057+0000","last_peered":"2024-04-22T06:32:19.294057+0000","last_clean":"2024-04-22T06:32:19.294057+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:32:19.294057+0000","last_undegraded":"2024-04-22T06:32:19.294057+0000","last_fullsized":"2024-04-22T06:32:19.294057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981530+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:32:18.981530+0000","last_peered":"2024-04-22T06:32:18.981530+0000","last_clean":"2024-04-22T06:32:18.981530+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:32:18.981530+0000","last_undegraded":"2024-04-22T06:32:18.981530+0000","last_fullsized":"2024-04-22T06:32:18.981530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966072+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:32:18.966072+0000","last_peered":"2024-04-22T06:32:18.966072+0000","last_clean":"2024-04-22T06:32:18.966072+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:32:18.966072+0000","last_undegraded":"2024-04-22T06:32:18.966072+0000","last_fullsized":"2024-04-22T06:32:18.966072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967351+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:32:18.967351+0000","last_peered":"2024-04-22T06:32:18.967351+0000","last_clean":"2024-04-22T06:32:18.967351+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:32:18.967351+0000","last_undegraded":"2024-04-22T06:32:18.967351+0000","last_fullsized":"2024-04-22T06:32:18.967351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294046+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:32:19.294046+0000","last_peered":"2024-04-22T06:32:19.294046+0000","last_clean":"2024-04-22T06:32:19.294046+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:32:19.294046+0000","last_undegraded":"2024-04-22T06:32:19.294046+0000","last_fullsized":"2024-04-22T06:32:19.294046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968137+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:32:18.968137+0000","last_peered":"2024-04-22T06:32:18.968137+0000","last_clean":"2024-04-22T06:32:18.968137+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:32:18.968137+0000","last_undegraded":"2024-04-22T06:32:18.968137+0000","last_fullsized":"2024-04-22T06:32:18.968137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294428+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:32:19.294428+0000","last_peered":"2024-04-22T06:32:19.294428+0000","last_clean":"2024-04-22T06:32:19.294428+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:32:19.294428+0000","last_undegraded":"2024-04-22T06:32:19.294428+0000","last_fullsized":"2024-04-22T06:32:19.294428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968415+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:32:18.968415+0000","last_peered":"2024-04-22T06:32:18.968415+0000","last_clean":"2024-04-22T06:32:18.968415+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:32:18.968415+0000","last_undegraded":"2024-04-22T06:32:18.968415+0000","last_fullsized":"2024-04-22T06:32:18.968415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966730+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:32:18.966730+0000","last_peered":"2024-04-22T06:32:18.966730+0000","last_clean":"2024-04-22T06:32:18.966730+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:32:18.966730+0000","last_undegraded":"2024-04-22T06:32:18.966730+0000","last_fullsized":"2024-04-22T06:32:18.966730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967818+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:32:18.967818+0000","last_peered":"2024-04-22T06:32:18.967818+0000","last_clean":"2024-04-22T06:32:18.967818+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:32:18.967818+0000","last_undegraded":"2024-04-22T06:32:18.967818+0000","last_fullsized":"2024-04-22T06:32:18.967818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969689+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:32:18.969689+0000","last_peered":"2024-04-22T06:32:18.969689+0000","last_clean":"2024-04-22T06:32:18.969689+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:32:18.969689+0000","last_undegraded":"2024-04-22T06:32:18.969689+0000","last_fullsized":"2024-04-22T06:32:18.969689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981441+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:32:18.981441+0000","last_peered":"2024-04-22T06:32:18.981441+0000","last_clean":"2024-04-22T06:32:18.981441+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:32:18.981441+0000","last_undegraded":"2024-04-22T06:32:18.981441+0000","last_fullsized":"2024-04-22T06:32:18.981441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151685+0000","last_change":"2024-04-22T06:32:19.151055+0000","last_active":"2024-04-22T06:32:19.151685+0000","last_peered":"2024-04-22T06:32:19.151685+0000","last_clean":"2024-04-22T06:32:19.151685+0000","last_became_active":"2024-04-22T06:32:19.150732+0000","last_became_peered":"2024-04-22T06:32:19.150732+0000","last_unstale":"2024-04-22T06:32:19.151685+0000","last_undegraded":"2024-04-22T06:32:19.151685+0000","last_fullsized":"2024-04-22T06:32:19.151685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:52:54.156456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.975775+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:32:24.975775+0000","last_peered":"2024-04-22T06:32:24.975775+0000","last_clean":"2024-04-22T06:32:24.975775+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:32:24.975775+0000","last_undegraded":"2024-04-22T06:32:24.975775+0000","last_fullsized":"2024-04-22T06:32:24.975775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966483+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:32:18.966483+0000","last_peered":"2024-04-22T06:32:18.966483+0000","last_clean":"2024-04-22T06:32:18.966483+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:32:18.966483+0000","last_undegraded":"2024-04-22T06:32:18.966483+0000","last_fullsized":"2024-04-22T06:32:18.966483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294596+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:32:19.294596+0000","last_peered":"2024-04-22T06:32:19.294596+0000","last_clean":"2024-04-22T06:32:19.294596+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:32:19.294596+0000","last_undegraded":"2024-04-22T06:32:19.294596+0000","last_fullsized":"2024-04-22T06:32:19.294596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150264+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:32:19.150264+0000","last_peered":"2024-04-22T06:32:19.150264+0000","last_clean":"2024-04-22T06:32:19.150264+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:32:19.150264+0000","last_undegraded":"2024-04-22T06:32:19.150264+0000","last_fullsized":"2024-04-22T06:32:19.150264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149416+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:32:19.149416+0000","last_peered":"2024-04-22T06:32:19.149416+0000","last_clean":"2024-04-22T06:32:19.149416+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:32:19.149416+0000","last_undegraded":"2024-04-22T06:32:19.149416+0000","last_fullsized":"2024-04-22T06:32:19.149416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294298+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:32:19.294298+0000","last_peered":"2024-04-22T06:32:19.294298+0000","last_clean":"2024-04-22T06:32:19.294298+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:32:19.294298+0000","last_undegraded":"2024-04-22T06:32:19.294298+0000","last_fullsized":"2024-04-22T06:32:19.294298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968595+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:32:18.968595+0000","last_peered":"2024-04-22T06:32:18.968595+0000","last_clean":"2024-04-22T06:32:18.968595+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:32:18.968595+0000","last_undegraded":"2024-04-22T06:32:18.968595+0000","last_fullsized":"2024-04-22T06:32:18.968595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981432+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:32:18.981432+0000","last_peered":"2024-04-22T06:32:18.981432+0000","last_clean":"2024-04-22T06:32:18.981432+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:32:18.981432+0000","last_undegraded":"2024-04-22T06:32:18.981432+0000","last_fullsized":"2024-04-22T06:32:18.981432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967559+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:32:18.967559+0000","last_peered":"2024-04-22T06:32:18.967559+0000","last_clean":"2024-04-22T06:32:18.967559+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:32:18.967559+0000","last_undegraded":"2024-04-22T06:32:18.967559+0000","last_fullsized":"2024-04-22T06:32:18.967559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967066+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:32:18.967066+0000","last_peered":"2024-04-22T06:32:18.967066+0000","last_clean":"2024-04-22T06:32:18.967066+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:32:18.967066+0000","last_undegraded":"2024-04-22T06:32:18.967066+0000","last_fullsized":"2024-04-22T06:32:18.967066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966623+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:32:18.966623+0000","last_peered":"2024-04-22T06:32:18.966623+0000","last_clean":"2024-04-22T06:32:18.966623+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:32:18.966623+0000","last_undegraded":"2024-04-22T06:32:18.966623+0000","last_fullsized":"2024-04-22T06:32:18.966623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294251+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:32:19.294251+0000","last_peered":"2024-04-22T06:32:19.294251+0000","last_clean":"2024-04-22T06:32:19.294251+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:32:19.294251+0000","last_undegraded":"2024-04-22T06:32:19.294251+0000","last_fullsized":"2024-04-22T06:32:19.294251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967610+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:32:18.967610+0000","last_peered":"2024-04-22T06:32:18.967610+0000","last_clean":"2024-04-22T06:32:18.967610+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:32:18.967610+0000","last_undegraded":"2024-04-22T06:32:18.967610+0000","last_fullsized":"2024-04-22T06:32:18.967610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966452+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:32:18.966452+0000","last_peered":"2024-04-22T06:32:18.966452+0000","last_clean":"2024-04-22T06:32:18.966452+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:32:18.966452+0000","last_undegraded":"2024-04-22T06:32:18.966452+0000","last_fullsized":"2024-04-22T06:32:18.966452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981284+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:32:18.981284+0000","last_peered":"2024-04-22T06:32:18.981284+0000","last_clean":"2024-04-22T06:32:18.981284+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:32:18.981284+0000","last_undegraded":"2024-04-22T06:32:18.981284+0000","last_fullsized":"2024-04-22T06:32:18.981284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.976916+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:32:24.976916+0000","last_peered":"2024-04-22T06:32:24.976916+0000","last_clean":"2024-04-22T06:32:24.976916+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:32:24.976916+0000","last_undegraded":"2024-04-22T06:32:24.976916+0000","last_fullsized":"2024-04-22T06:32:24.976916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967410+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:32:18.967410+0000","last_peered":"2024-04-22T06:32:18.967410+0000","last_clean":"2024-04-22T06:32:18.967410+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:32:18.967410+0000","last_undegraded":"2024-04-22T06:32:18.967410+0000","last_fullsized":"2024-04-22T06:32:18.967410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294312+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:32:19.294312+0000","last_peered":"2024-04-22T06:32:19.294312+0000","last_clean":"2024-04-22T06:32:19.294312+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:32:19.294312+0000","last_undegraded":"2024-04-22T06:32:19.294312+0000","last_fullsized":"2024-04-22T06:32:19.294312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.261148+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:32:33.261148+0000","last_peered":"2024-04-22T06:32:33.261148+0000","last_clean":"2024-04-22T06:32:33.261148+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:32:33.261148+0000","last_undegraded":"2024-04-22T06:32:33.261148+0000","last_fullsized":"2024-04-22T06:32:33.261148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969452+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:32:18.969452+0000","last_peered":"2024-04-22T06:32:18.969452+0000","last_clean":"2024-04-22T06:32:18.969452+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:32:18.969452+0000","last_undegraded":"2024-04-22T06:32:18.969452+0000","last_fullsized":"2024-04-22T06:32:18.969452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150153+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:32:19.150153+0000","last_peered":"2024-04-22T06:32:19.150153+0000","last_clean":"2024-04-22T06:32:19.150153+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:32:19.150153+0000","last_undegraded":"2024-04-22T06:32:19.150153+0000","last_fullsized":"2024-04-22T06:32:19.150153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969410+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:32:18.969410+0000","last_peered":"2024-04-22T06:32:18.969410+0000","last_clean":"2024-04-22T06:32:18.969410+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:32:18.969410+0000","last_undegraded":"2024-04-22T06:32:18.969410+0000","last_fullsized":"2024-04-22T06:32:18.969410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150044+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:32:19.150044+0000","last_peered":"2024-04-22T06:32:19.150044+0000","last_clean":"2024-04-22T06:32:19.150044+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:32:19.150044+0000","last_undegraded":"2024-04-22T06:32:19.150044+0000","last_fullsized":"2024-04-22T06:32:19.150044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981777+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:32:18.981777+0000","last_peered":"2024-04-22T06:32:18.981777+0000","last_clean":"2024-04-22T06:32:18.981777+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:32:18.981777+0000","last_undegraded":"2024-04-22T06:32:18.981777+0000","last_fullsized":"2024-04-22T06:32:18.981777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979367+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:32:24.979367+0000","last_peered":"2024-04-22T06:32:24.979367+0000","last_clean":"2024-04-22T06:32:24.979367+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:32:24.979367+0000","last_undegraded":"2024-04-22T06:32:24.979367+0000","last_fullsized":"2024-04-22T06:32:24.979367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965918+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:32:18.965918+0000","last_peered":"2024-04-22T06:32:18.965918+0000","last_clean":"2024-04-22T06:32:18.965918+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:32:18.965918+0000","last_undegraded":"2024-04-22T06:32:18.965918+0000","last_fullsized":"2024-04-22T06:32:18.965918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967599+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:32:18.967599+0000","last_peered":"2024-04-22T06:32:18.967599+0000","last_clean":"2024-04-22T06:32:18.967599+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:32:18.967599+0000","last_undegraded":"2024-04-22T06:32:18.967599+0000","last_fullsized":"2024-04-22T06:32:18.967599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968898+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:32:18.968898+0000","last_peered":"2024-04-22T06:32:18.968898+0000","last_clean":"2024-04-22T06:32:18.968898+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:32:18.968898+0000","last_undegraded":"2024-04-22T06:32:18.968898+0000","last_fullsized":"2024-04-22T06:32:18.968898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965891+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:32:18.965891+0000","last_peered":"2024-04-22T06:32:18.965891+0000","last_clean":"2024-04-22T06:32:18.965891+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:32:18.965891+0000","last_undegraded":"2024-04-22T06:32:18.965891+0000","last_fullsized":"2024-04-22T06:32:18.965891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981056+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:32:18.981056+0000","last_peered":"2024-04-22T06:32:18.981056+0000","last_clean":"2024-04-22T06:32:18.981056+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:32:18.981056+0000","last_undegraded":"2024-04-22T06:32:18.981056+0000","last_fullsized":"2024-04-22T06:32:18.981056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968899+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:32:18.968899+0000","last_peered":"2024-04-22T06:32:18.968899+0000","last_clean":"2024-04-22T06:32:18.968899+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:32:18.968899+0000","last_undegraded":"2024-04-22T06:32:18.968899+0000","last_fullsized":"2024-04-22T06:32:18.968899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966973+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:32:18.966973+0000","last_peered":"2024-04-22T06:32:18.966973+0000","last_clean":"2024-04-22T06:32:18.966973+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:32:18.966973+0000","last_undegraded":"2024-04-22T06:32:18.966973+0000","last_fullsized":"2024-04-22T06:32:18.966973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.982812+0000","last_change":"2024-04-22T06:32:18.982812+0000","last_active":"2024-04-22T06:32:18.982812+0000","last_peered":"2024-04-22T06:32:18.982812+0000","last_clean":"2024-04-22T06:32:18.982812+0000","last_became_active":"2024-04-22T06:32:18.982355+0000","last_became_peered":"2024-04-22T06:32:18.982355+0000","last_unstale":"2024-04-22T06:32:18.982812+0000","last_undegraded":"2024-04-22T06:32:18.982812+0000","last_fullsized":"2024-04-22T06:32:18.982812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:01:41.368881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966015+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:32:18.966015+0000","last_peered":"2024-04-22T06:32:18.966015+0000","last_clean":"2024-04-22T06:32:18.966015+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:32:18.966015+0000","last_undegraded":"2024-04-22T06:32:18.966015+0000","last_fullsized":"2024-04-22T06:32:18.966015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966324+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:32:18.966324+0000","last_peered":"2024-04-22T06:32:18.966324+0000","last_clean":"2024-04-22T06:32:18.966324+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:32:18.966324+0000","last_undegraded":"2024-04-22T06:32:18.966324+0000","last_fullsized":"2024-04-22T06:32:18.966324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967052+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:32:18.967052+0000","last_peered":"2024-04-22T06:32:18.967052+0000","last_clean":"2024-04-22T06:32:18.967052+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:32:18.967052+0000","last_undegraded":"2024-04-22T06:32:18.967052+0000","last_fullsized":"2024-04-22T06:32:18.967052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981529+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:32:18.981529+0000","last_peered":"2024-04-22T06:32:18.981529+0000","last_clean":"2024-04-22T06:32:18.981529+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:32:18.981529+0000","last_undegraded":"2024-04-22T06:32:18.981529+0000","last_fullsized":"2024-04-22T06:32:18.981529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.982586+0000","last_change":"2024-04-22T06:32:18.982586+0000","last_active":"2024-04-22T06:32:18.982586+0000","last_peered":"2024-04-22T06:32:18.982586+0000","last_clean":"2024-04-22T06:32:18.982586+0000","last_became_active":"2024-04-22T06:32:18.982159+0000","last_became_peered":"2024-04-22T06:32:18.982159+0000","last_unstale":"2024-04-22T06:32:18.982586+0000","last_undegraded":"2024-04-22T06:32:18.982586+0000","last_fullsized":"2024-04-22T06:32:18.982586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:37.104899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966312+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:32:18.966312+0000","last_peered":"2024-04-22T06:32:18.966312+0000","last_clean":"2024-04-22T06:32:18.966312+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:32:18.966312+0000","last_undegraded":"2024-04-22T06:32:18.966312+0000","last_fullsized":"2024-04-22T06:32:18.966312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149928+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:32:19.149928+0000","last_peered":"2024-04-22T06:32:19.149928+0000","last_clean":"2024-04-22T06:32:19.149928+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:32:19.149928+0000","last_undegraded":"2024-04-22T06:32:19.149928+0000","last_fullsized":"2024-04-22T06:32:19.149928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151801+0000","last_change":"2024-04-22T06:32:19.151801+0000","last_active":"2024-04-22T06:32:19.151801+0000","last_peered":"2024-04-22T06:32:19.151801+0000","last_clean":"2024-04-22T06:32:19.151801+0000","last_became_active":"2024-04-22T06:32:19.151353+0000","last_became_peered":"2024-04-22T06:32:19.151353+0000","last_unstale":"2024-04-22T06:32:19.151801+0000","last_undegraded":"2024-04-22T06:32:19.151801+0000","last_fullsized":"2024-04-22T06:32:19.151801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:11.699970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967391+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:32:18.967391+0000","last_peered":"2024-04-22T06:32:18.967391+0000","last_clean":"2024-04-22T06:32:18.967391+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:32:18.967391+0000","last_undegraded":"2024-04-22T06:32:18.967391+0000","last_fullsized":"2024-04-22T06:32:18.967391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967847+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:32:18.967847+0000","last_peered":"2024-04-22T06:32:18.967847+0000","last_clean":"2024-04-22T06:32:18.967847+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:32:18.967847+0000","last_undegraded":"2024-04-22T06:32:18.967847+0000","last_fullsized":"2024-04-22T06:32:18.967847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967467+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:32:18.967467+0000","last_peered":"2024-04-22T06:32:18.967467+0000","last_clean":"2024-04-22T06:32:18.967467+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:32:18.967467+0000","last_undegraded":"2024-04-22T06:32:18.967467+0000","last_fullsized":"2024-04-22T06:32:18.967467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981470+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:32:18.981470+0000","last_peered":"2024-04-22T06:32:18.981470+0000","last_clean":"2024-04-22T06:32:18.981470+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:32:18.981470+0000","last_undegraded":"2024-04-22T06:32:18.981470+0000","last_fullsized":"2024-04-22T06:32:18.981470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966631+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:32:18.966631+0000","last_peered":"2024-04-22T06:32:18.966631+0000","last_clean":"2024-04-22T06:32:18.966631+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:32:18.966631+0000","last_undegraded":"2024-04-22T06:32:18.966631+0000","last_fullsized":"2024-04-22T06:32:18.966631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969267+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:32:18.969267+0000","last_peered":"2024-04-22T06:32:18.969267+0000","last_clean":"2024-04-22T06:32:18.969267+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:32:18.969267+0000","last_undegraded":"2024-04-22T06:32:18.969267+0000","last_fullsized":"2024-04-22T06:32:18.969267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968549+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:32:18.968549+0000","last_peered":"2024-04-22T06:32:18.968549+0000","last_clean":"2024-04-22T06:32:18.968549+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:32:18.968549+0000","last_undegraded":"2024-04-22T06:32:18.968549+0000","last_fullsized":"2024-04-22T06:32:18.968549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.153901+0000","last_change":"2024-04-22T06:32:19.151471+0000","last_active":"2024-04-22T06:32:19.153901+0000","last_peered":"2024-04-22T06:32:19.153901+0000","last_clean":"2024-04-22T06:32:19.153901+0000","last_became_active":"2024-04-22T06:32:19.151207+0000","last_became_peered":"2024-04-22T06:32:19.151207+0000","last_unstale":"2024-04-22T06:32:19.153901+0000","last_undegraded":"2024-04-22T06:32:19.153901+0000","last_fullsized":"2024-04-22T06:32:19.153901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:37:11.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966603+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:32:18.966603+0000","last_peered":"2024-04-22T06:32:18.966603+0000","last_clean":"2024-04-22T06:32:18.966603+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:32:18.966603+0000","last_undegraded":"2024-04-22T06:32:18.966603+0000","last_fullsized":"2024-04-22T06:32:18.966603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966400+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:32:18.966400+0000","last_peered":"2024-04-22T06:32:18.966400+0000","last_clean":"2024-04-22T06:32:18.966400+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:32:18.966400+0000","last_undegraded":"2024-04-22T06:32:18.966400+0000","last_fullsized":"2024-04-22T06:32:18.966400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967375+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:32:18.967375+0000","last_peered":"2024-04-22T06:32:18.967375+0000","last_clean":"2024-04-22T06:32:18.967375+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:32:18.967375+0000","last_undegraded":"2024-04-22T06:32:18.967375+0000","last_fullsized":"2024-04-22T06:32:18.967375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981387+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:32:18.981387+0000","last_peered":"2024-04-22T06:32:18.981387+0000","last_clean":"2024-04-22T06:32:18.981387+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:32:18.981387+0000","last_undegraded":"2024-04-22T06:32:18.981387+0000","last_fullsized":"2024-04-22T06:32:18.981387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967995+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:32:18.967995+0000","last_peered":"2024-04-22T06:32:18.967995+0000","last_clean":"2024-04-22T06:32:18.967995+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:32:18.967995+0000","last_undegraded":"2024-04-22T06:32:18.967995+0000","last_fullsized":"2024-04-22T06:32:18.967995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294571+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:32:19.294571+0000","last_peered":"2024-04-22T06:32:19.294571+0000","last_clean":"2024-04-22T06:32:19.294571+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:32:19.294571+0000","last_undegraded":"2024-04-22T06:32:19.294571+0000","last_fullsized":"2024-04-22T06:32:19.294571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968088+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:32:18.968088+0000","last_peered":"2024-04-22T06:32:18.968088+0000","last_clean":"2024-04-22T06:32:18.968088+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:32:18.968088+0000","last_undegraded":"2024-04-22T06:32:18.968088+0000","last_fullsized":"2024-04-22T06:32:18.968088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967971+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:32:18.967971+0000","last_peered":"2024-04-22T06:32:18.967971+0000","last_clean":"2024-04-22T06:32:18.967971+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:32:18.967971+0000","last_undegraded":"2024-04-22T06:32:18.967971+0000","last_fullsized":"2024-04-22T06:32:18.967971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.984067+0000","last_change":"2024-04-22T06:32:18.981673+0000","last_active":"2024-04-22T06:32:18.984067+0000","last_peered":"2024-04-22T06:32:18.984067+0000","last_clean":"2024-04-22T06:32:18.984067+0000","last_became_active":"2024-04-22T06:32:18.981385+0000","last_became_peered":"2024-04-22T06:32:18.981385+0000","last_unstale":"2024-04-22T06:32:18.984067+0000","last_undegraded":"2024-04-22T06:32:18.984067+0000","last_fullsized":"2024-04-22T06:32:18.984067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:12:05.631449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969001+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:32:18.969001+0000","last_peered":"2024-04-22T06:32:18.969001+0000","last_clean":"2024-04-22T06:32:18.969001+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:32:18.969001+0000","last_undegraded":"2024-04-22T06:32:18.969001+0000","last_fullsized":"2024-04-22T06:32:18.969001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981198+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:32:18.981198+0000","last_peered":"2024-04-22T06:32:18.981198+0000","last_clean":"2024-04-22T06:32:18.981198+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:32:18.981198+0000","last_undegraded":"2024-04-22T06:32:18.981198+0000","last_fullsized":"2024-04-22T06:32:18.981198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966096+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:32:18.966096+0000","last_peered":"2024-04-22T06:32:18.966096+0000","last_clean":"2024-04-22T06:32:18.966096+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:32:18.966096+0000","last_undegraded":"2024-04-22T06:32:18.966096+0000","last_fullsized":"2024-04-22T06:32:18.966096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150236+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:32:19.150236+0000","last_peered":"2024-04-22T06:32:19.150236+0000","last_clean":"2024-04-22T06:32:19.150236+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:32:19.150236+0000","last_undegraded":"2024-04-22T06:32:19.150236+0000","last_fullsized":"2024-04-22T06:32:19.150236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968293+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:32:18.968293+0000","last_peered":"2024-04-22T06:32:18.968293+0000","last_clean":"2024-04-22T06:32:18.968293+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:32:18.968293+0000","last_undegraded":"2024-04-22T06:32:18.968293+0000","last_fullsized":"2024-04-22T06:32:18.968293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968508+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:32:18.968508+0000","last_peered":"2024-04-22T06:32:18.968508+0000","last_clean":"2024-04-22T06:32:18.968508+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:32:18.968508+0000","last_undegraded":"2024-04-22T06:32:18.968508+0000","last_fullsized":"2024-04-22T06:32:18.968508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294864+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:32:19.294864+0000","last_peered":"2024-04-22T06:32:19.294864+0000","last_clean":"2024-04-22T06:32:19.294864+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:32:19.294864+0000","last_undegraded":"2024-04-22T06:32:19.294864+0000","last_fullsized":"2024-04-22T06:32:19.294864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965909+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:32:18.965909+0000","last_peered":"2024-04-22T06:32:18.965909+0000","last_clean":"2024-04-22T06:32:18.965909+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:32:18.965909+0000","last_undegraded":"2024-04-22T06:32:18.965909+0000","last_fullsized":"2024-04-22T06:32:18.965909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294097+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:32:19.294097+0000","last_peered":"2024-04-22T06:32:19.294097+0000","last_clean":"2024-04-22T06:32:19.294097+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:32:19.294097+0000","last_undegraded":"2024-04-22T06:32:19.294097+0000","last_fullsized":"2024-04-22T06:32:19.294097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967270+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:32:18.967270+0000","last_peered":"2024-04-22T06:32:18.967270+0000","last_clean":"2024-04-22T06:32:18.967270+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:32:18.967270+0000","last_undegraded":"2024-04-22T06:32:18.967270+0000","last_fullsized":"2024-04-22T06:32:18.967270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294227+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:32:19.294227+0000","last_peered":"2024-04-22T06:32:19.294227+0000","last_clean":"2024-04-22T06:32:19.294227+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:32:19.294227+0000","last_undegraded":"2024-04-22T06:32:19.294227+0000","last_fullsized":"2024-04-22T06:32:19.294227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967631+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:32:18.967631+0000","last_peered":"2024-04-22T06:32:18.967631+0000","last_clean":"2024-04-22T06:32:18.967631+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:32:18.967631+0000","last_undegraded":"2024-04-22T06:32:18.967631+0000","last_fullsized":"2024-04-22T06:32:18.967631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981168+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:32:18.981168+0000","last_peered":"2024-04-22T06:32:18.981168+0000","last_clean":"2024-04-22T06:32:18.981168+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:32:18.981168+0000","last_undegraded":"2024-04-22T06:32:18.981168+0000","last_fullsized":"2024-04-22T06:32:18.981168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969514+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:32:18.969514+0000","last_peered":"2024-04-22T06:32:18.969514+0000","last_clean":"2024-04-22T06:32:18.969514+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:32:18.969514+0000","last_undegraded":"2024-04-22T06:32:18.969514+0000","last_fullsized":"2024-04-22T06:32:18.969514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294781+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:32:19.294781+0000","last_peered":"2024-04-22T06:32:19.294781+0000","last_clean":"2024-04-22T06:32:19.294781+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:32:19.294781+0000","last_undegraded":"2024-04-22T06:32:19.294781+0000","last_fullsized":"2024-04-22T06:32:19.294781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":119909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":115823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:32:37.315 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-22T06:32:37.315 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:32:37.318 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:32:37.354 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:32:37.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.451+0000 7fc9fd9e0640 1 Processor -- start 2024-04-22T06:32:37.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.451+0000 7fc9fd9e0640 1 -- start start 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9fd9e0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9f81552c0 0x7fc9f80c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9fd9e0640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc9f815bbd0 0x7fc9f80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9fd9e0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f815afc0 con 0x7fc9f80c8990 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9fd9e0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fc9f815e5b0 con 0x7fc9f81552c0 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9fd9e0640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fc9f815e7e0 con 0x7fc9f815bbd0 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9f6ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9f81552c0 0x7fc9f80c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9effff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc9f80c8990 0x7fc9f815b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45094/0 (socket says 172.21.15.113:45094) 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9effff640 1 -- 172.21.15.113:0/2597365508 learned_addr learned my addr 172.21.15.113:0/2597365508 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9f77fe640 1 --2- 172.21.15.113:0/2597365508 >> v2:172.21.15.145:3300/0 conn(0x7fc9f815bbd0 0x7fc9f80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9f6ffd640 1 -- 172.21.15.113:0/2597365508 >> v2:172.21.15.145:3300/0 conn(0x7fc9f815bbd0 msgr2=0x7fc9f80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:37.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9f6ffd640 1 --2- 172.21.15.113:0/2597365508 >> v2:172.21.15.145:3300/0 conn(0x7fc9f815bbd0 0x7fc9f80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9f6ffd640 1 -- 172.21.15.113:0/2597365508 >> v1:172.21.15.113:6789/0 conn(0x7fc9f80c8990 legacy=0x7fc9f815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9f67fc640 1 -- 172.21.15.113:0/2597365508 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498734040 0 0) 0x7fc9f815afc0 con 0x7fc9f80c8990 2024-04-22T06:32:37.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.452+0000 7fc9f6ffd640 1 -- 172.21.15.113:0/2597365508 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f815eac0 con 0x7fc9f81552c0 2024-04-22T06:32:37.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.453+0000 7fc9f6ffd640 1 --2- 172.21.15.113:0/2597365508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f81552c0 0x7fc9f80c8450 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc9f806e6d0 tx=0x7fc9e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e195e930ecd980 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.453+0000 7fc9f67fc640 1 -- 172.21.15.113:0/2597365508 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8035020 con 0x7fc9f81552c0 2024-04-22T06:32:37.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.453+0000 7fc9f67fc640 1 -- 172.21.15.113:0/2597365508 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8031830 con 0x7fc9f81552c0 2024-04-22T06:32:37.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.453+0000 7fc9f67fc640 1 -- 172.21.15.113:0/2597365508 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8031c00 con 0x7fc9f81552c0 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.454+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/2597365508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f81552c0 msgr2=0x7fc9f80c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.454+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/2597365508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f81552c0 0x7fc9f80c8450 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc9f806e6d0 tx=0x7fc9e802b8d0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.454+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/2597365508 shutdown_connections 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.454+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/2597365508 >> v2:172.21.15.145:3300/0 conn(0x7fc9f815bbd0 0x7fc9f80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.454+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/2597365508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f81552c0 0x7fc9f80c8450 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.454+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/2597365508 >> 172.21.15.113:0/2597365508 conn(0x7fc9f8074d50 msgr2=0x7fc9f8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.454+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/2597365508 shutdown_connections 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.454+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/2597365508 wait complete. 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.455+0000 7fc9fd9e0640 1 Processor -- start 2024-04-22T06:32:37.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.455+0000 7fc9fd9e0640 1 -- start start 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9fd9e0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9f80c8990 0x7fc9f80cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9fd9e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9f81552c0 0x7fc9f8146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9fd9e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f815bbd0 0x7fc9f81f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9fd9e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f815f360 con 0x7fc9f815bbd0 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9fd9e0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f815f080 con 0x7fc9f80c8990 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9fd9e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f81556a0 con 0x7fc9f81552c0 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f815bbd0 0x7fc9f81f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f815bbd0 0x7fc9f81f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33778/0 (socket says 172.21.15.113:33778) 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 -- 172.21.15.113:0/518335774 learned_addr learned my addr 172.21.15.113:0/518335774 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f6ffd640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9f80c8990 0x7fc9f80cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9effff640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9f81552c0 0x7fc9f8146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 -- 172.21.15.113:0/518335774 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9f81552c0 msgr2=0x7fc9f8146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9f81552c0 0x7fc9f8146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 -- 172.21.15.113:0/518335774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9f80c8990 msgr2=0x7fc9f80cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9f80c8990 0x7fc9f80cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 -- 172.21.15.113:0/518335774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f8142ec0 con 0x7fc9f815bbd0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f77fe640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f815bbd0 0x7fc9f81f0ad0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0007e90 tx=0x7fc9f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f4ff9640 1 -- 172.21.15.113:0/518335774 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0014420 con 0x7fc9f815bbd0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f4ff9640 1 -- 172.21.15.113:0/518335774 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f0019070 con 0x7fc9f815bbd0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f81f41c0 con 0x7fc9f815bbd0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9f4ff9640 1 -- 172.21.15.113:0/518335774 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0014800 con 0x7fc9f815bbd0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.456+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f81f4780 con 0x7fc9f815bbd0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.457+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f8068e40 con 0x7fc9f815bbd0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.458+0000 7fc9f4ff9640 1 -- 172.21.15.113:0/518335774 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9f00149a0 con 0x7fc9f815bbd0 2024-04-22T06:32:37.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.458+0000 7fc9f4ff9640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc9d806c920 0x7fc9d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.459+0000 7fc9f4ff9640 1 -- 172.21.15.113:0/518335774 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc9f008c6b0 con 0x7fc9f815bbd0 2024-04-22T06:32:37.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.459+0000 7fc9f6ffd640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc9d806c920 0x7fc9d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.459+0000 7fc9f6ffd640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc9d806c920 0x7fc9d806ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8036000 tx=0x7fc9e8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.467+0000 7fc9f4ff9640 1 -- 172.21.15.113:0/518335774 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9f005a6e0 con 0x7fc9f815bbd0 2024-04-22T06:32:37.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.645+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9f814f340 con 0x7fc9d806c920 2024-04-22T06:32:37.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.652+0000 7fc9f4ff9640 1 -- 172.21.15.113:0/518335774 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332634 (secure 0 0 0) 0x7fc9f814f340 con 0x7fc9d806c920 2024-04-22T06:32:37.655 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:37.657 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:32:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc9d806c920 msgr2=0x7fc9d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc9d806c920 0x7fc9d806ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8036000 tx=0x7fc9e8008030 comp rx=0 tx=0).stop 2024-04-22T06:32:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f815bbd0 msgr2=0x7fc9f81f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f815bbd0 0x7fc9f81f0ad0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0007e90 tx=0x7fc9f000e4b0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 shutdown_connections 2024-04-22T06:32:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc9d806c920 0x7fc9d806ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9f815bbd0 0x7fc9f81f0ad0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc9f81552c0 0x7fc9f8146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 --2- 172.21.15.113:0/518335774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc9f80c8990 0x7fc9f80cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 >> 172.21.15.113:0/518335774 conn(0x7fc9f8074d50 msgr2=0x7fc9f8152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:37.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 shutdown_connections 2024-04-22T06:32:37.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.656+0000 7fc9fd9e0640 1 -- 172.21.15.113:0/518335774 wait complete. 2024-04-22T06:32:37.666 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-22T06:32:36.981977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219720,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755000,"statfs":{"total":773094113280,"available":772869120000,"internally_reserved":0,"allocated":3678208,"data_stored":2119239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002841"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979849+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:32:24.979849+0000","last_peered":"2024-04-22T06:32:24.979849+0000","last_clean":"2024-04-22T06:32:24.979849+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:32:24.979849+0000","last_undegraded":"2024-04-22T06:32:24.979849+0000","last_fullsized":"2024-04-22T06:32:24.979849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966555+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:32:18.966555+0000","last_peered":"2024-04-22T06:32:18.966555+0000","last_clean":"2024-04-22T06:32:18.966555+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:32:18.966555+0000","last_undegraded":"2024-04-22T06:32:18.966555+0000","last_fullsized":"2024-04-22T06:32:18.966555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965851+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:32:18.965851+0000","last_peered":"2024-04-22T06:32:18.965851+0000","last_clean":"2024-04-22T06:32:18.965851+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:32:18.965851+0000","last_undegraded":"2024-04-22T06:32:18.965851+0000","last_fullsized":"2024-04-22T06:32:18.965851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966745+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:32:18.966745+0000","last_peered":"2024-04-22T06:32:18.966745+0000","last_clean":"2024-04-22T06:32:18.966745+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:32:18.966745+0000","last_undegraded":"2024-04-22T06:32:18.966745+0000","last_fullsized":"2024-04-22T06:32:18.966745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981681+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:32:18.981681+0000","last_peered":"2024-04-22T06:32:18.981681+0000","last_clean":"2024-04-22T06:32:18.981681+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:32:18.981681+0000","last_undegraded":"2024-04-22T06:32:18.981681+0000","last_fullsized":"2024-04-22T06:32:18.981681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149424+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:32:19.149424+0000","last_peered":"2024-04-22T06:32:19.149424+0000","last_clean":"2024-04-22T06:32:19.149424+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:32:19.149424+0000","last_undegraded":"2024-04-22T06:32:19.149424+0000","last_fullsized":"2024-04-22T06:32:19.149424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982683+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:32:24.982683+0000","last_peered":"2024-04-22T06:32:24.982683+0000","last_clean":"2024-04-22T06:32:24.982683+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:32:24.982683+0000","last_undegraded":"2024-04-22T06:32:24.982683+0000","last_fullsized":"2024-04-22T06:32:24.982683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151734+0000","last_change":"2024-04-22T06:32:19.150976+0000","last_active":"2024-04-22T06:32:19.151734+0000","last_peered":"2024-04-22T06:32:19.151734+0000","last_clean":"2024-04-22T06:32:19.151734+0000","last_became_active":"2024-04-22T06:32:19.150701+0000","last_became_peered":"2024-04-22T06:32:19.150701+0000","last_unstale":"2024-04-22T06:32:19.151734+0000","last_undegraded":"2024-04-22T06:32:19.151734+0000","last_fullsized":"2024-04-22T06:32:19.151734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:03:07.842684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149873+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:32:19.149873+0000","last_peered":"2024-04-22T06:32:19.149873+0000","last_clean":"2024-04-22T06:32:19.149873+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:32:19.149873+0000","last_undegraded":"2024-04-22T06:32:19.149873+0000","last_fullsized":"2024-04-22T06:32:19.149873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979700+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:32:24.979700+0000","last_peered":"2024-04-22T06:32:24.979700+0000","last_clean":"2024-04-22T06:32:24.979700+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:32:24.979700+0000","last_undegraded":"2024-04-22T06:32:24.979700+0000","last_fullsized":"2024-04-22T06:32:24.979700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967622+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:32:18.967622+0000","last_peered":"2024-04-22T06:32:18.967622+0000","last_clean":"2024-04-22T06:32:18.967622+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:32:18.967622+0000","last_undegraded":"2024-04-22T06:32:18.967622+0000","last_fullsized":"2024-04-22T06:32:18.967622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149778+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:32:19.149778+0000","last_peered":"2024-04-22T06:32:19.149778+0000","last_clean":"2024-04-22T06:32:19.149778+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:32:19.149778+0000","last_undegraded":"2024-04-22T06:32:19.149778+0000","last_fullsized":"2024-04-22T06:32:19.149778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966853+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:32:18.966853+0000","last_peered":"2024-04-22T06:32:18.966853+0000","last_clean":"2024-04-22T06:32:18.966853+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:32:18.966853+0000","last_undegraded":"2024-04-22T06:32:18.966853+0000","last_fullsized":"2024-04-22T06:32:18.966853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294409+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:32:19.294409+0000","last_peered":"2024-04-22T06:32:19.294409+0000","last_clean":"2024-04-22T06:32:19.294409+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:32:19.294409+0000","last_undegraded":"2024-04-22T06:32:19.294409+0000","last_fullsized":"2024-04-22T06:32:19.294409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150210+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:32:19.150210+0000","last_peered":"2024-04-22T06:32:19.150210+0000","last_clean":"2024-04-22T06:32:19.150210+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:32:19.150210+0000","last_undegraded":"2024-04-22T06:32:19.150210+0000","last_fullsized":"2024-04-22T06:32:19.150210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966124+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:32:18.966124+0000","last_peered":"2024-04-22T06:32:18.966124+0000","last_clean":"2024-04-22T06:32:18.966124+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:32:18.966124+0000","last_undegraded":"2024-04-22T06:32:18.966124+0000","last_fullsized":"2024-04-22T06:32:18.966124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969749+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:32:18.969749+0000","last_peered":"2024-04-22T06:32:18.969749+0000","last_clean":"2024-04-22T06:32:18.969749+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:32:18.969749+0000","last_undegraded":"2024-04-22T06:32:18.969749+0000","last_fullsized":"2024-04-22T06:32:18.969749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150005+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:32:19.150005+0000","last_peered":"2024-04-22T06:32:19.150005+0000","last_clean":"2024-04-22T06:32:19.150005+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:32:19.150005+0000","last_undegraded":"2024-04-22T06:32:19.150005+0000","last_fullsized":"2024-04-22T06:32:19.150005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966111+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:32:18.966111+0000","last_peered":"2024-04-22T06:32:18.966111+0000","last_clean":"2024-04-22T06:32:18.966111+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:32:18.966111+0000","last_undegraded":"2024-04-22T06:32:18.966111+0000","last_fullsized":"2024-04-22T06:32:18.966111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978562+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:32:24.978562+0000","last_peered":"2024-04-22T06:32:24.978562+0000","last_clean":"2024-04-22T06:32:24.978562+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:32:24.978562+0000","last_undegraded":"2024-04-22T06:32:24.978562+0000","last_fullsized":"2024-04-22T06:32:24.978562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969457+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:32:18.969457+0000","last_peered":"2024-04-22T06:32:18.969457+0000","last_clean":"2024-04-22T06:32:18.969457+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:32:18.969457+0000","last_undegraded":"2024-04-22T06:32:18.969457+0000","last_fullsized":"2024-04-22T06:32:18.969457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149852+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:32:19.149852+0000","last_peered":"2024-04-22T06:32:19.149852+0000","last_clean":"2024-04-22T06:32:19.149852+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:32:19.149852+0000","last_undegraded":"2024-04-22T06:32:19.149852+0000","last_fullsized":"2024-04-22T06:32:19.149852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.293907+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:32:19.293907+0000","last_peered":"2024-04-22T06:32:19.293907+0000","last_clean":"2024-04-22T06:32:19.293907+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:32:19.293907+0000","last_undegraded":"2024-04-22T06:32:19.293907+0000","last_fullsized":"2024-04-22T06:32:19.293907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150066+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:32:19.150066+0000","last_peered":"2024-04-22T06:32:19.150066+0000","last_clean":"2024-04-22T06:32:19.150066+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:32:19.150066+0000","last_undegraded":"2024-04-22T06:32:19.150066+0000","last_fullsized":"2024-04-22T06:32:19.150066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981653+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:32:18.981653+0000","last_peered":"2024-04-22T06:32:18.981653+0000","last_clean":"2024-04-22T06:32:18.981653+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:32:18.981653+0000","last_undegraded":"2024-04-22T06:32:18.981653+0000","last_fullsized":"2024-04-22T06:32:18.981653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.981798+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:32:24.981798+0000","last_peered":"2024-04-22T06:32:24.981798+0000","last_clean":"2024-04-22T06:32:24.981798+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:32:24.981798+0000","last_undegraded":"2024-04-22T06:32:24.981798+0000","last_fullsized":"2024-04-22T06:32:24.981798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149673+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:32:19.149673+0000","last_peered":"2024-04-22T06:32:19.149673+0000","last_clean":"2024-04-22T06:32:19.149673+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:32:19.149673+0000","last_undegraded":"2024-04-22T06:32:19.149673+0000","last_fullsized":"2024-04-22T06:32:19.149673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966813+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:32:18.966813+0000","last_peered":"2024-04-22T06:32:18.966813+0000","last_clean":"2024-04-22T06:32:18.966813+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:32:18.966813+0000","last_undegraded":"2024-04-22T06:32:18.966813+0000","last_fullsized":"2024-04-22T06:32:18.966813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969615+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:32:18.969615+0000","last_peered":"2024-04-22T06:32:18.969615+0000","last_clean":"2024-04-22T06:32:18.969615+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:32:18.969615+0000","last_undegraded":"2024-04-22T06:32:18.969615+0000","last_fullsized":"2024-04-22T06:32:18.969615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965797+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:32:18.965797+0000","last_peered":"2024-04-22T06:32:18.965797+0000","last_clean":"2024-04-22T06:32:18.965797+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:32:18.965797+0000","last_undegraded":"2024-04-22T06:32:18.965797+0000","last_fullsized":"2024-04-22T06:32:18.965797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969571+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:32:18.969571+0000","last_peered":"2024-04-22T06:32:18.969571+0000","last_clean":"2024-04-22T06:32:18.969571+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:32:18.969571+0000","last_undegraded":"2024-04-22T06:32:18.969571+0000","last_fullsized":"2024-04-22T06:32:18.969571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294699+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:32:19.294699+0000","last_peered":"2024-04-22T06:32:19.294699+0000","last_clean":"2024-04-22T06:32:19.294699+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:32:19.294699+0000","last_undegraded":"2024-04-22T06:32:19.294699+0000","last_fullsized":"2024-04-22T06:32:19.294699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981307+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:32:18.981307+0000","last_peered":"2024-04-22T06:32:18.981307+0000","last_clean":"2024-04-22T06:32:18.981307+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:32:18.981307+0000","last_undegraded":"2024-04-22T06:32:18.981307+0000","last_fullsized":"2024-04-22T06:32:18.981307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967531+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:32:18.967531+0000","last_peered":"2024-04-22T06:32:18.967531+0000","last_clean":"2024-04-22T06:32:18.967531+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:32:18.967531+0000","last_undegraded":"2024-04-22T06:32:18.967531+0000","last_fullsized":"2024-04-22T06:32:18.967531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969637+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:32:18.969637+0000","last_peered":"2024-04-22T06:32:18.969637+0000","last_clean":"2024-04-22T06:32:18.969637+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:32:18.969637+0000","last_undegraded":"2024-04-22T06:32:18.969637+0000","last_fullsized":"2024-04-22T06:32:18.969637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969213+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:32:18.969213+0000","last_peered":"2024-04-22T06:32:18.969213+0000","last_clean":"2024-04-22T06:32:18.969213+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:32:18.969213+0000","last_undegraded":"2024-04-22T06:32:18.969213+0000","last_fullsized":"2024-04-22T06:32:18.969213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150313+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:32:19.150313+0000","last_peered":"2024-04-22T06:32:19.150313+0000","last_clean":"2024-04-22T06:32:19.150313+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:32:19.150313+0000","last_undegraded":"2024-04-22T06:32:19.150313+0000","last_fullsized":"2024-04-22T06:32:19.150313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978693+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:32:24.978693+0000","last_peered":"2024-04-22T06:32:24.978693+0000","last_clean":"2024-04-22T06:32:24.978693+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:32:24.978693+0000","last_undegraded":"2024-04-22T06:32:24.978693+0000","last_fullsized":"2024-04-22T06:32:24.978693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969492+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:32:18.969492+0000","last_peered":"2024-04-22T06:32:18.969492+0000","last_clean":"2024-04-22T06:32:18.969492+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:32:18.969492+0000","last_undegraded":"2024-04-22T06:32:18.969492+0000","last_fullsized":"2024-04-22T06:32:18.969492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968986+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:32:18.968986+0000","last_peered":"2024-04-22T06:32:18.968986+0000","last_clean":"2024-04-22T06:32:18.968986+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:32:18.968986+0000","last_undegraded":"2024-04-22T06:32:18.968986+0000","last_fullsized":"2024-04-22T06:32:18.968986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978504+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:32:24.978504+0000","last_peered":"2024-04-22T06:32:24.978504+0000","last_clean":"2024-04-22T06:32:24.978504+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:32:24.978504+0000","last_undegraded":"2024-04-22T06:32:24.978504+0000","last_fullsized":"2024-04-22T06:32:24.978504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969478+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:32:18.969478+0000","last_peered":"2024-04-22T06:32:18.969478+0000","last_clean":"2024-04-22T06:32:18.969478+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:32:18.969478+0000","last_undegraded":"2024-04-22T06:32:18.969478+0000","last_fullsized":"2024-04-22T06:32:18.969478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981002+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:32:18.981002+0000","last_peered":"2024-04-22T06:32:18.981002+0000","last_clean":"2024-04-22T06:32:18.981002+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:32:18.981002+0000","last_undegraded":"2024-04-22T06:32:18.981002+0000","last_fullsized":"2024-04-22T06:32:18.981002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294057+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:32:19.294057+0000","last_peered":"2024-04-22T06:32:19.294057+0000","last_clean":"2024-04-22T06:32:19.294057+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:32:19.294057+0000","last_undegraded":"2024-04-22T06:32:19.294057+0000","last_fullsized":"2024-04-22T06:32:19.294057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981530+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:32:18.981530+0000","last_peered":"2024-04-22T06:32:18.981530+0000","last_clean":"2024-04-22T06:32:18.981530+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:32:18.981530+0000","last_undegraded":"2024-04-22T06:32:18.981530+0000","last_fullsized":"2024-04-22T06:32:18.981530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966072+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:32:18.966072+0000","last_peered":"2024-04-22T06:32:18.966072+0000","last_clean":"2024-04-22T06:32:18.966072+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:32:18.966072+0000","last_undegraded":"2024-04-22T06:32:18.966072+0000","last_fullsized":"2024-04-22T06:32:18.966072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967351+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:32:18.967351+0000","last_peered":"2024-04-22T06:32:18.967351+0000","last_clean":"2024-04-22T06:32:18.967351+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:32:18.967351+0000","last_undegraded":"2024-04-22T06:32:18.967351+0000","last_fullsized":"2024-04-22T06:32:18.967351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294046+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:32:19.294046+0000","last_peered":"2024-04-22T06:32:19.294046+0000","last_clean":"2024-04-22T06:32:19.294046+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:32:19.294046+0000","last_undegraded":"2024-04-22T06:32:19.294046+0000","last_fullsized":"2024-04-22T06:32:19.294046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968137+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:32:18.968137+0000","last_peered":"2024-04-22T06:32:18.968137+0000","last_clean":"2024-04-22T06:32:18.968137+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:32:18.968137+0000","last_undegraded":"2024-04-22T06:32:18.968137+0000","last_fullsized":"2024-04-22T06:32:18.968137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294428+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:32:19.294428+0000","last_peered":"2024-04-22T06:32:19.294428+0000","last_clean":"2024-04-22T06:32:19.294428+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:32:19.294428+0000","last_undegraded":"2024-04-22T06:32:19.294428+0000","last_fullsized":"2024-04-22T06:32:19.294428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968415+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:32:18.968415+0000","last_peered":"2024-04-22T06:32:18.968415+0000","last_clean":"2024-04-22T06:32:18.968415+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:32:18.968415+0000","last_undegraded":"2024-04-22T06:32:18.968415+0000","last_fullsized":"2024-04-22T06:32:18.968415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966730+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:32:18.966730+0000","last_peered":"2024-04-22T06:32:18.966730+0000","last_clean":"2024-04-22T06:32:18.966730+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:32:18.966730+0000","last_undegraded":"2024-04-22T06:32:18.966730+0000","last_fullsized":"2024-04-22T06:32:18.966730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967818+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:32:18.967818+0000","last_peered":"2024-04-22T06:32:18.967818+0000","last_clean":"2024-04-22T06:32:18.967818+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:32:18.967818+0000","last_undegraded":"2024-04-22T06:32:18.967818+0000","last_fullsized":"2024-04-22T06:32:18.967818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969689+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:32:18.969689+0000","last_peered":"2024-04-22T06:32:18.969689+0000","last_clean":"2024-04-22T06:32:18.969689+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:32:18.969689+0000","last_undegraded":"2024-04-22T06:32:18.969689+0000","last_fullsized":"2024-04-22T06:32:18.969689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981441+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:32:18.981441+0000","last_peered":"2024-04-22T06:32:18.981441+0000","last_clean":"2024-04-22T06:32:18.981441+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:32:18.981441+0000","last_undegraded":"2024-04-22T06:32:18.981441+0000","last_fullsized":"2024-04-22T06:32:18.981441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151685+0000","last_change":"2024-04-22T06:32:19.151055+0000","last_active":"2024-04-22T06:32:19.151685+0000","last_peered":"2024-04-22T06:32:19.151685+0000","last_clean":"2024-04-22T06:32:19.151685+0000","last_became_active":"2024-04-22T06:32:19.150732+0000","last_became_peered":"2024-04-22T06:32:19.150732+0000","last_unstale":"2024-04-22T06:32:19.151685+0000","last_undegraded":"2024-04-22T06:32:19.151685+0000","last_fullsized":"2024-04-22T06:32:19.151685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:52:54.156456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.975775+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:32:24.975775+0000","last_peered":"2024-04-22T06:32:24.975775+0000","last_clean":"2024-04-22T06:32:24.975775+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:32:24.975775+0000","last_undegraded":"2024-04-22T06:32:24.975775+0000","last_fullsized":"2024-04-22T06:32:24.975775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966483+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:32:18.966483+0000","last_peered":"2024-04-22T06:32:18.966483+0000","last_clean":"2024-04-22T06:32:18.966483+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:32:18.966483+0000","last_undegraded":"2024-04-22T06:32:18.966483+0000","last_fullsized":"2024-04-22T06:32:18.966483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294596+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:32:19.294596+0000","last_peered":"2024-04-22T06:32:19.294596+0000","last_clean":"2024-04-22T06:32:19.294596+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:32:19.294596+0000","last_undegraded":"2024-04-22T06:32:19.294596+0000","last_fullsized":"2024-04-22T06:32:19.294596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150264+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:32:19.150264+0000","last_peered":"2024-04-22T06:32:19.150264+0000","last_clean":"2024-04-22T06:32:19.150264+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:32:19.150264+0000","last_undegraded":"2024-04-22T06:32:19.150264+0000","last_fullsized":"2024-04-22T06:32:19.150264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149416+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:32:19.149416+0000","last_peered":"2024-04-22T06:32:19.149416+0000","last_clean":"2024-04-22T06:32:19.149416+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:32:19.149416+0000","last_undegraded":"2024-04-22T06:32:19.149416+0000","last_fullsized":"2024-04-22T06:32:19.149416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294298+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:32:19.294298+0000","last_peered":"2024-04-22T06:32:19.294298+0000","last_clean":"2024-04-22T06:32:19.294298+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:32:19.294298+0000","last_undegraded":"2024-04-22T06:32:19.294298+0000","last_fullsized":"2024-04-22T06:32:19.294298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968595+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:32:18.968595+0000","last_peered":"2024-04-22T06:32:18.968595+0000","last_clean":"2024-04-22T06:32:18.968595+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:32:18.968595+0000","last_undegraded":"2024-04-22T06:32:18.968595+0000","last_fullsized":"2024-04-22T06:32:18.968595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981432+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:32:18.981432+0000","last_peered":"2024-04-22T06:32:18.981432+0000","last_clean":"2024-04-22T06:32:18.981432+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:32:18.981432+0000","last_undegraded":"2024-04-22T06:32:18.981432+0000","last_fullsized":"2024-04-22T06:32:18.981432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967559+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:32:18.967559+0000","last_peered":"2024-04-22T06:32:18.967559+0000","last_clean":"2024-04-22T06:32:18.967559+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:32:18.967559+0000","last_undegraded":"2024-04-22T06:32:18.967559+0000","last_fullsized":"2024-04-22T06:32:18.967559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967066+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:32:18.967066+0000","last_peered":"2024-04-22T06:32:18.967066+0000","last_clean":"2024-04-22T06:32:18.967066+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:32:18.967066+0000","last_undegraded":"2024-04-22T06:32:18.967066+0000","last_fullsized":"2024-04-22T06:32:18.967066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966623+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:32:18.966623+0000","last_peered":"2024-04-22T06:32:18.966623+0000","last_clean":"2024-04-22T06:32:18.966623+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:32:18.966623+0000","last_undegraded":"2024-04-22T06:32:18.966623+0000","last_fullsized":"2024-04-22T06:32:18.966623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294251+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:32:19.294251+0000","last_peered":"2024-04-22T06:32:19.294251+0000","last_clean":"2024-04-22T06:32:19.294251+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:32:19.294251+0000","last_undegraded":"2024-04-22T06:32:19.294251+0000","last_fullsized":"2024-04-22T06:32:19.294251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967610+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:32:18.967610+0000","last_peered":"2024-04-22T06:32:18.967610+0000","last_clean":"2024-04-22T06:32:18.967610+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:32:18.967610+0000","last_undegraded":"2024-04-22T06:32:18.967610+0000","last_fullsized":"2024-04-22T06:32:18.967610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966452+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:32:18.966452+0000","last_peered":"2024-04-22T06:32:18.966452+0000","last_clean":"2024-04-22T06:32:18.966452+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:32:18.966452+0000","last_undegraded":"2024-04-22T06:32:18.966452+0000","last_fullsized":"2024-04-22T06:32:18.966452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981284+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:32:18.981284+0000","last_peered":"2024-04-22T06:32:18.981284+0000","last_clean":"2024-04-22T06:32:18.981284+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:32:18.981284+0000","last_undegraded":"2024-04-22T06:32:18.981284+0000","last_fullsized":"2024-04-22T06:32:18.981284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.976916+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:32:24.976916+0000","last_peered":"2024-04-22T06:32:24.976916+0000","last_clean":"2024-04-22T06:32:24.976916+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:32:24.976916+0000","last_undegraded":"2024-04-22T06:32:24.976916+0000","last_fullsized":"2024-04-22T06:32:24.976916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967410+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:32:18.967410+0000","last_peered":"2024-04-22T06:32:18.967410+0000","last_clean":"2024-04-22T06:32:18.967410+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:32:18.967410+0000","last_undegraded":"2024-04-22T06:32:18.967410+0000","last_fullsized":"2024-04-22T06:32:18.967410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294312+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:32:19.294312+0000","last_peered":"2024-04-22T06:32:19.294312+0000","last_clean":"2024-04-22T06:32:19.294312+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:32:19.294312+0000","last_undegraded":"2024-04-22T06:32:19.294312+0000","last_fullsized":"2024-04-22T06:32:19.294312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.261148+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:32:33.261148+0000","last_peered":"2024-04-22T06:32:33.261148+0000","last_clean":"2024-04-22T06:32:33.261148+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:32:33.261148+0000","last_undegraded":"2024-04-22T06:32:33.261148+0000","last_fullsized":"2024-04-22T06:32:33.261148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969452+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:32:18.969452+0000","last_peered":"2024-04-22T06:32:18.969452+0000","last_clean":"2024-04-22T06:32:18.969452+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:32:18.969452+0000","last_undegraded":"2024-04-22T06:32:18.969452+0000","last_fullsized":"2024-04-22T06:32:18.969452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150153+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:32:19.150153+0000","last_peered":"2024-04-22T06:32:19.150153+0000","last_clean":"2024-04-22T06:32:19.150153+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:32:19.150153+0000","last_undegraded":"2024-04-22T06:32:19.150153+0000","last_fullsized":"2024-04-22T06:32:19.150153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969410+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:32:18.969410+0000","last_peered":"2024-04-22T06:32:18.969410+0000","last_clean":"2024-04-22T06:32:18.969410+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:32:18.969410+0000","last_undegraded":"2024-04-22T06:32:18.969410+0000","last_fullsized":"2024-04-22T06:32:18.969410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150044+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:32:19.150044+0000","last_peered":"2024-04-22T06:32:19.150044+0000","last_clean":"2024-04-22T06:32:19.150044+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:32:19.150044+0000","last_undegraded":"2024-04-22T06:32:19.150044+0000","last_fullsized":"2024-04-22T06:32:19.150044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981777+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:32:18.981777+0000","last_peered":"2024-04-22T06:32:18.981777+0000","last_clean":"2024-04-22T06:32:18.981777+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:32:18.981777+0000","last_undegraded":"2024-04-22T06:32:18.981777+0000","last_fullsized":"2024-04-22T06:32:18.981777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979367+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:32:24.979367+0000","last_peered":"2024-04-22T06:32:24.979367+0000","last_clean":"2024-04-22T06:32:24.979367+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:32:24.979367+0000","last_undegraded":"2024-04-22T06:32:24.979367+0000","last_fullsized":"2024-04-22T06:32:24.979367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965918+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:32:18.965918+0000","last_peered":"2024-04-22T06:32:18.965918+0000","last_clean":"2024-04-22T06:32:18.965918+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:32:18.965918+0000","last_undegraded":"2024-04-22T06:32:18.965918+0000","last_fullsized":"2024-04-22T06:32:18.965918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967599+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:32:18.967599+0000","last_peered":"2024-04-22T06:32:18.967599+0000","last_clean":"2024-04-22T06:32:18.967599+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:32:18.967599+0000","last_undegraded":"2024-04-22T06:32:18.967599+0000","last_fullsized":"2024-04-22T06:32:18.967599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968898+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:32:18.968898+0000","last_peered":"2024-04-22T06:32:18.968898+0000","last_clean":"2024-04-22T06:32:18.968898+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:32:18.968898+0000","last_undegraded":"2024-04-22T06:32:18.968898+0000","last_fullsized":"2024-04-22T06:32:18.968898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965891+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:32:18.965891+0000","last_peered":"2024-04-22T06:32:18.965891+0000","last_clean":"2024-04-22T06:32:18.965891+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:32:18.965891+0000","last_undegraded":"2024-04-22T06:32:18.965891+0000","last_fullsized":"2024-04-22T06:32:18.965891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981056+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:32:18.981056+0000","last_peered":"2024-04-22T06:32:18.981056+0000","last_clean":"2024-04-22T06:32:18.981056+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:32:18.981056+0000","last_undegraded":"2024-04-22T06:32:18.981056+0000","last_fullsized":"2024-04-22T06:32:18.981056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968899+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:32:18.968899+0000","last_peered":"2024-04-22T06:32:18.968899+0000","last_clean":"2024-04-22T06:32:18.968899+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:32:18.968899+0000","last_undegraded":"2024-04-22T06:32:18.968899+0000","last_fullsized":"2024-04-22T06:32:18.968899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966973+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:32:18.966973+0000","last_peered":"2024-04-22T06:32:18.966973+0000","last_clean":"2024-04-22T06:32:18.966973+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:32:18.966973+0000","last_undegraded":"2024-04-22T06:32:18.966973+0000","last_fullsized":"2024-04-22T06:32:18.966973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.982812+0000","last_change":"2024-04-22T06:32:18.982812+0000","last_active":"2024-04-22T06:32:18.982812+0000","last_peered":"2024-04-22T06:32:18.982812+0000","last_clean":"2024-04-22T06:32:18.982812+0000","last_became_active":"2024-04-22T06:32:18.982355+0000","last_became_peered":"2024-04-22T06:32:18.982355+0000","last_unstale":"2024-04-22T06:32:18.982812+0000","last_undegraded":"2024-04-22T06:32:18.982812+0000","last_fullsized":"2024-04-22T06:32:18.982812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:01:41.368881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966015+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:32:18.966015+0000","last_peered":"2024-04-22T06:32:18.966015+0000","last_clean":"2024-04-22T06:32:18.966015+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:32:18.966015+0000","last_undegraded":"2024-04-22T06:32:18.966015+0000","last_fullsized":"2024-04-22T06:32:18.966015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966324+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:32:18.966324+0000","last_peered":"2024-04-22T06:32:18.966324+0000","last_clean":"2024-04-22T06:32:18.966324+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:32:18.966324+0000","last_undegraded":"2024-04-22T06:32:18.966324+0000","last_fullsized":"2024-04-22T06:32:18.966324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967052+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:32:18.967052+0000","last_peered":"2024-04-22T06:32:18.967052+0000","last_clean":"2024-04-22T06:32:18.967052+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:32:18.967052+0000","last_undegraded":"2024-04-22T06:32:18.967052+0000","last_fullsized":"2024-04-22T06:32:18.967052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981529+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:32:18.981529+0000","last_peered":"2024-04-22T06:32:18.981529+0000","last_clean":"2024-04-22T06:32:18.981529+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:32:18.981529+0000","last_undegraded":"2024-04-22T06:32:18.981529+0000","last_fullsized":"2024-04-22T06:32:18.981529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.982586+0000","last_change":"2024-04-22T06:32:18.982586+0000","last_active":"2024-04-22T06:32:18.982586+0000","last_peered":"2024-04-22T06:32:18.982586+0000","last_clean":"2024-04-22T06:32:18.982586+0000","last_became_active":"2024-04-22T06:32:18.982159+0000","last_became_peered":"2024-04-22T06:32:18.982159+0000","last_unstale":"2024-04-22T06:32:18.982586+0000","last_undegraded":"2024-04-22T06:32:18.982586+0000","last_fullsized":"2024-04-22T06:32:18.982586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:37.104899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966312+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:32:18.966312+0000","last_peered":"2024-04-22T06:32:18.966312+0000","last_clean":"2024-04-22T06:32:18.966312+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:32:18.966312+0000","last_undegraded":"2024-04-22T06:32:18.966312+0000","last_fullsized":"2024-04-22T06:32:18.966312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149928+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:32:19.149928+0000","last_peered":"2024-04-22T06:32:19.149928+0000","last_clean":"2024-04-22T06:32:19.149928+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:32:19.149928+0000","last_undegraded":"2024-04-22T06:32:19.149928+0000","last_fullsized":"2024-04-22T06:32:19.149928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.151801+0000","last_change":"2024-04-22T06:32:19.151801+0000","last_active":"2024-04-22T06:32:19.151801+0000","last_peered":"2024-04-22T06:32:19.151801+0000","last_clean":"2024-04-22T06:32:19.151801+0000","last_became_active":"2024-04-22T06:32:19.151353+0000","last_became_peered":"2024-04-22T06:32:19.151353+0000","last_unstale":"2024-04-22T06:32:19.151801+0000","last_undegraded":"2024-04-22T06:32:19.151801+0000","last_fullsized":"2024-04-22T06:32:19.151801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:11.699970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967391+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:32:18.967391+0000","last_peered":"2024-04-22T06:32:18.967391+0000","last_clean":"2024-04-22T06:32:18.967391+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:32:18.967391+0000","last_undegraded":"2024-04-22T06:32:18.967391+0000","last_fullsized":"2024-04-22T06:32:18.967391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967847+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:32:18.967847+0000","last_peered":"2024-04-22T06:32:18.967847+0000","last_clean":"2024-04-22T06:32:18.967847+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:32:18.967847+0000","last_undegraded":"2024-04-22T06:32:18.967847+0000","last_fullsized":"2024-04-22T06:32:18.967847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967467+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:32:18.967467+0000","last_peered":"2024-04-22T06:32:18.967467+0000","last_clean":"2024-04-22T06:32:18.967467+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:32:18.967467+0000","last_undegraded":"2024-04-22T06:32:18.967467+0000","last_fullsized":"2024-04-22T06:32:18.967467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981470+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:32:18.981470+0000","last_peered":"2024-04-22T06:32:18.981470+0000","last_clean":"2024-04-22T06:32:18.981470+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:32:18.981470+0000","last_undegraded":"2024-04-22T06:32:18.981470+0000","last_fullsized":"2024-04-22T06:32:18.981470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966631+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:32:18.966631+0000","last_peered":"2024-04-22T06:32:18.966631+0000","last_clean":"2024-04-22T06:32:18.966631+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:32:18.966631+0000","last_undegraded":"2024-04-22T06:32:18.966631+0000","last_fullsized":"2024-04-22T06:32:18.966631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969267+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:32:18.969267+0000","last_peered":"2024-04-22T06:32:18.969267+0000","last_clean":"2024-04-22T06:32:18.969267+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:32:18.969267+0000","last_undegraded":"2024-04-22T06:32:18.969267+0000","last_fullsized":"2024-04-22T06:32:18.969267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968549+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:32:18.968549+0000","last_peered":"2024-04-22T06:32:18.968549+0000","last_clean":"2024-04-22T06:32:18.968549+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:32:18.968549+0000","last_undegraded":"2024-04-22T06:32:18.968549+0000","last_fullsized":"2024-04-22T06:32:18.968549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.153901+0000","last_change":"2024-04-22T06:32:19.151471+0000","last_active":"2024-04-22T06:32:19.153901+0000","last_peered":"2024-04-22T06:32:19.153901+0000","last_clean":"2024-04-22T06:32:19.153901+0000","last_became_active":"2024-04-22T06:32:19.151207+0000","last_became_peered":"2024-04-22T06:32:19.151207+0000","last_unstale":"2024-04-22T06:32:19.153901+0000","last_undegraded":"2024-04-22T06:32:19.153901+0000","last_fullsized":"2024-04-22T06:32:19.153901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:37:11.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966603+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:32:18.966603+0000","last_peered":"2024-04-22T06:32:18.966603+0000","last_clean":"2024-04-22T06:32:18.966603+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:32:18.966603+0000","last_undegraded":"2024-04-22T06:32:18.966603+0000","last_fullsized":"2024-04-22T06:32:18.966603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966400+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:32:18.966400+0000","last_peered":"2024-04-22T06:32:18.966400+0000","last_clean":"2024-04-22T06:32:18.966400+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:32:18.966400+0000","last_undegraded":"2024-04-22T06:32:18.966400+0000","last_fullsized":"2024-04-22T06:32:18.966400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967375+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:32:18.967375+0000","last_peered":"2024-04-22T06:32:18.967375+0000","last_clean":"2024-04-22T06:32:18.967375+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:32:18.967375+0000","last_undegraded":"2024-04-22T06:32:18.967375+0000","last_fullsized":"2024-04-22T06:32:18.967375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981387+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:32:18.981387+0000","last_peered":"2024-04-22T06:32:18.981387+0000","last_clean":"2024-04-22T06:32:18.981387+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:32:18.981387+0000","last_undegraded":"2024-04-22T06:32:18.981387+0000","last_fullsized":"2024-04-22T06:32:18.981387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967995+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:32:18.967995+0000","last_peered":"2024-04-22T06:32:18.967995+0000","last_clean":"2024-04-22T06:32:18.967995+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:32:18.967995+0000","last_undegraded":"2024-04-22T06:32:18.967995+0000","last_fullsized":"2024-04-22T06:32:18.967995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294571+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:32:19.294571+0000","last_peered":"2024-04-22T06:32:19.294571+0000","last_clean":"2024-04-22T06:32:19.294571+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:32:19.294571+0000","last_undegraded":"2024-04-22T06:32:19.294571+0000","last_fullsized":"2024-04-22T06:32:19.294571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968088+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:32:18.968088+0000","last_peered":"2024-04-22T06:32:18.968088+0000","last_clean":"2024-04-22T06:32:18.968088+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:32:18.968088+0000","last_undegraded":"2024-04-22T06:32:18.968088+0000","last_fullsized":"2024-04-22T06:32:18.968088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967971+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:32:18.967971+0000","last_peered":"2024-04-22T06:32:18.967971+0000","last_clean":"2024-04-22T06:32:18.967971+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:32:18.967971+0000","last_undegraded":"2024-04-22T06:32:18.967971+0000","last_fullsized":"2024-04-22T06:32:18.967971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.984067+0000","last_change":"2024-04-22T06:32:18.981673+0000","last_active":"2024-04-22T06:32:18.984067+0000","last_peered":"2024-04-22T06:32:18.984067+0000","last_clean":"2024-04-22T06:32:18.984067+0000","last_became_active":"2024-04-22T06:32:18.981385+0000","last_became_peered":"2024-04-22T06:32:18.981385+0000","last_unstale":"2024-04-22T06:32:18.984067+0000","last_undegraded":"2024-04-22T06:32:18.984067+0000","last_fullsized":"2024-04-22T06:32:18.984067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:12:05.631449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969001+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:32:18.969001+0000","last_peered":"2024-04-22T06:32:18.969001+0000","last_clean":"2024-04-22T06:32:18.969001+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:32:18.969001+0000","last_undegraded":"2024-04-22T06:32:18.969001+0000","last_fullsized":"2024-04-22T06:32:18.969001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981198+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:32:18.981198+0000","last_peered":"2024-04-22T06:32:18.981198+0000","last_clean":"2024-04-22T06:32:18.981198+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:32:18.981198+0000","last_undegraded":"2024-04-22T06:32:18.981198+0000","last_fullsized":"2024-04-22T06:32:18.981198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966096+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:32:18.966096+0000","last_peered":"2024-04-22T06:32:18.966096+0000","last_clean":"2024-04-22T06:32:18.966096+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:32:18.966096+0000","last_undegraded":"2024-04-22T06:32:18.966096+0000","last_fullsized":"2024-04-22T06:32:18.966096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150236+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:32:19.150236+0000","last_peered":"2024-04-22T06:32:19.150236+0000","last_clean":"2024-04-22T06:32:19.150236+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:32:19.150236+0000","last_undegraded":"2024-04-22T06:32:19.150236+0000","last_fullsized":"2024-04-22T06:32:19.150236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968293+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:32:18.968293+0000","last_peered":"2024-04-22T06:32:18.968293+0000","last_clean":"2024-04-22T06:32:18.968293+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:32:18.968293+0000","last_undegraded":"2024-04-22T06:32:18.968293+0000","last_fullsized":"2024-04-22T06:32:18.968293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968508+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:32:18.968508+0000","last_peered":"2024-04-22T06:32:18.968508+0000","last_clean":"2024-04-22T06:32:18.968508+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:32:18.968508+0000","last_undegraded":"2024-04-22T06:32:18.968508+0000","last_fullsized":"2024-04-22T06:32:18.968508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294864+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:32:19.294864+0000","last_peered":"2024-04-22T06:32:19.294864+0000","last_clean":"2024-04-22T06:32:19.294864+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:32:19.294864+0000","last_undegraded":"2024-04-22T06:32:19.294864+0000","last_fullsized":"2024-04-22T06:32:19.294864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965909+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:32:18.965909+0000","last_peered":"2024-04-22T06:32:18.965909+0000","last_clean":"2024-04-22T06:32:18.965909+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:32:18.965909+0000","last_undegraded":"2024-04-22T06:32:18.965909+0000","last_fullsized":"2024-04-22T06:32:18.965909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294097+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:32:19.294097+0000","last_peered":"2024-04-22T06:32:19.294097+0000","last_clean":"2024-04-22T06:32:19.294097+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:32:19.294097+0000","last_undegraded":"2024-04-22T06:32:19.294097+0000","last_fullsized":"2024-04-22T06:32:19.294097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967270+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:32:18.967270+0000","last_peered":"2024-04-22T06:32:18.967270+0000","last_clean":"2024-04-22T06:32:18.967270+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:32:18.967270+0000","last_undegraded":"2024-04-22T06:32:18.967270+0000","last_fullsized":"2024-04-22T06:32:18.967270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294227+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:32:19.294227+0000","last_peered":"2024-04-22T06:32:19.294227+0000","last_clean":"2024-04-22T06:32:19.294227+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:32:19.294227+0000","last_undegraded":"2024-04-22T06:32:19.294227+0000","last_fullsized":"2024-04-22T06:32:19.294227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967631+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:32:18.967631+0000","last_peered":"2024-04-22T06:32:18.967631+0000","last_clean":"2024-04-22T06:32:18.967631+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:32:18.967631+0000","last_undegraded":"2024-04-22T06:32:18.967631+0000","last_fullsized":"2024-04-22T06:32:18.967631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981168+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:32:18.981168+0000","last_peered":"2024-04-22T06:32:18.981168+0000","last_clean":"2024-04-22T06:32:18.981168+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:32:18.981168+0000","last_undegraded":"2024-04-22T06:32:18.981168+0000","last_fullsized":"2024-04-22T06:32:18.981168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969514+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:32:18.969514+0000","last_peered":"2024-04-22T06:32:18.969514+0000","last_clean":"2024-04-22T06:32:18.969514+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:32:18.969514+0000","last_undegraded":"2024-04-22T06:32:18.969514+0000","last_fullsized":"2024-04-22T06:32:18.969514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294781+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:32:19.294781+0000","last_peered":"2024-04-22T06:32:19.294781+0000","last_clean":"2024-04-22T06:32:19.294781+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:32:19.294781+0000","last_undegraded":"2024-04-22T06:32:19.294781+0000","last_fullsized":"2024-04-22T06:32:19.294781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":119909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":115823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:32:37.671 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:32:37.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.808+0000 7f9fae681640 1 Processor -- start 2024-04-22T06:32:37.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.808+0000 7f9fae681640 1 -- start start 2024-04-22T06:32:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fae681640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c5b10 0x7f9fa80c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fae681640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa8071df0 con 0x7f9fa8073a50 2024-04-22T06:32:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fae681640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa8159e10 con 0x7f9fa8142280 2024-04-22T06:32:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fae681640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa8142660 con 0x7f9fa80c5b10 2024-04-22T06:32:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9facc1e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9fa8073a50 0x7f9fa8073ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45110/0 (socket says 172.21.15.113:45110) 2024-04-22T06:32:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9facc1e640 1 -- 172.21.15.113:0/1570153571 learned_addr learned my addr 172.21.15.113:0/1570153571 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa77fe640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c5b10 0x7f9fa80c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944103893 0 0) 0x7f9fa8071df0 con 0x7f9fa8073a50 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f90003520 con 0x7f9fa8073a50 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3834114242 0 0) 0x7f9f90003520 con 0x7f9fa8073a50 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c5b10 msgr2=0x7f9fa80c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c5b10 0x7f9fa80c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 >> v1:172.21.15.145:6789/0 conn(0x7f9fa8142280 legacy=0x7f9fa80c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa8159290 con 0x7f9fa8073a50 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f9fa00019f0 con 0x7f9fa8073a50 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 >> v1:172.21.15.113:6789/0 conn(0x7f9fa8073a50 legacy=0x7f9fa8073ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f900039e0 0x7f9f90003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c5b10 0x7f9f90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f90004d40 0x7f9f900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8142660 con 0x7f9f900039e0 2024-04-22T06:32:37.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9000bb00 con 0x7f9f90004d40 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9f9000bd00 con 0x7f9fa80c5b10 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.809+0000 7f9fa7fff640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f900039e0 0x7f9f90003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.810+0000 7f9fa77fe640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c5b10 0x7f9f90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.810+0000 7f9facc1e640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f90004d40 0x7f9f900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.810+0000 7f9fa7fff640 1 -- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c5b10 msgr2=0x7f9f90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.810+0000 7f9fa7fff640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c5b10 0x7f9f90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.810+0000 7f9fa7fff640 1 -- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f90004d40 msgr2=0x7f9f900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.810+0000 7f9fa7fff640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f90004d40 0x7f9f900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.810+0000 7f9fa7fff640 1 -- 172.21.15.113:0/1570153571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f90003520 con 0x7f9f900039e0 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fa7fff640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f900039e0 0x7f9f90003e00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9f98001720 tx=0x7f9f90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603710aa7d737a13 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98001370 con 0x7f9f900039e0 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f980052d0 con 0x7f9f900039e0 2024-04-22T06:32:37.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fa6ffd640 1 -- 172.21.15.113:0/1570153571 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98003830 con 0x7f9f900039e0 2024-04-22T06:32:37.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fae681640 1 -- 172.21.15.113:0/1570153571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f900039e0 msgr2=0x7f9f90003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fae681640 1 --2- 172.21.15.113:0/1570153571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9f900039e0 0x7f9f90003e00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9f98001720 tx=0x7f9f90005830 comp rx=0 tx=0).stop 2024-04-22T06:32:37.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9facc1e640 1 -- 172.21.15.113:0/1570153571 reap_dead start 2024-04-22T06:32:37.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fae681640 1 -- 172.21.15.113:0/1570153571 shutdown_connections 2024-04-22T06:32:37.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fae681640 1 -- 172.21.15.113:0/1570153571 >> 172.21.15.113:0/1570153571 conn(0x7f9fa806d610 msgr2=0x7f9fa8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:37.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fae681640 1 -- 172.21.15.113:0/1570153571 shutdown_connections 2024-04-22T06:32:37.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.811+0000 7f9fae681640 1 -- 172.21.15.113:0/1570153571 wait complete. 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9fae681640 1 Processor -- start 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9fae681640 1 -- start start 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9fae681640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f900039e0 0x7f9fa81e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9fae681640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c3450 0x7f9fa81e44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9fae681640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa81549f0 0x7f9fa81f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9fae681640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8159850 con 0x7f9fa81549f0 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9fae681640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa80735c0 con 0x7f9f900039e0 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9fae681640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa8159b30 con 0x7f9fa80c3450 2024-04-22T06:32:37.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.813+0000 7f9facc1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa81549f0 0x7f9fa81f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9facc1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa81549f0 0x7f9fa81f0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33808/0 (socket says 172.21.15.113:33808) 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9facc1e640 1 -- 172.21.15.113:0/1287370140 learned_addr learned my addr 172.21.15.113:0/1287370140 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9fa7fff640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f900039e0 0x7f9fa81e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9fa77fe640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c3450 0x7f9fa81e44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9facc1e640 1 -- 172.21.15.113:0/1287370140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c3450 msgr2=0x7f9fa81e44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9facc1e640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c3450 0x7f9fa81e44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9facc1e640 1 -- 172.21.15.113:0/1287370140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f900039e0 msgr2=0x7f9fa81e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9facc1e640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f900039e0 0x7f9fa81e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9facc1e640 1 -- 172.21.15.113:0/1287370140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa8155ab0 con 0x7f9fa81549f0 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9facc1e640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa81549f0 0x7f9fa81f0770 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f80 tx=0x7f9fa0007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9fa4ff9640 1 -- 172.21.15.113:0/1287370140 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000ab60 con 0x7f9fa81549f0 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9fa4ff9640 1 -- 172.21.15.113:0/1287370140 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa0018070 con 0x7f9fa81549f0 2024-04-22T06:32:37.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa81effd0 con 0x7f9fa81549f0 2024-04-22T06:32:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9fa4ff9640 1 -- 172.21.15.113:0/1287370140 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00133f0 con 0x7f9fa81549f0 2024-04-22T06:32:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.814+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa8156030 con 0x7f9fa81549f0 2024-04-22T06:32:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.815+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa8068e40 con 0x7f9fa81549f0 2024-04-22T06:32:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.816+0000 7f9fa4ff9640 1 -- 172.21.15.113:0/1287370140 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9fa0013590 con 0x7f9fa81549f0 2024-04-22T06:32:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.816+0000 7f9fa4ff9640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.816+0000 7f9fa4ff9640 1 -- 172.21.15.113:0/1287370140 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9fa008c490 con 0x7f9fa81549f0 2024-04-22T06:32:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.816+0000 7f9fa7fff640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:37.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.817+0000 7f9fa7fff640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f9406c8f0 0x7f9f9406edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9f98033000 tx=0x7f9f98009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:37.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:37.825+0000 7f9fa4ff9640 1 -- 172.21.15.113:0/1287370140 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9fa005a430 con 0x7f9fa81549f0 2024-04-22T06:32:38.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.071+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fa80cca90 con 0x7f9fa81549f0 2024-04-22T06:32:38.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.071+0000 7f9fa4ff9640 1 -- 172.21.15.113:0/1287370140 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6917 (secure 0 0 0) 0x7f9fa0059d30 con 0x7f9fa81549f0 2024-04-22T06:32:38.071 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:38.071 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:25.981022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4308,"mds_2":4305,"mds_3":4264,"mds_4":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":4,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"a","rank":2,"incarnation":12,"state":"up:active","state_seq":12,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:active","state_seq":11,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4259,4311,4264,4305,4308]},"id":1}]} 2024-04-22T06:32:38.071 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 17 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f9406c8f0 msgr2=0x7f9f9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f9406c8f0 0x7f9f9406edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9f98033000 tx=0x7f9f98009030 comp rx=0 tx=0).stop 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa81549f0 msgr2=0x7f9fa81f0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa81549f0 0x7f9fa81f0770 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f80 tx=0x7f9fa0007a60 comp rx=0 tx=0).stop 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 shutdown_connections 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9fa81549f0 0x7f9fa81f0770 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fa80c3450 0x7f9fa81e44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 --2- 172.21.15.113:0/1287370140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f900039e0 0x7f9fa81e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 >> 172.21.15.113:0/1287370140 conn(0x7f9fa806d610 msgr2=0x7f9fa8157e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 shutdown_connections 2024-04-22T06:32:38.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.073+0000 7f9fae681640 1 -- 172.21.15.113:0/1287370140 wait complete. 2024-04-22T06:32:38.084 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:38.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.182+0000 7f3e54d23640 1 Processor -- start 2024-04-22T06:32:38.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.182+0000 7f3e54d23640 1 -- start start 2024-04-22T06:32:38.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e54d23640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e500c5b10 0x7f3e500c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e54d23640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e50073a50 0x7f3e50073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e54d23640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e50074420 con 0x7f3e50142280 2024-04-22T06:32:38.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e54d23640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f3e50142660 con 0x7f3e50073a50 2024-04-22T06:32:38.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e54d23640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3e500735c0 con 0x7f3e500c5b10 2024-04-22T06:32:38.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e4ed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e50073a50 0x7f3e50073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e4ed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e50073a50 0x7f3e50073ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33818/0 (socket says 172.21.15.113:33818) 2024-04-22T06:32:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e4ed9d640 1 -- 172.21.15.113:0/1139701877 learned_addr learned my addr 172.21.15.113:0/1139701877 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.183+0000 7f3e4dd9b640 1 --2- 172.21.15.113:0/1139701877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e500c5b10 0x7f3e500c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.184+0000 7f3e4ed9d640 1 -- 172.21.15.113:0/1139701877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e500c5b10 msgr2=0x7f3e500c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.184+0000 7f3e4ed9d640 1 --2- 172.21.15.113:0/1139701877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e500c5b10 0x7f3e500c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.184+0000 7f3e4ed9d640 1 -- 172.21.15.113:0/1139701877 >> v1:172.21.15.145:6789/0 conn(0x7f3e50142280 legacy=0x7f3e500c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.184+0000 7f3e4ed9d640 1 -- 172.21.15.113:0/1139701877 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e50071df0 con 0x7f3e50073a50 2024-04-22T06:32:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.184+0000 7f3e4ed9d640 1 --2- 172.21.15.113:0/1139701877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e50073a50 0x7f3e50073ee0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009e50 tx=0x7f3e4802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f63c63a81499b09 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.184+0000 7f3e4d59a640 1 -- 172.21.15.113:0/1139701877 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4802cb90 con 0x7f3e50073a50 2024-04-22T06:32:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.184+0000 7f3e4d59a640 1 -- 172.21.15.113:0/1139701877 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4802cd30 con 0x7f3e50073a50 2024-04-22T06:32:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e4d59a640 1 -- 172.21.15.113:0/1139701877 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48034610 con 0x7f3e50073a50 2024-04-22T06:32:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e54d23640 1 -- 172.21.15.113:0/1139701877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e50073a50 msgr2=0x7f3e50073ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e54d23640 1 --2- 172.21.15.113:0/1139701877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e50073a50 0x7f3e50073ee0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009e50 tx=0x7f3e4802bff0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e54d23640 1 -- 172.21.15.113:0/1139701877 shutdown_connections 2024-04-22T06:32:38.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e54d23640 1 --2- 172.21.15.113:0/1139701877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e50073a50 0x7f3e50073ee0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e54d23640 1 --2- 172.21.15.113:0/1139701877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e500c5b10 0x7f3e500c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e54d23640 1 -- 172.21.15.113:0/1139701877 >> 172.21.15.113:0/1139701877 conn(0x7f3e5006d610 msgr2=0x7f3e50074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:38.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e54d23640 1 -- 172.21.15.113:0/1139701877 shutdown_connections 2024-04-22T06:32:38.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.185+0000 7f3e54d23640 1 -- 172.21.15.113:0/1139701877 wait complete. 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.186+0000 7f3e54d23640 1 Processor -- start 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.186+0000 7f3e54d23640 1 -- start start 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e54d23640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50073a50 0x7f3e5013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e54d23640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500c5b10 0x7f3e500bebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e54d23640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e50142280 0x7f3e500bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e54d23640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f3e50159570 con 0x7f3e500c5b10 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e54d23640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3e50159290 con 0x7f3e50073a50 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e54d23640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f3e50159850 con 0x7f3e50142280 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4dd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500c5b10 0x7f3e500bebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4dd9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500c5b10 0x7f3e500bebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33824/0 (socket says 172.21.15.113:33824) 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4dd9b640 1 -- 172.21.15.113:0/330712356 learned_addr learned my addr 172.21.15.113:0/330712356 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4ed9d640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e50142280 0x7f3e500bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4e59c640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50073a50 0x7f3e5013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4dd9b640 1 -- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e50142280 msgr2=0x7f3e500bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4dd9b640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e50142280 0x7f3e500bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4dd9b640 1 -- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50073a50 msgr2=0x7f3e5013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4dd9b640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50073a50 0x7f3e5013fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4dd9b640 1 -- 172.21.15.113:0/330712356 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e501f43c0 con 0x7f3e500c5b10 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4ed9d640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e50142280 0x7f3e500bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.187+0000 7f3e4e59c640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50073a50 0x7f3e5013fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.188+0000 7f3e4dd9b640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500c5b10 0x7f3e500bebc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400d830 tx=0x7f3e4400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.188+0000 7f3e3effd640 1 -- 172.21.15.113:0/330712356 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400b6c0 con 0x7f3e500c5b10 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.188+0000 7f3e3effd640 1 -- 172.21.15.113:0/330712356 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e44019070 con 0x7f3e500c5b10 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.188+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e501f4680 con 0x7f3e500c5b10 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.188+0000 7f3e3effd640 1 -- 172.21.15.113:0/330712356 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400ba80 con 0x7f3e500c5b10 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.188+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e501f4c40 con 0x7f3e500c5b10 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.189+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5006ddf0 con 0x7f3e500c5b10 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.189+0000 7f3e3effd640 1 -- 172.21.15.113:0/330712356 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e4401e460 con 0x7f3e500c5b10 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.190+0000 7f3e3effd640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3e3006c8f0 0x7f3e3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.190+0000 7f3e3effd640 1 -- 172.21.15.113:0/330712356 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3e4408c630 con 0x7f3e500c5b10 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.190+0000 7f3e4e59c640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3e3006c8f0 0x7f3e3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.190+0000 7f3e4e59c640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3e3006c8f0 0x7f3e3006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3e400015e0 tx=0x7f3e40009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.198+0000 7f3e3effd640 1 -- 172.21.15.113:0/330712356 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e5006ddf0 con 0x7f3e500c5b10 2024-04-22T06:32:38.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.381+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e501419d0 con 0x7f3e500c5b10 2024-04-22T06:32:38.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.382+0000 7f3e3effd640 1 -- 172.21.15.113:0/330712356 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f3e501419d0 con 0x7f3e500c5b10 2024-04-22T06:32:38.382 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:38.382 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:38.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3e3006c8f0 msgr2=0x7f3e3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3e3006c8f0 0x7f3e3006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3e400015e0 tx=0x7f3e40009040 comp rx=0 tx=0).stop 2024-04-22T06:32:38.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500c5b10 msgr2=0x7f3e500bebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500c5b10 0x7f3e500bebc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400d830 tx=0x7f3e4400dcf0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 shutdown_connections 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3e50142280 0x7f3e500bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f3e3006c8f0 0x7f3e3006edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e500c5b10 0x7f3e500bebc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 --2- 172.21.15.113:0/330712356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e50073a50 0x7f3e5013fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 >> 172.21.15.113:0/330712356 conn(0x7f3e5006d610 msgr2=0x7f3e500c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 shutdown_connections 2024-04-22T06:32:38.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.385+0000 7f3e54d23640 1 -- 172.21.15.113:0/330712356 wait complete. 2024-04-22T06:32:38.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:32:38.396 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:32:38.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.497+0000 7f359e92b640 1 Processor -- start 2024-04-22T06:32:38.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.497+0000 7f359e92b640 1 -- start start 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f359e92b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f359815e960 0x7f359815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f359e92b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f359806b920 0x7f359806bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f359e92b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359815f310 con 0x7f3598155210 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f359e92b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f359815bf00 con 0x7f359815e960 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f359e92b640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f359815b0a0 con 0x7f359806b920 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f35977fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f359815e960 0x7f359815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f3597fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3598155210 0x7f35980cb2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38338/0 (socket says 172.21.15.113:38338) 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f3597fff640 1 -- 172.21.15.113:0/3951024265 learned_addr learned my addr 172.21.15.113:0/3951024265 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f35977fe640 1 -- 172.21.15.113:0/3951024265 >> v2:172.21.15.145:3300/0 conn(0x7f359806b920 msgr2=0x7f359806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f359cec8640 1 --2- 172.21.15.113:0/3951024265 >> v2:172.21.15.145:3300/0 conn(0x7f359806b920 0x7f359806bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.498 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f35977fe640 1 --2- 172.21.15.113:0/3951024265 >> v2:172.21.15.145:3300/0 conn(0x7f359806b920 0x7f359806bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f3596ffd640 1 -- 172.21.15.113:0/3951024265 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643316785 0 0) 0x7f359815f310 con 0x7f3598155210 2024-04-22T06:32:38.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f35977fe640 1 -- 172.21.15.113:0/3951024265 >> v1:172.21.15.113:6789/0 conn(0x7f3598155210 legacy=0x7f35980cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f35977fe640 1 -- 172.21.15.113:0/3951024265 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359815b380 con 0x7f359815e960 2024-04-22T06:32:38.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.498+0000 7f359cec8640 1 --2- 172.21.15.113:0/3951024265 >> v2:172.21.15.145:3300/0 conn(0x7f359806b920 0x7f359806bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:38.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f35977fe640 1 --2- 172.21.15.113:0/3951024265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f359815edd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f359806f070 tx=0x7f358802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7a4bcf26268d53 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f3596ffd640 1 -- 172.21.15.113:0/3951024265 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588034070 con 0x7f359815e960 2024-04-22T06:32:38.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f3596ffd640 1 -- 172.21.15.113:0/3951024265 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3588030610 con 0x7f359815e960 2024-04-22T06:32:38.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f3596ffd640 1 -- 172.21.15.113:0/3951024265 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880309e0 con 0x7f359815e960 2024-04-22T06:32:38.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f359e92b640 1 -- 172.21.15.113:0/3951024265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 msgr2=0x7f359815edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.500 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f359e92b640 1 --2- 172.21.15.113:0/3951024265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f359815edd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f359806f070 tx=0x7f358802b960 comp rx=0 tx=0).stop 2024-04-22T06:32:38.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f359e92b640 1 -- 172.21.15.113:0/3951024265 shutdown_connections 2024-04-22T06:32:38.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f359e92b640 1 --2- 172.21.15.113:0/3951024265 >> v2:172.21.15.145:3300/0 conn(0x7f359806b920 0x7f359806bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.499+0000 7f359e92b640 1 --2- 172.21.15.113:0/3951024265 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f359815edd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.500+0000 7f359e92b640 1 -- 172.21.15.113:0/3951024265 >> 172.21.15.113:0/3951024265 conn(0x7f3598074f30 msgr2=0x7f3598075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:38.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.500+0000 7f359e92b640 1 -- 172.21.15.113:0/3951024265 shutdown_connections 2024-04-22T06:32:38.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.500+0000 7f359e92b640 1 -- 172.21.15.113:0/3951024265 wait complete. 2024-04-22T06:32:38.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.501+0000 7f359e92b640 1 Processor -- start 2024-04-22T06:32:38.501 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.501+0000 7f359e92b640 1 -- start start 2024-04-22T06:32:38.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.501+0000 7f359e92b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f359806b920 0x7f359814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.501+0000 7f359e92b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3598155210 0x7f35980cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.501+0000 7f359e92b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f35980cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.501+0000 7f359e92b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f359815bc20 con 0x7f359815e960 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.501+0000 7f359e92b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f359815b940 con 0x7f3598155210 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.501+0000 7f359e92b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f35981555f0 con 0x7f359806b920 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f35980cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f35980cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51032/0 (socket says 172.21.15.113:51032) 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 -- 172.21.15.113:0/3149246314 learned_addr learned my addr 172.21.15.113:0/3149246314 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f35977fe640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3598155210 0x7f35980cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f3597fff640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f359806b920 0x7f359814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 -- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f359806b920 msgr2=0x7f359814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f359806b920 0x7f359814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 -- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3598155210 msgr2=0x7f35980cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3598155210 0x7f35980cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 -- 172.21.15.113:0/3149246314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359815d4f0 con 0x7f359815e960 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f35977fe640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3598155210 0x7f35980cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359cec8640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f35980cd340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f359000cef0 tx=0x7f359000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f3594ff9640 1 -- 172.21.15.113:0/3149246314 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359001a070 con 0x7f359815e960 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f3594ff9640 1 -- 172.21.15.113:0/3149246314 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359000d860 con 0x7f359815e960 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f3594ff9640 1 -- 172.21.15.113:0/3149246314 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359000dc50 con 0x7f359815e960 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359815d7b0 con 0x7f359815e960 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.502+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359815dd70 con 0x7f359815e960 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.503+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3598068f50 con 0x7f359815e960 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.504+0000 7f3594ff9640 1 -- 172.21.15.113:0/3149246314 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f359001d070 con 0x7f359815e960 2024-04-22T06:32:38.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.504+0000 7f3594ff9640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358406c920 0x7f358406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.504+0000 7f3594ff9640 1 -- 172.21.15.113:0/3149246314 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f359008c700 con 0x7f359815e960 2024-04-22T06:32:38.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.504+0000 7f3597fff640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358406c920 0x7f358406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.505+0000 7f3597fff640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358406c920 0x7f358406ede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f358c000f60 tx=0x7f358c007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.509+0000 7f3594ff9640 1 -- 172.21.15.113:0/3149246314 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f359005a880 con 0x7f359815e960 2024-04-22T06:32:38.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.687+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3598154a10 con 0x7f359815e960 2024-04-22T06:32:38.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.687+0000 7f3594ff9640 1 -- 172.21.15.113:0/3149246314 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f359005a180 con 0x7f359815e960 2024-04-22T06:32:38.687 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358406c920 msgr2=0x7f358406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358406c920 0x7f358406ede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f358c000f60 tx=0x7f358c007b50 comp rx=0 tx=0).stop 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 msgr2=0x7f35980cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f35980cd340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f359000cef0 tx=0x7f359000a710 comp rx=0 tx=0).stop 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 shutdown_connections 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f358406c920 0x7f358406ede0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f359815e960 0x7f35980cd340 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3598155210 0x7f35980cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 --2- 172.21.15.113:0/3149246314 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f359806b920 0x7f359814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 >> 172.21.15.113:0/3149246314 conn(0x7f3598074f30 msgr2=0x7f3598153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 shutdown_connections 2024-04-22T06:32:38.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.689+0000 7f359e92b640 1 -- 172.21.15.113:0/3149246314 wait complete. 2024-04-22T06:32:38.699 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:32:38.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.800+0000 7f528550d640 1 Processor -- start 2024-04-22T06:32:38.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.800+0000 7f528550d640 1 -- start start 2024-04-22T06:32:38.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f528550d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f52800d0820 0x7f52800d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f528550d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52800c5c80 con 0x7f528015b070 2024-04-22T06:32:38.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f528550d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52800d1170 con 0x7f52801553c0 2024-04-22T06:32:38.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f528550d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f528015e660 con 0x7f52800d0820 2024-04-22T06:32:38.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527e7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f528015b070 0x7f52800cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38340/0 (socket says 172.21.15.113:38340) 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527e7fc640 1 -- 172.21.15.113:0/1987590608 learned_addr learned my addr 172.21.15.113:0/1987590608 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527f7fe640 1 --2- 172.21.15.113:0/1987590608 >> v2:172.21.15.145:3300/0 conn(0x7f52800d0820 0x7f52800d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1992130444 0 0) 0x7f52800c5c80 con 0x7f528015b070 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5268003520 con 0x7f528015b070 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 997717855 0 0) 0x7f5268003520 con 0x7f528015b070 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 >> v2:172.21.15.145:3300/0 conn(0x7f52800d0820 msgr2=0x7f52800d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 --2- 172.21.15.113:0/1987590608 >> v2:172.21.15.145:3300/0 conn(0x7f52800d0820 0x7f52800d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 >> v1:172.21.15.145:6789/0 conn(0x7f52801553c0 legacy=0x7f528015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528015b5d0 con 0x7f528015b070 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f52740017f0 con 0x7f528015b070 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 >> v1:172.21.15.113:6789/0 conn(0x7f528015b070 legacy=0x7f52800cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52680039b0 0x7f5268003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5268004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52680051c0 0x7f526800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f528015e660 con 0x7f5268004800 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f526800c060 con 0x7f52680039b0 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f526800c260 con 0x7f52680051c0 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527e7fc640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5268004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.801+0000 7f527effd640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52680039b0 0x7f5268003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.802+0000 7f527f7fe640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52680051c0 0x7f526800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.802+0000 7f527e7fc640 1 -- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52680051c0 msgr2=0x7f526800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.802+0000 7f527e7fc640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f52680051c0 0x7f526800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.802+0000 7f527e7fc640 1 -- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52680039b0 msgr2=0x7f5268003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.802+0000 7f527e7fc640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52680039b0 0x7f5268003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.802+0000 7f527e7fc640 1 -- 172.21.15.113:0/1987590608 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5268003520 con 0x7f5268004800 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.802+0000 7f527f7fe640 1 -- 172.21.15.113:0/1987590608 reap_dead start 2024-04-22T06:32:38.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.802+0000 7f527effd640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52680039b0 0x7f5268003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f527e7fc640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5268004c80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f527400c1c0 tx=0x7f5268005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae053ce9fbb21955 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274007d00 con 0x7f5268004800 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5274030070 con 0x7f5268004800 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f527dffb640 1 -- 172.21.15.113:0/1987590608 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274007510 con 0x7f5268004800 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f528550d640 1 -- 172.21.15.113:0/1987590608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 msgr2=0x7f5268004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f528550d640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5268004c80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f527400c1c0 tx=0x7f5268005830 comp rx=0 tx=0).stop 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f528550d640 1 -- 172.21.15.113:0/1987590608 shutdown_connections 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f528550d640 1 --2- 172.21.15.113:0/1987590608 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5268004c80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f528550d640 1 -- 172.21.15.113:0/1987590608 >> 172.21.15.113:0/1987590608 conn(0x7f5280072360 msgr2=0x7f5280074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f528550d640 1 -- 172.21.15.113:0/1987590608 shutdown_connections 2024-04-22T06:32:38.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.803+0000 7f528550d640 1 -- 172.21.15.113:0/1987590608 wait complete. 2024-04-22T06:32:38.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f528550d640 1 Processor -- start 2024-04-22T06:32:38.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f528550d640 1 -- start start 2024-04-22T06:32:38.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f528550d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5280151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f528550d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52801537b0 0x7f52801f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f528550d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528014e850 0x7f528014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f528550d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f528015bb90 con 0x7f5268004800 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f528550d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f52801557a0 con 0x7f52801537b0 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f528550d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f528015be70 con 0x7f528014e850 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f527effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5280151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f527effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5280151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51050/0 (socket says 172.21.15.113:51050) 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f527effd640 1 -- 172.21.15.113:0/3184387589 learned_addr learned my addr 172.21.15.113:0/3184387589 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.805+0000 7f527e7fc640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52801537b0 0x7f52801f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527f7fe640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528014e850 0x7f528014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527effd640 1 -- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528014e850 msgr2=0x7f528014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527effd640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528014e850 0x7f528014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527effd640 1 -- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52801537b0 msgr2=0x7f52801f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527effd640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52801537b0 0x7f52801f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527effd640 1 -- 172.21.15.113:0/3184387589 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52800c7c00 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527e7fc640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52801537b0 0x7f52801f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527f7fe640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528014e850 0x7f528014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f527effd640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5280151b60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f527000f730 tx=0x7f527000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f52677fe640 1 -- 172.21.15.113:0/3184387589 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52700013c0 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f52677fe640 1 -- 172.21.15.113:0/3184387589 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5270018070 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52800c9690 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f52677fe640 1 -- 172.21.15.113:0/3184387589 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52700052f0 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.806+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52800c9c50 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.807+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52800b3660 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.807+0000 7f52677fe640 1 -- 172.21.15.113:0/3184387589 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f527000d6d0 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.808+0000 7f52677fe640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f526c06c8f0 0x7f526c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.808+0000 7f527e7fc640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f526c06c8f0 0x7f526c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.808+0000 7f52677fe640 1 -- 172.21.15.113:0/3184387589 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f527008bcf0 con 0x7f5268004800 2024-04-22T06:32:38.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.808+0000 7f527e7fc640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f526c06c8f0 0x7f526c06edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5274034000 tx=0x7f5274039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:38.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.812+0000 7f52677fe640 1 -- 172.21.15.113:0/3184387589 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52800b3660 con 0x7f5268004800 2024-04-22T06:32:38.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.987+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5280068f50 con 0x7f5268004800 2024-04-22T06:32:38.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.988+0000 7f52677fe640 1 -- 172.21.15.113:0/3184387589 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f5270090070 con 0x7f5268004800 2024-04-22T06:32:38.987 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:38.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f526c06c8f0 msgr2=0x7f526c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f526c06c8f0 0x7f526c06edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5274034000 tx=0x7f5274039040 comp rx=0 tx=0).stop 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 msgr2=0x7f5280151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5280151b60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f527000f730 tx=0x7f527000fbf0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 shutdown_connections 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528014e850 0x7f528014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52801537b0 0x7f52801f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f526c06c8f0 0x7f526c06edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 --2- 172.21.15.113:0/3184387589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5268004800 0x7f5280151b60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 >> 172.21.15.113:0/3184387589 conn(0x7f5280072360 msgr2=0x7f52800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 shutdown_connections 2024-04-22T06:32:38.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:38.990+0000 7f528550d640 1 -- 172.21.15.113:0/3184387589 wait complete. 2024-04-22T06:32:39.000 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:32:39.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.101+0000 7fd1ffa7a640 1 Processor -- start 2024-04-22T06:32:39.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.101+0000 7fd1ffa7a640 1 -- start start 2024-04-22T06:32:39.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1ffa7a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1f806cc00 0x7fd1f815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1ffa7a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd1f806cfe0 0x7fd1f8154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1ffa7a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 0x7fd1f8155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1ffa7a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fd1f80cd140 con 0x7fd1f806cc00 2024-04-22T06:32:39.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1ffa7a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fd1f815f500 con 0x7fd1f806cfe0 2024-04-22T06:32:39.102 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1ffa7a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f815b190 con 0x7fd1f80cbc00 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd816640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1f806cc00 0x7fd1f815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd816640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd1f806cc00 0x7fd1f815efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51052/0 (socket says 172.21.15.113:51052) 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd816640 1 -- 172.21.15.113:0/4111179445 learned_addr learned my addr 172.21.15.113:0/4111179445 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd015640 1 --2- 172.21.15.113:0/4111179445 >> v2:172.21.15.145:3300/0 conn(0x7fd1f806cfe0 0x7fd1f8154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fe017640 1 --2- 172.21.15.113:0/4111179445 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 0x7fd1f8155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd816640 1 -- 172.21.15.113:0/4111179445 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 msgr2=0x7fd1f8155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd816640 1 --2- 172.21.15.113:0/4111179445 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 0x7fd1f8155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd816640 1 -- 172.21.15.113:0/4111179445 >> v2:172.21.15.145:3300/0 conn(0x7fd1f806cfe0 msgr2=0x7fd1f8154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd816640 1 --2- 172.21.15.113:0/4111179445 >> v2:172.21.15.145:3300/0 conn(0x7fd1f806cfe0 0x7fd1f8154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.102+0000 7fd1fd816640 1 -- 172.21.15.113:0/4111179445 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f815b470 con 0x7fd1f806cc00 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1fd816640 1 --2- 172.21.15.113:0/4111179445 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f815efc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009870 tx=0x7fd1f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a01397a24c5afd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1fc814640 1 -- 172.21.15.113:0/4111179445 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4034070 con 0x7fd1f806cc00 2024-04-22T06:32:39.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1fc814640 1 -- 172.21.15.113:0/4111179445 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f4030840 con 0x7fd1f806cc00 2024-04-22T06:32:39.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1fc814640 1 -- 172.21.15.113:0/4111179445 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4030c10 con 0x7fd1f806cc00 2024-04-22T06:32:39.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/4111179445 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 msgr2=0x7fd1f815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/4111179445 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f815efc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009870 tx=0x7fd1f402b980 comp rx=0 tx=0).stop 2024-04-22T06:32:39.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/4111179445 shutdown_connections 2024-04-22T06:32:39.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/4111179445 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 0x7fd1f8155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/4111179445 >> v2:172.21.15.145:3300/0 conn(0x7fd1f806cfe0 0x7fd1f8154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/4111179445 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f815efc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.103+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/4111179445 >> 172.21.15.113:0/4111179445 conn(0x7fd1f8075570 msgr2=0x7fd1f8073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:39.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.104+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/4111179445 shutdown_connections 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.104+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/4111179445 wait complete. 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1ffa7a640 1 Processor -- start 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1ffa7a640 1 -- start start 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1ffa7a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f8151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1ffa7a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f806cfe0 0x7fd1f8152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1ffa7a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 0x7fd1f8150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1ffa7a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f815bd10 con 0x7fd1f806cc00 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1ffa7a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f815ba30 con 0x7fd1f806cfe0 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1ffa7a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f80ccbe0 con 0x7fd1f80cbc00 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1fd816640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f8151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1fd816640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f8151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51062/0 (socket says 172.21.15.113:51062) 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.105+0000 7fd1fd816640 1 -- 172.21.15.113:0/1479561329 learned_addr learned my addr 172.21.15.113:0/1479561329 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1fd015640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f806cfe0 0x7fd1f8152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1fe017640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 0x7fd1f8150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1fd816640 1 -- 172.21.15.113:0/1479561329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 msgr2=0x7fd1f8150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1fd816640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 0x7fd1f8150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1fd816640 1 -- 172.21.15.113:0/1479561329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f806cfe0 msgr2=0x7fd1f8152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1fd816640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f806cfe0 0x7fd1f8152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1fd816640 1 -- 172.21.15.113:0/1479561329 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f81f1e80 con 0x7fd1f806cc00 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1fd816640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f8151b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd1f402b9c0 tx=0x7fd1f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1ee7fc640 1 -- 172.21.15.113:0/1479561329 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4048070 con 0x7fd1f806cc00 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1ee7fc640 1 -- 172.21.15.113:0/1479561329 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f4030640 con 0x7fd1f806cc00 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1ee7fc640 1 -- 172.21.15.113:0/1479561329 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4034040 con 0x7fd1f806cc00 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f814f5e0 con 0x7fd1f806cc00 2024-04-22T06:32:39.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.106+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f814f880 con 0x7fd1f806cc00 2024-04-22T06:32:39.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.107+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f8068f50 con 0x7fd1f806cc00 2024-04-22T06:32:39.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.108+0000 7fd1ee7fc640 1 -- 172.21.15.113:0/1479561329 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1f404b070 con 0x7fd1f806cc00 2024-04-22T06:32:39.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.108+0000 7fd1ee7fc640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd1dc06c920 0x7fd1dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.108+0000 7fd1ee7fc640 1 -- 172.21.15.113:0/1479561329 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd1f40ade50 con 0x7fd1f806cc00 2024-04-22T06:32:39.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.108+0000 7fd1fd015640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd1dc06c920 0x7fd1dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.108+0000 7fd1fd015640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd1dc06c920 0x7fd1dc06ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80b3890 tx=0x7fd1e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.112+0000 7fd1ee7fc640 1 -- 172.21.15.113:0/1479561329 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd1f407bfa0 con 0x7fd1f806cc00 2024-04-22T06:32:39.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.287+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd1f80b3060 con 0x7fd1f806cc00 2024-04-22T06:32:39.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.288+0000 7fd1ee7fc640 1 -- 172.21.15.113:0/1479561329 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fd1f4030810 con 0x7fd1f806cc00 2024-04-22T06:32:39.287 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:32:39.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd1dc06c920 msgr2=0x7fd1dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd1dc06c920 0x7fd1dc06ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80b3890 tx=0x7fd1e8008040 comp rx=0 tx=0).stop 2024-04-22T06:32:39.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 msgr2=0x7fd1f8151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f8151b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd1f402b9c0 tx=0x7fd1f4004730 comp rx=0 tx=0).stop 2024-04-22T06:32:39.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 shutdown_connections 2024-04-22T06:32:39.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd1f80cbc00 0x7fd1f8150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f806cfe0 0x7fd1f8152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd1dc06c920 0x7fd1dc06ede0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 --2- 172.21.15.113:0/1479561329 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd1f806cc00 0x7fd1f8151b10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.289+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 >> 172.21.15.113:0/1479561329 conn(0x7fd1f8075570 msgr2=0x7fd1f8152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:39.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.290+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 shutdown_connections 2024-04-22T06:32:39.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.290+0000 7fd1ffa7a640 1 -- 172.21.15.113:0/1479561329 wait complete. 2024-04-22T06:32:39.300 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:32:39.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.400+0000 7f8cf1a43640 1 Processor -- start 2024-04-22T06:32:39.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.400+0000 7f8cf1a43640 1 -- start start 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8cf1a43640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec15b070 0x7f8cec0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8cf1a43640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cec0c5c80 con 0x7f8cec0cbae0 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8cf1a43640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cec15b5d0 con 0x7f8cec1553c0 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8cf1a43640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8cec15e660 con 0x7f8cec15b070 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ceb7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8cec0cbae0 0x7f8cec0d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38348/0 (socket says 172.21.15.113:38348) 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ceb7fe640 1 -- 172.21.15.113:0/1409546752 learned_addr learned my addr 172.21.15.113:0/1409546752 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123376036 0 0) 0x7f8cec0c5c80 con 0x7f8cec0cbae0 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8cea7fc640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec15b070 0x7f8cec0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cd4003520 con 0x7f8cec0cbae0 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 771566742 0 0) 0x7f8cd4003520 con 0x7f8cec0cbae0 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec15b070 msgr2=0x7f8cec0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec15b070 0x7f8cec0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 >> v1:172.21.15.145:6789/0 conn(0x7f8cec1553c0 legacy=0x7f8cec15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec15b8b0 con 0x7f8cec0cbae0 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f8ce40019f0 con 0x7f8cec0cbae0 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 >> v1:172.21.15.113:6789/0 conn(0x7f8cec0cbae0 legacy=0x7f8cec0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cd40039e0 0x7f8cd4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec15b070 0x7f8cd4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd4004d40 0x7f8cd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec15e660 con 0x7f8cd40039e0 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd400bb50 con 0x7f8cd4004d40 2024-04-22T06:32:39.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.401+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd400bd50 con 0x7f8cec15b070 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.402+0000 7f8ceaffd640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cd40039e0 0x7f8cd4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.402+0000 7f8cea7fc640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec15b070 0x7f8cd4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.402+0000 7f8ceb7fe640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd4004d40 0x7f8cd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.402+0000 7f8ceaffd640 1 -- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec15b070 msgr2=0x7f8cd4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.402+0000 7f8ceaffd640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec15b070 0x7f8cd4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.402+0000 7f8ceaffd640 1 -- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd4004d40 msgr2=0x7f8cd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.402+0000 7f8ceaffd640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd4004d40 0x7f8cd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.402+0000 7f8ceaffd640 1 -- 172.21.15.113:0/1409546752 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd4003520 con 0x7f8cd40039e0 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8ceaffd640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cd40039e0 0x7f8cd4003e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc001770 tx=0x7f8cd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed8217aa39c1042 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0013c0 con 0x7f8cd40039e0 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0052d0 con 0x7f8cd40039e0 2024-04-22T06:32:39.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8ce9ffb640 1 -- 172.21.15.113:0/1409546752 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc003640 con 0x7f8cd40039e0 2024-04-22T06:32:39.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8cf1a43640 1 -- 172.21.15.113:0/1409546752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cd40039e0 msgr2=0x7f8cd4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8cf1a43640 1 --2- 172.21.15.113:0/1409546752 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cd40039e0 0x7f8cd4003e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc001770 tx=0x7f8cd4005830 comp rx=0 tx=0).stop 2024-04-22T06:32:39.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8ceb7fe640 1 -- 172.21.15.113:0/1409546752 reap_dead start 2024-04-22T06:32:39.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8cf1a43640 1 -- 172.21.15.113:0/1409546752 shutdown_connections 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8cf1a43640 1 -- 172.21.15.113:0/1409546752 >> 172.21.15.113:0/1409546752 conn(0x7f8cec072360 msgr2=0x7f8cec074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8cf1a43640 1 -- 172.21.15.113:0/1409546752 shutdown_connections 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.403+0000 7f8cf1a43640 1 -- 172.21.15.113:0/1409546752 wait complete. 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.404+0000 7f8cf1a43640 1 Processor -- start 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.404+0000 7f8cf1a43640 1 -- start start 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cf1a43640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd40039e0 0x7f8cec1f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cf1a43640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cec0ca4d0 0x7f8cec0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cf1a43640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec14e3a0 0x7f8cec14e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cf1a43640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec15be70 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cf1a43640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec1557a0 con 0x7f8cd40039e0 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cf1a43640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8cec15e8b0 con 0x7f8cec14e3a0 2024-04-22T06:32:39.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cea7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cec0ca4d0 0x7f8cec0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cea7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cec0ca4d0 0x7f8cec0c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51090/0 (socket says 172.21.15.113:51090) 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cea7fc640 1 -- 172.21.15.113:0/247922884 learned_addr learned my addr 172.21.15.113:0/247922884 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8ceaffd640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd40039e0 0x7f8cec1f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8ceb7fe640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec14e3a0 0x7f8cec14e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.405+0000 7f8cea7fc640 1 -- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec14e3a0 msgr2=0x7f8cec14e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cea7fc640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec14e3a0 0x7f8cec14e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cea7fc640 1 -- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd40039e0 msgr2=0x7f8cec1f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cea7fc640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd40039e0 0x7f8cec1f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cea7fc640 1 -- 172.21.15.113:0/247922884 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec1f59f0 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8ceb7fe640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec14e3a0 0x7f8cec14e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cea7fc640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cec0ca4d0 0x7f8cec0c8780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000b7a0 tx=0x7f8ce000bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cd3fff640 1 -- 172.21.15.113:0/247922884 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0018070 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cd3fff640 1 -- 172.21.15.113:0/247922884 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce000be50 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cec158560 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cd3fff640 1 -- 172.21.15.113:0/247922884 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0010c80 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.406+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cec0cee00 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.407+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cec159ce0 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.407+0000 7f8cd3fff640 1 -- 172.21.15.113:0/247922884 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ce001b070 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.408+0000 7f8cd3fff640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c920 0x7f8cd806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.408+0000 7f8cd3fff640 1 -- 172.21.15.113:0/247922884 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8ce008c310 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.408+0000 7f8ceaffd640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c920 0x7f8cd806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.408+0000 7f8ceaffd640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c920 0x7f8cd806ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc001770 tx=0x7f8cdc009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.412+0000 7f8cd3fff640 1 -- 172.21.15.113:0/247922884 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8cec159ce0 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.588+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8cec0b44f0 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.588+0000 7f8cd3fff640 1 -- 172.21.15.113:0/247922884 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f8cec0b44f0 con 0x7f8cec0ca4d0 2024-04-22T06:32:39.588 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:32:39.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c920 msgr2=0x7f8cd806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c920 0x7f8cd806ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc001770 tx=0x7f8cdc009030 comp rx=0 tx=0).stop 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cec0ca4d0 msgr2=0x7f8cec0c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cec0ca4d0 0x7f8cec0c8780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000b7a0 tx=0x7f8ce000bc60 comp rx=0 tx=0).stop 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 shutdown_connections 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8cec14e3a0 0x7f8cec14e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8cd806c920 0x7f8cd806ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cec0ca4d0 0x7f8cec0c8780 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 --2- 172.21.15.113:0/247922884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cd40039e0 0x7f8cec1f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 >> 172.21.15.113:0/247922884 conn(0x7f8cec072360 msgr2=0x7f8cec154600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 shutdown_connections 2024-04-22T06:32:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.590+0000 7f8cf1a43640 1 -- 172.21.15.113:0/247922884 wait complete. 2024-04-22T06:32:39.600 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:32:39.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.699+0000 7fd3a7a31640 1 Processor -- start 2024-04-22T06:32:39.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.699+0000 7fd3a7a31640 1 -- start start 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a7a31640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a0075830 0x7fd3a015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a7a31640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a00c73f0 con 0x7fd3a006f880 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a7a31640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a00c76d0 con 0x7fd3a0153150 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a7a31640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a00caef0 con 0x7fd3a0075830 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a4fcc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd3a006f880 0x7fd3a00c4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38360/0 (socket says 172.21.15.113:38360) 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a4fcc640 1 -- 172.21.15.113:0/3695578903 learned_addr learned my addr 172.21.15.113:0/3695578903 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258290170 0 0) 0x7fd3a00c73f0 con 0x7fd3a006f880 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd38c003520 con 0x7fd3a006f880 2024-04-22T06:32:39.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a5fce640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a0075830 0x7fd3a015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 262916504 0 0) 0x7fd38c003520 con 0x7fd3a006f880 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a0075830 msgr2=0x7fd3a015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a0075830 0x7fd3a015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 >> v1:172.21.15.145:6789/0 conn(0x7fd3a0153150 legacy=0x7fd3a00c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a00c79b0 con 0x7fd3a006f880 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fd390001670 con 0x7fd3a006f880 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 >> v1:172.21.15.113:6789/0 conn(0x7fd3a006f880 legacy=0x7fd3a00c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd38c0039e0 0x7fd38c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a0075830 0x7fd38c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd38c004d40 0x7fd38c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c00bb00 con 0x7fd38c004d40 2024-04-22T06:32:39.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c00bc80 con 0x7fd38c0039e0 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c00be80 con 0x7fd3a0075830 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a5fce640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd38c004d40 0x7fd38c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a57cd640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd38c0039e0 0x7fd38c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.700+0000 7fd3a4fcc640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a0075830 0x7fd38c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.701+0000 7fd3a5fce640 1 -- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a0075830 msgr2=0x7fd38c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.701+0000 7fd3a5fce640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3a0075830 0x7fd38c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.701+0000 7fd3a5fce640 1 -- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd38c0039e0 msgr2=0x7fd38c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.701+0000 7fd3a5fce640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd38c0039e0 0x7fd38c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.701+0000 7fd3a5fce640 1 -- 172.21.15.113:0/3695578903 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c003520 con 0x7fd38c004d40 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.701+0000 7fd3a5fce640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd38c004d40 0x7fd38c0051c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd398009f90 tx=0x7fd38c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aefa26dc99aad2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.701+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398039070 con 0x7fd38c004d40 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39802cbd0 con 0x7fd38c004d40 2024-04-22T06:32:39.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd397fff640 1 -- 172.21.15.113:0/3695578903 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398009c10 con 0x7fd38c004d40 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd3a7a31640 1 -- 172.21.15.113:0/3695578903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd38c004d40 msgr2=0x7fd38c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd3a7a31640 1 --2- 172.21.15.113:0/3695578903 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd38c004d40 0x7fd38c0051c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd398009f90 tx=0x7fd38c005830 comp rx=0 tx=0).stop 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd3a5fce640 1 -- 172.21.15.113:0/3695578903 reap_dead start 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd3a7a31640 1 -- 172.21.15.113:0/3695578903 shutdown_connections 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd3a7a31640 1 -- 172.21.15.113:0/3695578903 >> 172.21.15.113:0/3695578903 conn(0x7fd3a00ca0d0 msgr2=0x7fd3a00ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd3a7a31640 1 -- 172.21.15.113:0/3695578903 shutdown_connections 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.702+0000 7fd3a7a31640 1 -- 172.21.15.113:0/3695578903 wait complete. 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.703+0000 7fd3a7a31640 1 Processor -- start 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.703+0000 7fd3a7a31640 1 -- start start 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a7a31640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd38c004d40 0x7fd3a01f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a7a31640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a01f0790 0x7fd3a014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a7a31640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3a014cd80 0x7fd3a00cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a7a31640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a00753a0 con 0x7fd3a014cd80 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a7a31640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a0075cc0 con 0x7fd3a01f0790 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a7a31640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a0075030 con 0x7fd38c004d40 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a5fce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3a014cd80 0x7fd3a00cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a5fce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3a014cd80 0x7fd3a00cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51104/0 (socket says 172.21.15.113:51104) 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a5fce640 1 -- 172.21.15.113:0/2978181653 learned_addr learned my addr 172.21.15.113:0/2978181653 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a4fcc640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a01f0790 0x7fd3a014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a57cd640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd38c004d40 0x7fd3a01f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a5fce640 1 -- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd38c004d40 msgr2=0x7fd3a01f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a5fce640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd38c004d40 0x7fd3a01f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a5fce640 1 -- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a01f0790 msgr2=0x7fd3a014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a5fce640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a01f0790 0x7fd3a014c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a5fce640 1 -- 172.21.15.113:0/2978181653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a01f0ca0 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.704+0000 7fd3a4fcc640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a01f0790 0x7fd3a014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.705+0000 7fd3a5fce640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3a014cd80 0x7fd3a00cd870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd39802c640 tx=0x7fd398009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.705+0000 7fd395ffb640 1 -- 172.21.15.113:0/2978181653 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398039070 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.705+0000 7fd395ffb640 1 -- 172.21.15.113:0/2978181653 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39803a040 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.705+0000 7fd395ffb640 1 -- 172.21.15.113:0/2978181653 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398003990 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.705+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a00cb640 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.705+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a00cbc00 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.706+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a0158450 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.706+0000 7fd395ffb640 1 -- 172.21.15.113:0/2978181653 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd398046030 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.707+0000 7fd395ffb640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd38406c860 0x7fd38406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.707+0000 7fd395ffb640 1 -- 172.21.15.113:0/2978181653 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd3980ade30 con 0x7fd3a014cd80 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.707+0000 7fd3a57cd640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd38406c860 0x7fd38406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:39.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.707+0000 7fd3a57cd640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd38406c860 0x7fd38406ed20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd39c005590 tx=0x7fd39c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:39.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.711+0000 7fd395ffb640 1 -- 172.21.15.113:0/2978181653 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3a0158450 con 0x7fd3a014cd80 2024-04-22T06:32:39.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.921+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3a0068e40 con 0x7fd3a014cd80 2024-04-22T06:32:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.922+0000 7fd395ffb640 1 -- 172.21.15.113:0/2978181653 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6917 (secure 0 0 0) 0x7fd39804d020 con 0x7fd3a014cd80 2024-04-22T06:32:39.921 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:39.921 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:25.981022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4308,"mds_2":4305,"mds_3":4264,"mds_4":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":4,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"a","rank":2,"incarnation":12,"state":"up:active","state_seq":12,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:active","state_seq":11,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4259,4311,4264,4305,4308]},"id":1}]} 2024-04-22T06:32:39.921 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 17 2024-04-22T06:32:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd38406c860 msgr2=0x7fd38406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd38406c860 0x7fd38406ed20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd39c005590 tx=0x7fd39c009040 comp rx=0 tx=0).stop 2024-04-22T06:32:39.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3a014cd80 msgr2=0x7fd3a00cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3a014cd80 0x7fd3a00cd870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd39802c640 tx=0x7fd398009750 comp rx=0 tx=0).stop 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 shutdown_connections 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd38406c860 0x7fd38406ed20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd3a014cd80 0x7fd3a00cd870 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3a01f0790 0x7fd3a014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 --2- 172.21.15.113:0/2978181653 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd38c004d40 0x7fd3a01f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 >> 172.21.15.113:0/2978181653 conn(0x7fd3a00ca0d0 msgr2=0x7fd3a01569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 shutdown_connections 2024-04-22T06:32:39.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:39.924+0000 7fd3a7a31640 1 -- 172.21.15.113:0/2978181653 wait complete. 2024-04-22T06:32:39.934 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:32:40.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.031+0000 7f12b84fd640 1 Processor -- start 2024-04-22T06:32:40.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.031+0000 7f12b84fd640 1 -- start start 2024-04-22T06:32:40.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.032+0000 7f12b84fd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f12b015c620 0x7f12b015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.032+0000 7f12b84fd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b00c7690 con 0x7f12b0153130 2024-04-22T06:32:40.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.032+0000 7f12b84fd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b015cfb0 con 0x7f12b00ca940 2024-04-22T06:32:40.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.032+0000 7f12b84fd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f12b0159c20 con 0x7f12b015c620 2024-04-22T06:32:40.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.032+0000 7f12b6a9a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f12b015c620 0x7f12b015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.032+0000 7f12b6299640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f12b0153130 0x7f12b0073c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38370/0 (socket says 172.21.15.113:38370) 2024-04-22T06:32:40.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.033+0000 7f12b6299640 1 -- 172.21.15.113:0/1978582188 learned_addr learned my addr 172.21.15.113:0/1978582188 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:40.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.033+0000 7f12b6a9a640 1 --2- 172.21.15.113:0/1978582188 >> v2:172.21.15.113:3300/0 conn(0x7f12b015c620 0x7f12b015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51120/0 (socket says 172.21.15.113:51120) 2024-04-22T06:32:40.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.033+0000 7f12b6a9a640 1 -- 172.21.15.113:0/1978582188 >> v1:172.21.15.145:6789/0 conn(0x7f12b00ca940 legacy=0x7f12b00ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.033+0000 7f12b6a9a640 1 -- 172.21.15.113:0/1978582188 >> v1:172.21.15.113:6789/0 conn(0x7f12b0153130 legacy=0x7f12b0073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.033+0000 7f12b5297640 1 -- 172.21.15.113:0/1978582188 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329858496 0 0) 0x7f12b00c7690 con 0x7f12b0153130 2024-04-22T06:32:40.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.033+0000 7f12b6a9a640 1 -- 172.21.15.113:0/1978582188 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b0158d50 con 0x7f12b015c620 2024-04-22T06:32:40.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b6a9a640 1 --2- 172.21.15.113:0/1978582188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b015c620 0x7f12b015ca70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009d90 tx=0x7f12a802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f56cc6a99b350bc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:40.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b5297640 1 -- 172.21.15.113:0/1978582188 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8039070 con 0x7f12b015c620 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b5297640 1 -- 172.21.15.113:0/1978582188 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a802cd00 con 0x7f12b015c620 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b5297640 1 -- 172.21.15.113:0/1978582188 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8034660 con 0x7f12b015c620 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b84fd640 1 -- 172.21.15.113:0/1978582188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b015c620 msgr2=0x7f12b015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b84fd640 1 --2- 172.21.15.113:0/1978582188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b015c620 0x7f12b015ca70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009d90 tx=0x7f12a802bf50 comp rx=0 tx=0).stop 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b84fd640 1 -- 172.21.15.113:0/1978582188 shutdown_connections 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b84fd640 1 --2- 172.21.15.113:0/1978582188 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b015c620 0x7f12b015ca70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b84fd640 1 -- 172.21.15.113:0/1978582188 >> 172.21.15.113:0/1978582188 conn(0x7f12b0074d50 msgr2=0x7f12b0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b84fd640 1 -- 172.21.15.113:0/1978582188 shutdown_connections 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.034+0000 7f12b84fd640 1 -- 172.21.15.113:0/1978582188 wait complete. 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.035+0000 7f12b84fd640 1 Processor -- start 2024-04-22T06:32:40.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.035+0000 7f12b84fd640 1 -- start start 2024-04-22T06:32:40.037 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b84fd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b00ca940 0x7f12b014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b84fd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b0153130 0x7f12b0159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b84fd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b015c620 0x7f12b01538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b84fd640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f12b01595d0 con 0x7f12b0153130 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b84fd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f12b01592f0 con 0x7f12b015c620 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b84fd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f12b01598b0 con 0x7f12b00ca940 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b5a98640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b0153130 0x7f12b0159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b5a98640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b0153130 0x7f12b0159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51132/0 (socket says 172.21.15.113:51132) 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b5a98640 1 -- 172.21.15.113:0/2796403118 learned_addr learned my addr 172.21.15.113:0/2796403118 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b6a9a640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b015c620 0x7f12b01538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.036+0000 7f12b6299640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b00ca940 0x7f12b014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b5a98640 1 -- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b00ca940 msgr2=0x7f12b014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b5a98640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b00ca940 0x7f12b014ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b5a98640 1 -- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b015c620 msgr2=0x7f12b01538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b5a98640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b015c620 0x7f12b01538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b5a98640 1 -- 172.21.15.113:0/2796403118 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b014b960 con 0x7f12b0153130 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b6299640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b00ca940 0x7f12b014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b5a98640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b0153130 0x7f12b0159f10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c480 tx=0x7f12a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12a6ffd640 1 -- 172.21.15.113:0/2796403118 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a00052d0 con 0x7f12b0153130 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12a6ffd640 1 -- 172.21.15.113:0/2796403118 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a0005470 con 0x7f12b0153130 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12a6ffd640 1 -- 172.21.15.113:0/2796403118 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0012870 con 0x7f12b0153130 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b014bc40 con 0x7f12b0153130 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.037+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b014c200 con 0x7f12b0153130 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.038+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b00cda20 con 0x7f12b0153130 2024-04-22T06:32:40.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.038+0000 7f12a6ffd640 1 -- 172.21.15.113:0/2796403118 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12a0012a10 con 0x7f12b0153130 2024-04-22T06:32:40.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.039+0000 7f12a6ffd640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f129406c920 0x7f129406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.039+0000 7f12b6299640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f129406c920 0x7f129406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.039+0000 7f12a6ffd640 1 -- 172.21.15.113:0/2796403118 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f12a008bb00 con 0x7f12b0153130 2024-04-22T06:32:40.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.039+0000 7f12b6299640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f129406c920 0x7f129406ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12ac000f60 tx=0x7f12ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:40.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.043+0000 7f12a6ffd640 1 -- 172.21.15.113:0/2796403118 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f12b00cda20 con 0x7f12b0153130 2024-04-22T06:32:40.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.221+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12b0069e00 con 0x7f12b0153130 2024-04-22T06:32:40.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.222+0000 7f12a6ffd640 1 -- 172.21.15.113:0/2796403118 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f12b0069e00 con 0x7f12b0153130 2024-04-22T06:32:40.221 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:40.222 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:32:40.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f129406c920 msgr2=0x7f129406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f129406c920 0x7f129406ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12ac000f60 tx=0x7f12ac009040 comp rx=0 tx=0).stop 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b0153130 msgr2=0x7f12b0159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b0153130 0x7f12b0159f10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c480 tx=0x7f12a000c940 comp rx=0 tx=0).stop 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 shutdown_connections 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12b015c620 0x7f12b01538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f129406c920 0x7f129406ede0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12b0153130 0x7f12b0159f10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 --2- 172.21.15.113:0/2796403118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12b00ca940 0x7f12b014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 >> 172.21.15.113:0/2796403118 conn(0x7f12b0074d50 msgr2=0x7f12b00cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 shutdown_connections 2024-04-22T06:32:40.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.224+0000 7f12b84fd640 1 -- 172.21.15.113:0/2796403118 wait complete. 2024-04-22T06:32:40.234 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 109093 2024-04-22T06:32:40.235 DEBUG:tasks.quiescer:Yielding 2024-04-22T06:32:40.235 INFO:teuthology.run_tasks:Running task workunit... 2024-04-22T06:32:40.248 INFO:tasks.workunit:Pulling workunits from ref 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T06:32:40.248 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-22T06:32:40.248 INFO:tasks.workunit:timeout=3h 2024-04-22T06:32:40.248 INFO:tasks.workunit:cleanup=True 2024-04-22T06:32:40.249 DEBUG:teuthology.orchestra.run.smithi113:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:40.249 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-04-22 06:31:42.828764151 +0000 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-04-22 06:31:50.222780065 +0000 2024-04-22T06:32:40.264 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2024-04-22T06:32:40.265 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-22T06:32:40.265 DEBUG:teuthology.orchestra.run.smithi113:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-22T06:32:40.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.348+0000 7ff523a11640 1 Processor -- start 2024-04-22T06:32:40.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.349+0000 7ff523a11640 1 -- start start 2024-04-22T06:32:40.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.349+0000 7ff523a11640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff51c0c9610 0x7ff51c0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.349+0000 7ff523a11640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51c158570 con 0x7ff51c0c5b80 2024-04-22T06:32:40.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.349+0000 7ff523a11640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51c158850 con 0x7ff51c151f10 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.349+0000 7ff523a11640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7ff51c15b8a0 con 0x7ff51c0c9610 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.349+0000 7ff520fac640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff51c0c5b80 0x7ff51c15bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38378/0 (socket says 172.21.15.113:38378) 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff520fac640 1 -- 172.21.15.113:0/3898096663 learned_addr learned my addr 172.21.15.113:0/3898096663 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161211355 0 0) 0x7ff51c158570 con 0x7ff51c0c5b80 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff521fae640 1 --2- 172.21.15.113:0/3898096663 >> v2:172.21.15.145:3300/0 conn(0x7ff51c0c9610 0x7ff51c0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff508003520 con 0x7ff51c0c5b80 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3242400704 0 0) 0x7ff508003520 con 0x7ff51c0c5b80 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 >> v2:172.21.15.145:3300/0 conn(0x7ff51c0c9610 msgr2=0x7ff51c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 --2- 172.21.15.113:0/3898096663 >> v2:172.21.15.145:3300/0 conn(0x7ff51c0c9610 0x7ff51c0ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 >> v1:172.21.15.145:6789/0 conn(0x7ff51c151f10 legacy=0x7ff51c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c158b30 con 0x7ff51c0c5b80 2024-04-22T06:32:40.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7ff518001670 con 0x7ff51c0c5b80 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 >> v1:172.21.15.113:6789/0 conn(0x7ff51c0c5b80 legacy=0x7ff51c15bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5080039b0 0x7ff508003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff508004800 0x7ff508004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5080051c0 0x7ff50800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c15b8a0 con 0x7ff5080039b0 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff50800c060 con 0x7ff508004800 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff50800c260 con 0x7ff5080051c0 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff5217ad640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5080039b0 0x7ff508003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff520fac640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff508004800 0x7ff508004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff521fae640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5080051c0 0x7ff50800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff5217ad640 1 -- 172.21.15.113:0/3898096663 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5080051c0 msgr2=0x7ff50800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff5217ad640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff5080051c0 0x7ff50800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff5217ad640 1 -- 172.21.15.113:0/3898096663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff508004800 msgr2=0x7ff508004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff5217ad640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff508004800 0x7ff508004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff5217ad640 1 -- 172.21.15.113:0/3898096663 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff508003520 con 0x7ff5080039b0 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.350+0000 7ff521fae640 1 -- 172.21.15.113:0/3898096663 reap_dead start 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.351+0000 7ff5217ad640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5080039b0 0x7ff508003dd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff50c001750 tx=0x7ff508005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a7a014cb6070dd server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.351+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c001370 con 0x7ff5080039b0 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.351+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50c0052d0 con 0x7ff5080039b0 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.351+0000 7ff513fff640 1 -- 172.21.15.113:0/3898096663 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c003830 con 0x7ff5080039b0 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.352+0000 7ff523a11640 1 -- 172.21.15.113:0/3898096663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5080039b0 msgr2=0x7ff508003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.352+0000 7ff523a11640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5080039b0 0x7ff508003dd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff50c001750 tx=0x7ff508005830 comp rx=0 tx=0).stop 2024-04-22T06:32:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.352+0000 7ff523a11640 1 -- 172.21.15.113:0/3898096663 shutdown_connections 2024-04-22T06:32:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.352+0000 7ff523a11640 1 --2- 172.21.15.113:0/3898096663 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5080039b0 0x7ff508003dd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.352+0000 7ff523a11640 1 -- 172.21.15.113:0/3898096663 >> 172.21.15.113:0/3898096663 conn(0x7ff51c06bd10 msgr2=0x7ff51c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.352+0000 7ff523a11640 1 -- 172.21.15.113:0/3898096663 shutdown_connections 2024-04-22T06:32:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.352+0000 7ff523a11640 1 -- 172.21.15.113:0/3898096663 wait complete. 2024-04-22T06:32:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.353+0000 7ff523a11640 1 Processor -- start 2024-04-22T06:32:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.353+0000 7ff523a11640 1 -- start start 2024-04-22T06:32:40.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff523a11640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5080039b0 0x7ff51c073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff523a11640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff51c1f4d20 0x7ff51c072550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff523a11640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff51c072a90 0x7ff51c1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff523a11640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c0c8100 con 0x7ff51c1f4d20 2024-04-22T06:32:40.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff523a11640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c0c7f80 con 0x7ff5080039b0 2024-04-22T06:32:40.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff523a11640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ff51c157da0 con 0x7ff51c072a90 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff51c1f4d20 0x7ff51c072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff51c1f4d20 0x7ff51c072550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51146/0 (socket says 172.21.15.113:51146) 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 -- 172.21.15.113:0/3563575227 learned_addr learned my addr 172.21.15.113:0/3563575227 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff5217ad640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5080039b0 0x7ff51c073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff521fae640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff51c072a90 0x7ff51c1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 -- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff51c072a90 msgr2=0x7ff51c1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff51c072a90 0x7ff51c1599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 -- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5080039b0 msgr2=0x7ff51c073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.360 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5080039b0 0x7ff51c073360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 -- 172.21.15.113:0/3563575227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c14c1b0 con 0x7ff51c1f4d20 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff521fae640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff51c072a90 0x7ff51c1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff520fac640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff51c1f4d20 0x7ff51c072550 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff518007340 tx=0x7ff518007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff511ffb640 1 -- 172.21.15.113:0/3563575227 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51800f8c0 con 0x7ff51c1f4d20 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff511ffb640 1 -- 172.21.15.113:0/3563575227 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff518018070 con 0x7ff51c1f4d20 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c0cbdf0 con 0x7ff51c1f4d20 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.354+0000 7ff511ffb640 1 -- 172.21.15.113:0/3563575227 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51800fca0 con 0x7ff51c1f4d20 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.355+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c1591b0 con 0x7ff51c1f4d20 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.356+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51c0c4de0 con 0x7ff51c1f4d20 2024-04-22T06:32:40.361 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.356+0000 7ff511ffb640 1 -- 172.21.15.113:0/3563575227 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff51801d460 con 0x7ff51c1f4d20 2024-04-22T06:32:40.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.356+0000 7ff511ffb640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff50006c8f0 0x7ff50006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:40.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.356+0000 7ff511ffb640 1 -- 172.21.15.113:0/3563575227 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff51808be70 con 0x7ff51c1f4d20 2024-04-22T06:32:40.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.356+0000 7ff5217ad640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff50006c8f0 0x7ff50006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:40.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.357+0000 7ff5217ad640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff50006c8f0 0x7ff50006edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff50c033000 tx=0x7ff50c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:40.362 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.360+0000 7ff511ffb640 1 -- 172.21.15.113:0/3563575227 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff51c0c4de0 con 0x7ff51c1f4d20 2024-04-22T06:32:40.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.570+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff51c0c7450 con 0x7ff51c1f4d20 2024-04-22T06:32:40.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.570+0000 7ff511ffb640 1 -- 172.21.15.113:0/3563575227 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6917 (secure 0 0 0) 0x7ff518059f30 con 0x7ff51c1f4d20 2024-04-22T06:32:40.570 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:40.570 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:25.981022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4308,"mds_2":4305,"mds_3":4264,"mds_4":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":4,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"a","rank":2,"incarnation":12,"state":"up:active","state_seq":12,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:active","state_seq":11,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4259,4311,4264,4305,4308]},"id":1}]} 2024-04-22T06:32:40.570 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 17 2024-04-22T06:32:40.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff50006c8f0 msgr2=0x7ff50006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff50006c8f0 0x7ff50006edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff50c033000 tx=0x7ff50c009030 comp rx=0 tx=0).stop 2024-04-22T06:32:40.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff51c1f4d20 msgr2=0x7ff51c072550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:40.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff51c1f4d20 0x7ff51c072550 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff518007340 tx=0x7ff518007800 comp rx=0 tx=0).stop 2024-04-22T06:32:40.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 shutdown_connections 2024-04-22T06:32:40.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff51c072a90 0x7ff51c1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff50006c8f0 0x7ff50006edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff51c1f4d20 0x7ff51c072550 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 --2- 172.21.15.113:0/3563575227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff5080039b0 0x7ff51c073360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:40.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.572+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 >> 172.21.15.113:0/3563575227 conn(0x7ff51c06bd10 msgr2=0x7ff51c0c63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:40.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.573+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 shutdown_connections 2024-04-22T06:32:40.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:40.573+0000 7ff523a11640 1 -- 172.21.15.113:0/3563575227 wait complete. 2024-04-22T06:32:41.179 DEBUG:teuthology.orchestra.run.smithi113:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T06:32:41.187 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-22T06:31:37.179004+0000', 'modified': '2024-04-22T06:32:25.981022+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4311, 'mds_1': 4308, 'mds_2': 4305, 'mds_3': 4264, 'mds_4': 4259}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4259': {'gid': 4259, 'name': 'f', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.145:6837/2093995968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6836', 'nonce': 2093995968}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 2093995968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4264': {'gid': 4264, 'name': 'd', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.145:6834/9331508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 9331508}, {'type': 'v1', 'addr': '172.21.15.145:6834', 'nonce': 9331508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4305': {'gid': 4305, 'name': 'a', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.113:6835/999776030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6834', 'nonce': 999776030}, {'type': 'v1', 'addr': '172.21.15.113:6835', 'nonce': 999776030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4308': {'gid': 4308, 'name': 'e', 'rank': 1, 'incarnation': 8, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.113:6838/1889319276', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6836', 'nonce': 1889319276}, {'type': 'v1', 'addr': '172.21.15.113:6838', 'nonce': 1889319276}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4311': {'gid': 4311, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.113:6839/4160787448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6837', 'nonce': 4160787448}, {'type': 'v1', 'addr': '172.21.15.113:6839', 'nonce': 4160787448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4311, 'qdb_cluster': [4259, 4311, 4264, 4305, 4308]} 2024-04-22T06:32:41.187 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-22T06:32:41.187 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-22T06:32:41.196 INFO:tasks.workunit.client.0.smithi113.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-22T06:32:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.297+0000 7fa43207a640 1 Processor -- start 2024-04-22T06:32:41.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.297+0000 7fa43207a640 1 -- start start 2024-04-22T06:32:41.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.297+0000 7fa43207a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa42c152f70 0x7fa42c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa43207a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa42c15cbd0 0x7fa42c0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa43207a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa42c158fe0 con 0x7fa42c0c8870 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa43207a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fa42c1592c0 con 0x7fa42c15cbd0 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa43207a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fa42c1595a0 con 0x7fa42c152f70 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa42c15cbd0 0x7fa42c0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42affd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa42c0c8870 0x7fa42c15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38390/0 (socket says 172.21.15.113:38390) 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42affd640 1 -- 172.21.15.113:0/3003333561 learned_addr learned my addr 172.21.15.113:0/3003333561 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/3003333561 >> v2:172.21.15.145:3300/0 conn(0x7fa42c152f70 0x7fa42c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42bfff640 1 -- 172.21.15.113:0/3003333561 >> v2:172.21.15.145:3300/0 conn(0x7fa42c152f70 msgr2=0x7fa42c0c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42bfff640 1 --2- 172.21.15.113:0/3003333561 >> v2:172.21.15.145:3300/0 conn(0x7fa42c152f70 0x7fa42c0c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42bfff640 1 -- 172.21.15.113:0/3003333561 >> v1:172.21.15.113:6789/0 conn(0x7fa42c0c8870 legacy=0x7fa42c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42a7fc640 1 -- 172.21.15.113:0/3003333561 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474362923 0 0) 0x7fa42c158fe0 con 0x7fa42c0c8870 2024-04-22T06:32:41.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.298+0000 7fa42bfff640 1 -- 172.21.15.113:0/3003333561 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42c159880 con 0x7fa42c15cbd0 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.299+0000 7fa42bfff640 1 --2- 172.21.15.113:0/3003333561 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c15cbd0 0x7fa42c0c6090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa42c071b40 tx=0x7fa42402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f055fa0877d0689e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.299+0000 7fa42a7fc640 1 -- 172.21.15.113:0/3003333561 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424039070 con 0x7fa42c15cbd0 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.299+0000 7fa42a7fc640 1 -- 172.21.15.113:0/3003333561 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42402cc80 con 0x7fa42c15cbd0 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.299+0000 7fa42a7fc640 1 -- 172.21.15.113:0/3003333561 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424034660 con 0x7fa42c15cbd0 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.299+0000 7fa43207a640 1 -- 172.21.15.113:0/3003333561 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c15cbd0 msgr2=0x7fa42c0c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.299+0000 7fa43207a640 1 --2- 172.21.15.113:0/3003333561 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c15cbd0 0x7fa42c0c6090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa42c071b40 tx=0x7fa42402bed0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.300+0000 7fa43207a640 1 -- 172.21.15.113:0/3003333561 shutdown_connections 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.300+0000 7fa43207a640 1 --2- 172.21.15.113:0/3003333561 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c15cbd0 0x7fa42c0c6090 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.300+0000 7fa43207a640 1 --2- 172.21.15.113:0/3003333561 >> v2:172.21.15.145:3300/0 conn(0x7fa42c152f70 0x7fa42c0c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.300+0000 7fa43207a640 1 -- 172.21.15.113:0/3003333561 >> 172.21.15.113:0/3003333561 conn(0x7fa42c074d50 msgr2=0x7fa42c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.300+0000 7fa43207a640 1 -- 172.21.15.113:0/3003333561 shutdown_connections 2024-04-22T06:32:41.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.300+0000 7fa43207a640 1 -- 172.21.15.113:0/3003333561 wait complete. 2024-04-22T06:32:41.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.301+0000 7fa43207a640 1 Processor -- start 2024-04-22T06:32:41.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.301+0000 7fa43207a640 1 -- start start 2024-04-22T06:32:41.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa43207a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c0c8870 0x7fa42c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa43207a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa42c152f70 0x7fa42c0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa43207a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa42c15cbd0 0x7fa42c14d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa43207a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1534d0 con 0x7fa42c0c8870 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa43207a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c153350 con 0x7fa42c152f70 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa43207a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa42c073a30 con 0x7fa42c15cbd0 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c0c8870 0x7fa42c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c0c8870 0x7fa42c1558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51164/0 (socket says 172.21.15.113:51164) 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 -- 172.21.15.113:0/708055542 learned_addr learned my addr 172.21.15.113:0/708055542 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 -- 172.21.15.113:0/708055542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa42c15cbd0 msgr2=0x7fa42c14d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa42c15cbd0 0x7fa42c14d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 -- 172.21.15.113:0/708055542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa42c152f70 msgr2=0x7fa42c0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa42c152f70 0x7fa42c0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 -- 172.21.15.113:0/708055542 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42c0ca7f0 con 0x7fa42c0c8870 2024-04-22T06:32:41.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c0c8870 0x7fa42c1558a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c7f0 tx=0x7fa41c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa413fff640 1 -- 172.21.15.113:0/708055542 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c015070 con 0x7fa42c0c8870 2024-04-22T06:32:41.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa413fff640 1 -- 172.21.15.113:0/708055542 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41c004240 con 0x7fa42c0c8870 2024-04-22T06:32:41.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa413fff640 1 -- 172.21.15.113:0/708055542 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c007620 con 0x7fa42c0c8870 2024-04-22T06:32:41.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa43207a640 1 -- 172.21.15.113:0/708055542 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42c157010 con 0x7fa42c0c8870 2024-04-22T06:32:41.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.302+0000 7fa43207a640 1 -- 172.21.15.113:0/708055542 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42c156d30 con 0x7fa42c0c8870 2024-04-22T06:32:41.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.304+0000 7fa413fff640 1 -- 172.21.15.113:0/708055542 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa41c0079d0 con 0x7fa42c0c8870 2024-04-22T06:32:41.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.304+0000 7fa413fff640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41806c8f0 0x7fa41806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.304+0000 7fa413fff640 1 -- 172.21.15.113:0/708055542 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa41c08c410 con 0x7fa42c0c8870 2024-04-22T06:32:41.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.304+0000 7fa42affd640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41806c8f0 0x7fa41806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.305+0000 7fa42affd640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41806c8f0 0x7fa41806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa4200011e0 tx=0x7fa420007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.305+0000 7fa434c6a740 1 Processor -- start 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.305+0000 7fa434c6a740 1 -- start start 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a3a2e40 0x56357a3abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a363ec0 0x56357a3ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a35fca0 0x56357a387ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa434c6a740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x56357a2c6b10 con 0x56357a363ec0 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa434c6a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56357a264240 con 0x56357a35fca0 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa434c6a740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56357a2c2ad0 con 0x56357a3a2e40 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a363ec0 0x56357a3ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a363ec0 0x56357a3ac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51172/0 (socket says 172.21.15.113:51172) 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42affd640 1 -- 172.21.15.113:0/2563134206 learned_addr learned my addr 172.21.15.113:0/2563134206 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a3a2e40 0x56357a3abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42bfff640 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a35fca0 0x56357a387ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42affd640 1 -- 172.21.15.113:0/2563134206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a3a2e40 msgr2=0x56357a3abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42affd640 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a3a2e40 0x56357a3abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42affd640 1 -- 172.21.15.113:0/2563134206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a35fca0 msgr2=0x56357a387ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42affd640 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a35fca0 0x56357a387ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.306+0000 7fa42affd640 1 -- 172.21.15.113:0/2563134206 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563579fd92d0 con 0x56357a363ec0 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.307+0000 7fa42affd640 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a363ec0 0x56357a3ac4a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0cf7b0 tx=0x7fa42000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45c07793a701bd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.307+0000 7fa4117fa640 1 -- 172.21.15.113:0/2563134206 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420006c90 con 0x56357a363ec0 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.307+0000 7fa4117fa640 1 -- 172.21.15.113:0/2563134206 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa420006e30 con 0x56357a363ec0 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.307+0000 7fa4117fa640 1 -- 172.21.15.113:0/2563134206 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420015910 con 0x56357a363ec0 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.307+0000 7fa434c6a740 1 -- 172.21.15.113:0/2563134206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a363ec0 msgr2=0x56357a3ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.307+0000 7fa434c6a740 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a363ec0 0x56357a3ac4a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0cf7b0 tx=0x7fa42000f000 comp rx=0 tx=0).stop 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 -- 172.21.15.113:0/2563134206 shutdown_connections 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a35fca0 0x56357a387ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a363ec0 0x56357a3ac4a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 --2- 172.21.15.113:0/2563134206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a3a2e40 0x56357a3abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 -- 172.21.15.113:0/2563134206 >> 172.21.15.113:0/2563134206 conn(0x56357a35e990 msgr2=0x56357a361290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 -- 172.21.15.113:0/2563134206 shutdown_connections 2024-04-22T06:32:41.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 -- 172.21.15.113:0/2563134206 wait complete. 2024-04-22T06:32:41.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 -- start start 2024-04-22T06:32:41.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.308+0000 7fa434c6a740 1 Processor -- start 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 0x56357a3a9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 0x56357a3a6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa434c6a740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x56357a362250 con 0x56357a3a2e40 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa434c6a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56357a24f190 con 0x56357a363ec0 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa434c6a740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56357a362530 con 0x56357a37da50 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa434c6a740 10 client.0 _ll_register_callbacks cb 0x56357a24a8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51180/0 (socket says 172.21.15.113:51180) 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 0x56357a3a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 -- 172.21.15.113:0/568016762 learned_addr learned my addr 172.21.15.113:0/568016762 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42bfff640 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 0x56357a3a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 -- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 msgr2=0x56357a3a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 0x56357a3a6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 -- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 msgr2=0x56357a3a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 0x56357a3a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 -- 172.21.15.113:0/568016762 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357a0a36b0 con 0x56357a3a2e40 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa42affd640 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35c670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa420014000 tx=0x7fa420011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b58345dea51b21 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.309+0000 7fa40a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa40a7fc640 1 -- 172.21.15.113:0/568016762 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420006c90 con 0x56357a3a2e40 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa40a7fc640 1 -- 172.21.15.113:0/568016762 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa420006070 con 0x56357a3a2e40 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 1 -- 172.21.15.113:0/568016762 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa420006e30 con 0x56357a3a2e40 2024-04-22T06:32:41.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa40a7fc640 1 -- 172.21.15.113:0/568016762 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa420030050 con 0x56357a3a2e40 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 10 client.5184 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 1 -- 172.21.15.113:0/568016762 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56357a35cbb0 con 0x56357a3a2e40 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa40a7fc640 1 -- 172.21.15.113:0/568016762 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa420006e30 con 0x56357a3a2e40 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa40a7fc640 1 -- 172.21.15.113:0/568016762 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7fa420033020 con 0x56357a3a2e40 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 10 client.5184 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 10 client.5184 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 20 client.5184 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x56357a3b72a0 0x56357a3c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 4 client.5184 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa434c6a740 1 -- 172.21.15.113:0/568016762 --> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56357a2d4530 con 0x56357a3b72a0 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.310+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x56357a3b72a0 0x56357a3c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.311+0000 7fa40a7fc640 10 client.5184 ms_handle_connect on v2:172.21.15.145:6836/2093995968 2024-04-22T06:32:41.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.311+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x56357a3b72a0 0x56357a3c29e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b4662320698a824 server_cookie=5789efec63a6c041 in_seq=0 out_seq=0 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.311+0000 7fa40a7fc640 1 -- 172.21.15.113:0/568016762 <== mds.4 v2:172.21.15.145:6836/2093995968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56357a2d4530 con 0x56357a3b72a0 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.311+0000 7fa40a7fc640 10 client.5184 handle_command_reply: tid=0 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.311+0000 7fa434c6a740 1 client.5184 shutdown 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.311+0000 7fa434c6a740 1 -- 172.21.15.113:0/568016762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 msgr2=0x56357a35c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.311+0000 7fa434c6a740 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35c670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa420014000 tx=0x7fa420011000 comp rx=0 tx=0).stop 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 1 -- 172.21.15.113:0/568016762 shutdown_connections 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x56357a3b72a0 0x56357a3c29e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 0x56357a3a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa40a7fc640 0 client.5184 ms_handle_reset on v2:172.21.15.145:6836/2093995968 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35c670 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 1 --2- 172.21.15.113:0/568016762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 0x56357a3a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 1 -- 172.21.15.113:0/568016762 >> 172.21.15.113:0/568016762 conn(0x56357a35fca0 msgr2=0x56357a360260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 1 -- 172.21.15.113:0/568016762 shutdown_connections 2024-04-22T06:32:41.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 1 -- 172.21.15.113:0/568016762 wait complete. 2024-04-22T06:32:41.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.312+0000 7fa434c6a740 20 client.5184 trim_cache size 0 max 16384 2024-04-22T06:32:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.330+0000 7fa434c6a740 1 Processor -- start 2024-04-22T06:32:41.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.331+0000 7fa434c6a740 1 -- start start 2024-04-22T06:32:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.331+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 0x56357a3a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.331+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 0x56357a35b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.331+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.331+0000 7fa434c6a740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1fcad0 con 0x56357a3a2e40 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.331+0000 7fa434c6a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56357a3a5b30 con 0x56357a363ec0 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.331+0000 7fa434c6a740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56357a35d110 con 0x56357a37da50 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.331+0000 7fa42bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51184/0 (socket says 172.21.15.113:51184) 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42bfff640 1 -- 172.21.15.113:0/3570710424 learned_addr learned my addr 172.21.15.113:0/3570710424 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 0x56357a3a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42affd640 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 0x56357a35b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42bfff640 1 -- 172.21.15.113:0/3570710424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 msgr2=0x56357a35b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42bfff640 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 0x56357a35b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42bfff640 1 -- 172.21.15.113:0/3570710424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 msgr2=0x56357a3a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42bfff640 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 0x56357a3a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42bfff640 1 -- 172.21.15.113:0/3570710424 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357a35d290 con 0x56357a3a2e40 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa42bfff640 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35b6b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa42402c4e0 tx=0x7fa42402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f563a1e2eb1750 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa410ff9640 1 -- 172.21.15.113:0/3570710424 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424039040 con 0x56357a3a2e40 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa410ff9640 1 -- 172.21.15.113:0/3570710424 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42402cd80 con 0x56357a3a2e40 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.332+0000 7fa410ff9640 1 -- 172.21.15.113:0/3570710424 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424003b90 con 0x56357a3a2e40 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 -- 172.21.15.113:0/3570710424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 msgr2=0x56357a35b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35b6b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa42402c4e0 tx=0x7fa42402e070 comp rx=0 tx=0).stop 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 -- 172.21.15.113:0/3570710424 shutdown_connections 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a35b6b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a37da50 0x56357a35b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 --2- 172.21.15.113:0/3570710424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a363ec0 0x56357a3a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 -- 172.21.15.113:0/3570710424 >> 172.21.15.113:0/3570710424 conn(0x56357a35fca0 msgr2=0x56357a3a6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 -- 172.21.15.113:0/3570710424 shutdown_connections 2024-04-22T06:32:41.334 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 -- 172.21.15.113:0/3570710424 wait complete. 2024-04-22T06:32:41.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 -- start start 2024-04-22T06:32:41.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.333+0000 7fa434c6a740 1 Processor -- start 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a363ec0 0x56357a3a5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a37da50 0x56357a3c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa434c6a740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a39f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa434c6a740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x56357a3b7120 con 0x56357a3a2e40 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa434c6a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56357a3aba80 con 0x56357a37da50 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa434c6a740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56357a3b7770 con 0x56357a363ec0 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa434c6a740 10 client.0 _ll_register_callbacks cb 0x7fa41c059b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa42bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a39f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa42bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a39f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51194/0 (socket says 172.21.15.113:51194) 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa42bfff640 1 -- 172.21.15.113:0/123703383 learned_addr learned my addr 172.21.15.113:0/123703383 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa42affd640 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a37da50 0x56357a3c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.334+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a363ec0 0x56357a3a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa42bfff640 1 -- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a363ec0 msgr2=0x56357a3a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa42bfff640 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a363ec0 0x56357a3a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa42bfff640 1 -- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a37da50 msgr2=0x56357a3c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa42bfff640 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a37da50 0x56357a3c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa42bfff640 1 -- 172.21.15.113:0/123703383 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357a3c81a0 con 0x56357a3a2e40 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a363ec0 0x56357a3a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa42bfff640 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a39f8f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa424009e50 tx=0x7fa424004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2063b456621ac761 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa40a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa40a7fc640 1 -- 172.21.15.113:0/123703383 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424039050 con 0x56357a3a2e40 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa40a7fc640 1 -- 172.21.15.113:0/123703383 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa424004240 con 0x56357a3a2e40 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa434c6a740 1 -- 172.21.15.113:0/123703383 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa42402cd80 con 0x56357a3a2e40 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa40a7fc640 1 -- 172.21.15.113:0/123703383 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa424058050 con 0x56357a3a2e40 2024-04-22T06:32:41.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa434c6a740 10 client.5190 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa434c6a740 1 -- 172.21.15.113:0/123703383 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56357a4219a0 con 0x56357a3a2e40 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa40a7fc640 1 -- 172.21.15.113:0/123703383 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42402cd80 con 0x56357a3a2e40 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa40a7fc640 1 -- 172.21.15.113:0/123703383 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7fa42405b020 con 0x56357a3a2e40 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa434c6a740 10 client.5190 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa434c6a740 10 client.5190 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa434c6a740 20 client.5190 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.335+0000 7fa434c6a740 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x56357a362e20 0x56357a429e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 4 client.5190 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 -- 172.21.15.113:0/123703383 --> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] -- command(tid 0: {"prefix": "status"}) -- 0x56357a2ce3a0 con 0x56357a362e20 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x56357a362e20 0x56357a429e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa42b7fe640 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x56357a362e20 0x56357a429e90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ece352a5cd049b1c server_cookie=d6c33081f641f85c in_seq=0 out_seq=0 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa40a7fc640 10 client.5190 ms_handle_connect on v2:172.21.15.145:6836/2093995968 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa40a7fc640 1 -- 172.21.15.113:0/123703383 <== mds.4 v2:172.21.15.145:6836/2093995968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56357a2ce3a0 con 0x56357a362e20 2024-04-22T06:32:41.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa40a7fc640 10 client.5190 handle_command_reply: tid=0 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 client.5190 shutdown 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 -- 172.21.15.113:0/123703383 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 msgr2=0x56357a39f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a39f8f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa424009e50 tx=0x7fa424004ab0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 -- 172.21.15.113:0/123703383 shutdown_connections 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:6836/2093995968,v1:172.21.15.145:6837/2093995968] conn(0x56357a362e20 0x56357a429e90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56357a3a2e40 0x56357a39f8f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56357a37da50 0x56357a3c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa40a7fc640 0 client.5190 ms_handle_reset on v2:172.21.15.145:6836/2093995968 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 --2- 172.21.15.113:0/123703383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56357a363ec0 0x56357a3a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.336+0000 7fa434c6a740 1 -- 172.21.15.113:0/123703383 >> 172.21.15.113:0/123703383 conn(0x56357a35fca0 msgr2=0x56357a35b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa434c6a740 1 -- 172.21.15.113:0/123703383 shutdown_connections 2024-04-22T06:32:41.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa434c6a740 1 -- 172.21.15.113:0/123703383 wait complete. 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa434c6a740 20 client.5190 trim_cache size 0 max 16384 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 4, 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4259, 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 21.368681575, 2024-04-22T06:32:41.343 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:41.344 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:41.344 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:41.344 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 70.712058045999996 2024-04-22T06:32:41.344 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 -- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41806c8f0 msgr2=0x7fa41806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41806c8f0 0x7fa41806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa4200011e0 tx=0x7fa420007920 comp rx=0 tx=0).stop 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 -- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c0c8870 msgr2=0x7fa42c1558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c0c8870 0x7fa42c1558a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c7f0 tx=0x7fa41c00ccb0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 -- 172.21.15.113:0/708055542 shutdown_connections 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa42c15cbd0 0x7fa42c14d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa42c152f70 0x7fa42c0c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa41806c8f0 0x7fa41806edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 --2- 172.21.15.113:0/708055542 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa42c0c8870 0x7fa42c1558a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 -- 172.21.15.113:0/708055542 >> 172.21.15.113:0/708055542 conn(0x7fa42c074d50 msgr2=0x7fa42c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 -- 172.21.15.113:0/708055542 shutdown_connections 2024-04-22T06:32:41.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.337+0000 7fa43207a640 1 -- 172.21.15.113:0/708055542 wait complete. 2024-04-22T06:32:41.347 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-22T06:32:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.446+0000 7f1032e8c640 1 Processor -- start 2024-04-22T06:32:41.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.446+0000 7f1032e8c640 1 -- start start 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1032e8c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c1554e0 0x7f102c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1032e8c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f102c0b3c00 0x7f102c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1032e8c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f102c0b5450 0x7f102c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1032e8c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f102c0b4a80 con 0x7f102c0b5450 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1032e8c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f102c1558c0 con 0x7f102c0b3c00 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1032e8c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f102c15f630 con 0x7f102c1554e0 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1031429640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f102c0b5450 0x7f102c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1031429640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f102c0b5450 0x7f102c0d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51206/0 (socket says 172.21.15.113:51206) 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1031429640 1 -- 172.21.15.113:0/3266610384 learned_addr learned my addr 172.21.15.113:0/3266610384 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f102bfff640 1 --2- 172.21.15.113:0/3266610384 >> v2:172.21.15.145:3300/0 conn(0x7f102c0b3c00 0x7f102c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1030c28640 1 --2- 172.21.15.113:0/3266610384 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c1554e0 0x7f102c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1031429640 1 -- 172.21.15.113:0/3266610384 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c1554e0 msgr2=0x7f102c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1031429640 1 --2- 172.21.15.113:0/3266610384 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c1554e0 0x7f102c15f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1031429640 1 -- 172.21.15.113:0/3266610384 >> v2:172.21.15.145:3300/0 conn(0x7f102c0b3c00 msgr2=0x7f102c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1031429640 1 --2- 172.21.15.113:0/3266610384 >> v2:172.21.15.145:3300/0 conn(0x7f102c0b3c00 0x7f102c0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.447+0000 7f1031429640 1 -- 172.21.15.113:0/3266610384 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c0cb8c0 con 0x7f102c0b5450 2024-04-22T06:32:41.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.448+0000 7f1031429640 1 --2- 172.21.15.113:0/3266610384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c0b5450 0x7f102c0d08a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f102c0ce4b0 tx=0x7f102402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfee86c1c9ebb044 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.448+0000 7f102b7fe640 1 -- 172.21.15.113:0/3266610384 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102402cb00 con 0x7f102c0b5450 2024-04-22T06:32:41.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.448+0000 7f102b7fe640 1 -- 172.21.15.113:0/3266610384 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102402cca0 con 0x7f102c0b5450 2024-04-22T06:32:41.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.448+0000 7f102b7fe640 1 -- 172.21.15.113:0/3266610384 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024034610 con 0x7f102c0b5450 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 -- 172.21.15.113:0/3266610384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c0b5450 msgr2=0x7f102c0d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 --2- 172.21.15.113:0/3266610384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c0b5450 0x7f102c0d08a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f102c0ce4b0 tx=0x7f102402bf60 comp rx=0 tx=0).stop 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 -- 172.21.15.113:0/3266610384 shutdown_connections 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 --2- 172.21.15.113:0/3266610384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c0b5450 0x7f102c0d08a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 --2- 172.21.15.113:0/3266610384 >> v2:172.21.15.145:3300/0 conn(0x7f102c0b3c00 0x7f102c0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 --2- 172.21.15.113:0/3266610384 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c1554e0 0x7f102c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 -- 172.21.15.113:0/3266610384 >> 172.21.15.113:0/3266610384 conn(0x7f102c074d50 msgr2=0x7f102c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 -- 172.21.15.113:0/3266610384 shutdown_connections 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.449+0000 7f1032e8c640 1 -- 172.21.15.113:0/3266610384 wait complete. 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.450+0000 7f1032e8c640 1 Processor -- start 2024-04-22T06:32:41.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.450+0000 7f1032e8c640 1 -- start start 2024-04-22T06:32:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1032e8c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c0b3c00 0x7f102c1e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1032e8c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f102c0b5450 0x7f102c1e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1032e8c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c1554e0 0x7f102c15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1032e8c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f102c0b4430 con 0x7f102c1554e0 2024-04-22T06:32:41.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1032e8c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f102c0b4150 con 0x7f102c0b5450 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1032e8c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f102c0b4710 con 0x7f102c0b3c00 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c1554e0 0x7f102c15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c1554e0 0x7f102c15e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51216/0 (socket says 172.21.15.113:51216) 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 -- 172.21.15.113:0/1332937403 learned_addr learned my addr 172.21.15.113:0/1332937403 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f102bfff640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f102c0b5450 0x7f102c1e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1030c28640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c0b3c00 0x7f102c1e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 -- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c0b3c00 msgr2=0x7f102c1e7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c0b3c00 0x7f102c1e7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 -- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f102c0b5450 msgr2=0x7f102c1e4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f102c0b5450 0x7f102c1e4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 -- 172.21.15.113:0/1332937403 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c1f44d0 con 0x7f102c1554e0 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f102bfff640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f102c0b5450 0x7f102c1e4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f1031429640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c1554e0 0x7f102c15e900 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1024009f40 tx=0x7f1024004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.451+0000 7f10297fa640 1 -- 172.21.15.113:0/1332937403 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024043020 con 0x7f102c1554e0 2024-04-22T06:32:41.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.452+0000 7f10297fa640 1 -- 172.21.15.113:0/1332937403 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102402ce50 con 0x7f102c1554e0 2024-04-22T06:32:41.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.452+0000 7f10297fa640 1 -- 172.21.15.113:0/1332937403 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024009510 con 0x7f102c1554e0 2024-04-22T06:32:41.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.452+0000 7f1032e8c640 1 -- 172.21.15.113:0/1332937403 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102c1f47b0 con 0x7f102c1554e0 2024-04-22T06:32:41.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.452+0000 7f1032e8c640 1 -- 172.21.15.113:0/1332937403 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f102c1f4d70 con 0x7f102c1554e0 2024-04-22T06:32:41.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.453+0000 7f10297fa640 1 -- 172.21.15.113:0/1332937403 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1024046020 con 0x7f102c1554e0 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.453+0000 7f10297fa640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f101006c920 0x7f101006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.453+0000 7f10297fa640 1 -- 172.21.15.113:0/1332937403 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f10240ae870 con 0x7f102c1554e0 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.454+0000 7f1030c28640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f101006c920 0x7f101006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.454+0000 7f1030c28640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f101006c920 0x7f101006ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1020006fd0 tx=0x7f1020008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.454+0000 7f1035722740 1 Processor -- start 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.454+0000 7f1035722740 1 -- start start 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1035722740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a28f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1035722740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 0x557a28a294a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1035722740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dcca0 0x557a28a04ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1035722740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x557a28943b10 con 0x557a28a1fe40 2024-04-22T06:32:41.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1035722740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557a288e1240 con 0x557a289dcca0 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1035722740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x557a2893fad0 con 0x557a289e0ec0 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1030c28640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a28f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1030c28640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a28f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51224/0 (socket says 172.21.15.113:51224) 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1030c28640 1 -- 172.21.15.113:0/1880779010 learned_addr learned my addr 172.21.15.113:0/1880779010 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1031429640 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dcca0 0x557a28a04ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1030c28640 1 -- 172.21.15.113:0/1880779010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 msgr2=0x557a28a294a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1030c28640 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 0x557a28a294a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1030c28640 1 -- 172.21.15.113:0/1880779010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dcca0 msgr2=0x557a28a04ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1030c28640 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dcca0 0x557a28a04ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1030c28640 1 -- 172.21.15.113:0/1880779010 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a286562d0 con 0x557a28a1fe40 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.455+0000 7f1031429640 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dcca0 0x557a28a04ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1030c28640 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a28f60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f102000fa50 tx=0x7f1020012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d612f41f1469da09 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f10167fc640 1 -- 172.21.15.113:0/1880779010 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102001b050 con 0x557a28a1fe40 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f10167fc640 1 -- 172.21.15.113:0/1880779010 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1020025070 con 0x557a28a1fe40 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f10167fc640 1 -- 172.21.15.113:0/1880779010 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020014de0 con 0x557a28a1fe40 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 -- 172.21.15.113:0/1880779010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 msgr2=0x557a28a28f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a28f60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f102000fa50 tx=0x7f1020012000 comp rx=0 tx=0).stop 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 -- 172.21.15.113:0/1880779010 shutdown_connections 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dcca0 0x557a28a04ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 0x557a28a294a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 --2- 172.21.15.113:0/1880779010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a28f60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 -- 172.21.15.113:0/1880779010 >> 172.21.15.113:0/1880779010 conn(0x557a289db990 msgr2=0x557a289de290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 -- 172.21.15.113:0/1880779010 shutdown_connections 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.456+0000 7f1035722740 1 -- 172.21.15.113:0/1880779010 wait complete. 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.457+0000 7f1035722740 1 -- start start 2024-04-22T06:32:41.459 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.457+0000 7f1035722740 1 Processor -- start 2024-04-22T06:32:41.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1035722740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 0x557a28a21580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1035722740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a28a1fe40 0x557a289d9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1035722740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a23b60 0x557a28a33d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1035722740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x557a289df250 con 0x557a28a23b60 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1035722740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557a288cc190 con 0x557a28a1fe40 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1035722740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x557a289df530 con 0x557a289e0ec0 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1035722740 10 client.0 _ll_register_callbacks cb 0x557a288c78b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a23b60 0x557a28a33d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a23b60 0x557a28a33d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51240/0 (socket says 172.21.15.113:51240) 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 -- 172.21.15.113:0/12533650 learned_addr learned my addr 172.21.15.113:0/12533650 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f102bfff640 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a28a1fe40 0x557a289d9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1030c28640 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 0x557a28a21580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 -- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 msgr2=0x557a28a21580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 0x557a28a21580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 -- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a28a1fe40 msgr2=0x557a289d9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a28a1fe40 0x557a289d9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 -- 172.21.15.113:0/12533650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a287206b0 con 0x557a28a23b60 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1030c28640 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 0x557a28a21580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f1031429640 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a23b60 0x557a28a33d10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f10240094a0 tx=0x7f102407c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472e8324608ea404 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.458+0000 7f100b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f100b7fe640 1 -- 172.21.15.113:0/12533650 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024084d80 con 0x557a28a23b60 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f100b7fe640 1 -- 172.21.15.113:0/12533650 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f10240333a0 con 0x557a28a23b60 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 1 -- 172.21.15.113:0/12533650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1020025070 con 0x557a28a23b60 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f100b7fe640 1 -- 172.21.15.113:0/12533650 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1024080120 con 0x557a28a23b60 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 10 client.5202 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 1 -- 172.21.15.113:0/12533650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x557a28a23360 con 0x557a28a23b60 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f100b7fe640 1 -- 172.21.15.113:0/12533650 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1020025070 con 0x557a28a23b60 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f100b7fe640 1 -- 172.21.15.113:0/12533650 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f10240848f0 con 0x557a28a23b60 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 10 client.5202 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 10 client.5202 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-22T06:32:41.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 20 client.5202 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x557a28a24650 0x557a28a3f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 4 client.5202 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1035722740 1 -- 172.21.15.113:0/12533650 --> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a28951530 con 0x557a28a24650 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.459+0000 7f1030c28640 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x557a28a24650 0x557a28a3f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.460+0000 7f1030c28640 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x557a28a24650 0x557a28a3f560 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=199689ccee081828 server_cookie=281a0c436bcec272 in_seq=0 out_seq=0 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.460+0000 7f100b7fe640 10 client.5202 ms_handle_connect on v2:172.21.15.145:6832/9331508 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.460+0000 7f100b7fe640 1 -- 172.21.15.113:0/12533650 <== mds.3 v2:172.21.15.145:6832/9331508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557a28951530 con 0x557a28a24650 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.460+0000 7f100b7fe640 10 client.5202 handle_command_reply: tid=0 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.460+0000 7f1035722740 1 client.5202 shutdown 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 -- 172.21.15.113:0/12533650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a23b60 msgr2=0x557a28a33d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a23b60 0x557a28a33d10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f10240094a0 tx=0x7f102407c9e0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 -- 172.21.15.113:0/12533650 shutdown_connections 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x557a28a24650 0x557a28a3f560 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a23b60 0x557a28a33d10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a28a1fe40 0x557a289d9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f100b7fe640 0 client.5202 ms_handle_reset on v2:172.21.15.145:6832/9331508 2024-04-22T06:32:41.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 --2- 172.21.15.113:0/12533650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289e0ec0 0x557a28a21580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 -- 172.21.15.113:0/12533650 >> 172.21.15.113:0/12533650 conn(0x557a289dcca0 msgr2=0x557a28a20220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 -- 172.21.15.113:0/12533650 shutdown_connections 2024-04-22T06:32:41.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 1 -- 172.21.15.113:0/12533650 wait complete. 2024-04-22T06:32:41.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.461+0000 7f1035722740 20 client.5202 trim_cache size 0 max 16384 2024-04-22T06:32:41.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.480+0000 7f1035722740 1 Processor -- start 2024-04-22T06:32:41.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.480+0000 7f1035722740 1 -- start start 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1035722740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a289e0ec0 0x557a28a20410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1035722740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a28a1fe40 0x557a28a20950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1035722740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dee70 0x557a28a26910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1035722740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f102c1e5d80 con 0x557a289e0ec0 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1035722740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557a289df250 con 0x557a289dee70 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1035722740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x557a28a22c20 con 0x557a28a1fe40 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a289e0ec0 0x557a28a20410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a289e0ec0 0x557a28a20410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51252/0 (socket says 172.21.15.113:51252) 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 -- 172.21.15.113:0/1816947013 learned_addr learned my addr 172.21.15.113:0/1816947013 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 -- 172.21.15.113:0/1816947013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a28a1fe40 msgr2=0x557a28a20950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 --2- 172.21.15.113:0/1816947013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a28a1fe40 0x557a28a20950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 -- 172.21.15.113:0/1816947013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dee70 msgr2=0x557a28a26910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 --2- 172.21.15.113:0/1816947013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dee70 0x557a28a26910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 -- 172.21.15.113:0/1816947013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a28a21a10 con 0x557a289e0ec0 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1030c28640 1 --2- 172.21.15.113:0/1816947013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a289e0ec0 0x557a28a20410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f102000f5b0 tx=0x7f102001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d676148c6ac950b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1015ffb640 1 -- 172.21.15.113:0/1816947013 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102001b070 con 0x557a289e0ec0 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1015ffb640 1 -- 172.21.15.113:0/1816947013 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102003b070 con 0x557a289e0ec0 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.481+0000 7f1015ffb640 1 -- 172.21.15.113:0/1816947013 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200365d0 con 0x557a289e0ec0 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 -- 172.21.15.113:0/1816947013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a289e0ec0 msgr2=0x557a28a20410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 --2- 172.21.15.113:0/1816947013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a289e0ec0 0x557a28a20410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f102000f5b0 tx=0x7f102001e000 comp rx=0 tx=0).stop 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 -- 172.21.15.113:0/1816947013 shutdown_connections 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 --2- 172.21.15.113:0/1816947013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289dee70 0x557a28a26910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 --2- 172.21.15.113:0/1816947013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a28a1fe40 0x557a28a20950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 --2- 172.21.15.113:0/1816947013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a289e0ec0 0x557a28a20410 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 -- 172.21.15.113:0/1816947013 >> 172.21.15.113:0/1816947013 conn(0x557a289dcca0 msgr2=0x557a28a33a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 -- 172.21.15.113:0/1816947013 shutdown_connections 2024-04-22T06:32:41.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.482+0000 7f1035722740 1 -- 172.21.15.113:0/1816947013 wait complete. 2024-04-22T06:32:41.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 1 -- start start 2024-04-22T06:32:41.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 1 Processor -- start 2024-04-22T06:32:41.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289dee70 0x557a28a9b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289e0ec0 0x557a28a18970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a950c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x557a28a348e0 con 0x557a28a1fe40 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557a28a244d0 con 0x557a289e0ec0 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x557a28a19420 con 0x557a289dee70 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.483+0000 7f1035722740 10 client.0 _ll_register_callbacks cb 0x7f102407bf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51266/0 (socket says 172.21.15.113:51266) 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 -- 172.21.15.113:0/1793338674 learned_addr learned my addr 172.21.15.113:0/1793338674 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f102bfff640 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289e0ec0 0x557a28a18970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1030c28640 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289dee70 0x557a28a9b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 -- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289dee70 msgr2=0x557a28a9b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289dee70 0x557a28a9b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 -- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289e0ec0 msgr2=0x557a28a18970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289e0ec0 0x557a28a18970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 -- 172.21.15.113:0/1793338674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a28a27b30 con 0x557a28a1fe40 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1031429640 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a950c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1024078b20 tx=0x7f1024009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48131494990d40f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f100b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f100b7fe640 1 -- 172.21.15.113:0/1793338674 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024084d80 con 0x557a28a1fe40 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f100b7fe640 1 -- 172.21.15.113:0/1793338674 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f10240333a0 con 0x557a28a1fe40 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1035722740 1 -- 172.21.15.113:0/1793338674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f102003b070 con 0x557a28a1fe40 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f100b7fe640 1 -- 172.21.15.113:0/1793338674 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1024078440 con 0x557a28a1fe40 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1035722740 10 client.5208 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f1035722740 1 -- 172.21.15.113:0/1793338674 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x557a28a9f5d0 con 0x557a28a1fe40 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.484+0000 7f100b7fe640 1 -- 172.21.15.113:0/1793338674 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102003b070 con 0x557a28a1fe40 2024-04-22T06:32:41.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f100b7fe640 1 -- 172.21.15.113:0/1793338674 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f1024090bb0 con 0x557a28a1fe40 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1035722740 10 client.5208 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1035722740 10 client.5208 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1035722740 20 client.5208 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1035722740 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x557a28a03f70 0x557a28aa7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1035722740 4 client.5208 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1035722740 1 -- 172.21.15.113:0/1793338674 --> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] -- command(tid 0: {"prefix": "status"}) -- 0x557a2894b3a0 con 0x557a28a03f70 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1030c28640 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x557a28a03f70 0x557a28aa7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1030c28640 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x557a28a03f70 0x557a28aa7a90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=785ceb2ed736cc4b server_cookie=5c791c41347914e3 in_seq=0 out_seq=0 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f100b7fe640 10 client.5208 ms_handle_connect on v2:172.21.15.145:6832/9331508 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f100b7fe640 1 -- 172.21.15.113:0/1793338674 <== mds.3 v2:172.21.15.145:6832/9331508 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x557a2894b3a0 con 0x557a28a03f70 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f100b7fe640 10 client.5208 handle_command_reply: tid=0 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.485+0000 7f1035722740 1 client.5208 shutdown 2024-04-22T06:32:41.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 -- 172.21.15.113:0/1793338674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 msgr2=0x557a28a950c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a950c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1024078b20 tx=0x7f1024009810 comp rx=0 tx=0).stop 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 -- 172.21.15.113:0/1793338674 shutdown_connections 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:6832/9331508,v1:172.21.15.145:6834/9331508] conn(0x557a28a03f70 0x557a28aa7a90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x557a28a1fe40 0x557a28a950c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557a289e0ec0 0x557a28a18970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 --2- 172.21.15.113:0/1793338674 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x557a289dee70 0x557a28a9b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f100b7fe640 0 client.5208 ms_handle_reset on v2:172.21.15.145:6832/9331508 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 -- 172.21.15.113:0/1793338674 >> 172.21.15.113:0/1793338674 conn(0x557a289dcca0 msgr2=0x557a28a20410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 -- 172.21.15.113:0/1793338674 shutdown_connections 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 1 -- 172.21.15.113:0/1793338674 wait complete. 2024-04-22T06:32:41.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1035722740 20 client.5208 trim_cache size 0 max 16384 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 3, 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4264, 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 27.537589938, 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:41.492 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 70.864452102000001 2024-04-22T06:32:41.493 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:41.493 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 -- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f101006c920 msgr2=0x7f101006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.493 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f101006c920 0x7f101006ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1020006fd0 tx=0x7f1020008040 comp rx=0 tx=0).stop 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 -- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c1554e0 msgr2=0x7f102c15e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c1554e0 0x7f102c15e900 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1024009f40 tx=0x7f1024004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 -- 172.21.15.113:0/1332937403 shutdown_connections 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f101006c920 0x7f101006ede0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f102c1554e0 0x7f102c15e900 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f102c0b5450 0x7f102c1e4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 --2- 172.21.15.113:0/1332937403 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f102c0b3c00 0x7f102c1e7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 -- 172.21.15.113:0/1332937403 >> 172.21.15.113:0/1332937403 conn(0x7f102c074d50 msgr2=0x7f102c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 -- 172.21.15.113:0/1332937403 shutdown_connections 2024-04-22T06:32:41.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.486+0000 7f1032e8c640 1 -- 172.21.15.113:0/1332937403 wait complete. 2024-04-22T06:32:41.497 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-22T06:32:41.598 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.599+0000 7f62ebaa8640 1 Processor -- start 2024-04-22T06:32:41.599 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.599+0000 7f62ebaa8640 1 -- start start 2024-04-22T06:32:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62ebaa8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f62e40d08a0 0x7f62e40d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62ebaa8640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e41558c0 con 0x7f62e40b3c00 2024-04-22T06:32:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62ebaa8640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e40cb8c0 con 0x7f62e41554e0 2024-04-22T06:32:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62ebaa8640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f62e40b4a80 con 0x7f62e40d08a0 2024-04-22T06:32:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62e9043640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f62e40b3c00 0x7f62e40b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:38392/0 (socket says 172.21.15.113:38392) 2024-04-22T06:32:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62e9043640 1 -- 172.21.15.113:0/2471203458 learned_addr learned my addr 172.21.15.113:0/2471203458 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:41.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62ea045640 1 --2- 172.21.15.113:0/2471203458 >> v2:172.21.15.145:3300/0 conn(0x7f62e40d08a0 0x7f62e40d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917723154 0 0) 0x7f62d4001110 con 0x7f62e40b3c00 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.600+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62d0003520 con 0x7f62e40b3c00 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1983826232 0 0) 0x7f62d0003520 con 0x7f62e40b3c00 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 >> v2:172.21.15.145:3300/0 conn(0x7f62e40d08a0 msgr2=0x7f62e40d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 --2- 172.21.15.113:0/2471203458 >> v2:172.21.15.145:3300/0 conn(0x7f62e40d08a0 0x7f62e40d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 >> v1:172.21.15.145:6789/0 conn(0x7f62e41554e0 legacy=0x7f62e415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e40cbba0 con 0x7f62e40b3c00 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f62d4001840 con 0x7f62e40b3c00 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 >> v1:172.21.15.113:6789/0 conn(0x7f62e40b3c00 legacy=0x7f62e40b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62d00039b0 0x7f62d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62d0004800 0x7f62d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d00051c0 0x7f62d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40b4a80 con 0x7f62d0004800 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f62d000c070 con 0x7f62d00039b0 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f62d000c270 con 0x7f62d00051c0 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e9043640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62d0004800 0x7f62d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e9844640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62d00039b0 0x7f62d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62ea045640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d00051c0 0x7f62d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e9043640 1 -- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d00051c0 msgr2=0x7f62d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e9043640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d00051c0 0x7f62d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e9043640 1 -- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62d00039b0 msgr2=0x7f62d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e9043640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62d00039b0 0x7f62d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62e9043640 1 -- 172.21.15.113:0/2471203458 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d0003520 con 0x7f62d0004800 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62ea045640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d00051c0 0x7f62d000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.601+0000 7f62ea045640 1 -- 172.21.15.113:0/2471203458 reap_dead start 2024-04-22T06:32:41.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.602+0000 7f62e9043640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62d0004800 0x7f62d0004c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c4c0 tx=0x7f62d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103310fa50736a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.602+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d400c0e0 con 0x7f62d0004800 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.602+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4030070 con 0x7f62d0004800 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.602+0000 7f62e8842640 1 -- 172.21.15.113:0/2471203458 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d40058d0 con 0x7f62d0004800 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.603+0000 7f62ebaa8640 1 -- 172.21.15.113:0/2471203458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62d0004800 msgr2=0x7f62d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.603+0000 7f62ebaa8640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62d0004800 0x7f62d0004c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c4c0 tx=0x7f62d0005830 comp rx=0 tx=0).stop 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.603+0000 7f62ebaa8640 1 -- 172.21.15.113:0/2471203458 shutdown_connections 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.603+0000 7f62ebaa8640 1 --2- 172.21.15.113:0/2471203458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62d0004800 0x7f62d0004c80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.603+0000 7f62ebaa8640 1 -- 172.21.15.113:0/2471203458 >> 172.21.15.113:0/2471203458 conn(0x7f62e4074d50 msgr2=0x7f62e4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.603+0000 7f62ebaa8640 1 -- 172.21.15.113:0/2471203458 shutdown_connections 2024-04-22T06:32:41.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.603+0000 7f62ebaa8640 1 -- 172.21.15.113:0/2471203458 wait complete. 2024-04-22T06:32:41.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.604+0000 7f62ebaa8640 1 Processor -- start 2024-04-22T06:32:41.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.604+0000 7f62ebaa8640 1 -- start start 2024-04-22T06:32:41.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.604+0000 7f62ebaa8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d0004800 0x7f62e41f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.604+0000 7f62ebaa8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62e40ca6a0 0x7f62e40cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.604+0000 7f62ebaa8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62e40cfe00 0x7f62e40c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.604+0000 7f62ebaa8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40b4710 con 0x7f62e40ca6a0 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.604+0000 7f62ebaa8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f62e40b4430 con 0x7f62e40cfe00 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.604+0000 7f62ebaa8640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f62e40b3580 con 0x7f62d0004800 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62e40ca6a0 0x7f62e40cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62e40ca6a0 0x7f62e40cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51276/0 (socket says 172.21.15.113:51276) 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 -- 172.21.15.113:0/3310603609 learned_addr learned my addr 172.21.15.113:0/3310603609 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62ea045640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62e40cfe00 0x7f62e40c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9844640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d0004800 0x7f62e41f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 -- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d0004800 msgr2=0x7f62e41f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d0004800 0x7f62e41f1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 -- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62e40cfe00 msgr2=0x7f62e40c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62e40cfe00 0x7f62e40c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 -- 172.21.15.113:0/3310603609 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e40c8080 con 0x7f62e40ca6a0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62ea045640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62e40cfe00 0x7f62e40c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62e9043640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62e40ca6a0 0x7f62e40cf8c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c5e0 tx=0x7f62d402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62da7fc640 1 -- 172.21.15.113:0/3310603609 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4004bf0 con 0x7f62e40ca6a0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62da7fc640 1 -- 172.21.15.113:0/3310603609 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4004d90 con 0x7f62e40ca6a0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62da7fc640 1 -- 172.21.15.113:0/3310603609 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4007270 con 0x7f62e40ca6a0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62ebaa8640 1 -- 172.21.15.113:0/3310603609 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e40c8360 con 0x7f62e40ca6a0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.605+0000 7f62ebaa8640 1 -- 172.21.15.113:0/3310603609 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e40c8920 con 0x7f62e40ca6a0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.607+0000 7f62da7fc640 1 -- 172.21.15.113:0/3310603609 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62d4007410 con 0x7f62e40ca6a0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.607+0000 7f62da7fc640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f62c806c8f0 0x7f62c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.607+0000 7f62e9844640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f62c806c8f0 0x7f62c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.607+0000 7f62da7fc640 1 -- 172.21.15.113:0/3310603609 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f62d40ad730 con 0x7f62e40ca6a0 2024-04-22T06:32:41.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.608+0000 7f62e9844640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f62c806c8f0 0x7f62c806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f62e0000c00 tx=0x7f62e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.608+0000 7f62ee779740 1 Processor -- start 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.608+0000 7f62ee779740 1 -- start start 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ee779740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a2af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ee779740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209e2ec0 0x560f20a2b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ee779740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209deca0 0x560f20a06ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ee779740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x560f20945b10 con 0x560f209deca0 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ee779740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x560f208e3240 con 0x560f209e2ec0 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ee779740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x560f20941ad0 con 0x560f20a21e40 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209deca0 0x560f20a06ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209deca0 0x560f20a06ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51280/0 (socket says 172.21.15.113:51280) 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 -- 172.21.15.113:0/3607308640 learned_addr learned my addr 172.21.15.113:0/3607308640 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62e9844640 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a2af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62e9043640 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209e2ec0 0x560f20a2b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 -- 172.21.15.113:0/3607308640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 msgr2=0x560f20a2af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a2af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 -- 172.21.15.113:0/3607308640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209e2ec0 msgr2=0x560f20a2b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209e2ec0 0x560f20a2b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 -- 172.21.15.113:0/3607308640 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f206582d0 con 0x560f209deca0 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.609+0000 7f62ea045640 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209deca0 0x560f20a06ee0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f62e40b3b80 tx=0x7f62dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602a3b1ae875500b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62c77fe640 1 -- 172.21.15.113:0/3607308640 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc015820 con 0x560f209deca0 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62c77fe640 1 -- 172.21.15.113:0/3607308640 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc01c070 con 0x560f209deca0 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62c77fe640 1 -- 172.21.15.113:0/3607308640 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc015bc0 con 0x560f209deca0 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 -- 172.21.15.113:0/3607308640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209deca0 msgr2=0x560f20a06ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209deca0 0x560f20a06ee0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f62e40b3b80 tx=0x7f62dc009750 comp rx=0 tx=0).stop 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 -- 172.21.15.113:0/3607308640 shutdown_connections 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209deca0 0x560f20a06ee0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209e2ec0 0x560f20a2b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 --2- 172.21.15.113:0/3607308640 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a2af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 -- 172.21.15.113:0/3607308640 >> 172.21.15.113:0/3607308640 conn(0x560f209dd990 msgr2=0x560f209e0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 -- 172.21.15.113:0/3607308640 shutdown_connections 2024-04-22T06:32:41.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.610+0000 7f62ee779740 1 -- 172.21.15.113:0/3607308640 wait complete. 2024-04-22T06:32:41.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.611+0000 7f62ee779740 1 -- start start 2024-04-22T06:32:41.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.611+0000 7f62ee779740 1 Processor -- start 2024-04-22T06:32:41.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ee779740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f209e2ec0 0x560f20a28f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ee779740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f20a21e40 0x560f209f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ee779740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209db7a0 0x560f20a00300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ee779740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x560f209e1250 con 0x560f209db7a0 2024-04-22T06:32:41.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ee779740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x560f208ce190 con 0x560f20a21e40 2024-04-22T06:32:41.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ee779740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x560f209e1530 con 0x560f209e2ec0 2024-04-22T06:32:41.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ee779740 10 client.0 _ll_register_callbacks cb 0x560f208c98b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209db7a0 0x560f20a00300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209db7a0 0x560f20a00300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51286/0 (socket says 172.21.15.113:51286) 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 -- 172.21.15.113:0/2398445587 learned_addr learned my addr 172.21.15.113:0/2398445587 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62e9043640 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f20a21e40 0x560f209f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62e9844640 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f209e2ec0 0x560f20a28f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 -- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f209e2ec0 msgr2=0x560f20a28f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f209e2ec0 0x560f20a28f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 -- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f20a21e40 msgr2=0x560f209f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f20a21e40 0x560f209f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 -- 172.21.15.113:0/2398445587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f207226b0 con 0x560f209db7a0 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62e9844640 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f209e2ec0 0x560f20a28f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ea045640 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209db7a0 0x560f20a00300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f62e40ce410 tx=0x7f62dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6341e86f6b343d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62c4ff9640 1 -- 172.21.15.113:0/2398445587 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc003b90 con 0x560f209db7a0 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62c4ff9640 1 -- 172.21.15.113:0/2398445587 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f62dc003d30 con 0x560f209db7a0 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.612+0000 7f62ee779740 1 -- 172.21.15.113:0/2398445587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62dc01c070 con 0x560f209db7a0 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62c4ff9640 1 -- 172.21.15.113:0/2398445587 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f62dc032050 con 0x560f209db7a0 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62ee779740 10 client.5220 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62ee779740 1 -- 172.21.15.113:0/2398445587 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560f209da550 con 0x560f209db7a0 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62c4ff9640 1 -- 172.21.15.113:0/2398445587 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc01c070 con 0x560f209db7a0 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62c4ff9640 1 -- 172.21.15.113:0/2398445587 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f62dc035020 con 0x560f209db7a0 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62ee779740 10 client.5220 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62ee779740 10 client.5220 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62ee779740 20 client.5220 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62ee779740 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x560f20a00e90 0x560f20a417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62ee779740 4 client.5220 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:41.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62ee779740 1 -- 172.21.15.113:0/2398445587 --> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f20953530 con 0x560f20a00e90 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62e9844640 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x560f20a00e90 0x560f20a417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62c4ff9640 10 client.5220 ms_handle_connect on v2:172.21.15.113:6834/999776030 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.613+0000 7f62e9844640 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x560f20a00e90 0x560f20a417b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7b95a342cbce4161 server_cookie=ee529172244f278c in_seq=0 out_seq=0 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62c4ff9640 1 -- 172.21.15.113:0/2398445587 <== mds.2 v2:172.21.15.113:6834/999776030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560f20953530 con 0x560f20a00e90 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62c4ff9640 10 client.5220 handle_command_reply: tid=0 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 client.5220 shutdown 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 -- 172.21.15.113:0/2398445587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209db7a0 msgr2=0x560f20a00300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209db7a0 0x560f20a00300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f62e40ce410 tx=0x7f62dc004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 -- 172.21.15.113:0/2398445587 shutdown_connections 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x560f20a00e90 0x560f20a417b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209db7a0 0x560f20a00300 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f20a21e40 0x560f209f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62c4ff9640 0 client.5220 ms_handle_reset on v2:172.21.15.113:6834/999776030 2024-04-22T06:32:41.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 --2- 172.21.15.113:0/2398445587 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f209e2ec0 0x560f20a28f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 -- 172.21.15.113:0/2398445587 >> 172.21.15.113:0/2398445587 conn(0x560f209deca0 msgr2=0x560f20a2aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 -- 172.21.15.113:0/2398445587 shutdown_connections 2024-04-22T06:32:41.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 1 -- 172.21.15.113:0/2398445587 wait complete. 2024-04-22T06:32:41.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.614+0000 7f62ee779740 20 client.5220 trim_cache size 0 max 16384 2024-04-22T06:32:41.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.635+0000 7f62ee779740 1 Processor -- start 2024-04-22T06:32:41.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.635+0000 7f62ee779740 1 -- start start 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62ee779740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 0x560f209e1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62ee779740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a28cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62ee779740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a29210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62ee779740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41fd8d0 con 0x560f209e2ec0 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62ee779740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x560f209f9640 con 0x560f209db7a0 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62ee779740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x560f20a2a790 con 0x560f20a21e40 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a28cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a28cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51296/0 (socket says 172.21.15.113:51296) 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 -- 172.21.15.113:0/45483611 learned_addr learned my addr 172.21.15.113:0/45483611 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9844640 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 0x560f209e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62ea045640 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a29210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 -- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 msgr2=0x560f20a29210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a29210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 -- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 msgr2=0x560f209e1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 0x560f209e1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 -- 172.21.15.113:0/45483611 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f20a01a60 con 0x560f209e2ec0 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62ea045640 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a29210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62e9043640 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a28cd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f62d402c960 tx=0x7f62d40ad040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96356480bde1418 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62c6ffd640 1 -- 172.21.15.113:0/45483611 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d407f380 con 0x560f209e2ec0 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62c6ffd640 1 -- 172.21.15.113:0/45483611 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4030040 con 0x560f209e2ec0 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.636+0000 7f62c6ffd640 1 -- 172.21.15.113:0/45483611 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4083c40 con 0x560f209e2ec0 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 -- 172.21.15.113:0/45483611 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 msgr2=0x560f20a28cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a28cd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f62d402c960 tx=0x7f62d40ad040 comp rx=0 tx=0).stop 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 -- 172.21.15.113:0/45483611 shutdown_connections 2024-04-22T06:32:41.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a29210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a28cd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 --2- 172.21.15.113:0/45483611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 0x560f209e1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 -- 172.21.15.113:0/45483611 >> 172.21.15.113:0/45483611 conn(0x560f209deca0 msgr2=0x560f20a2aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 -- 172.21.15.113:0/45483611 shutdown_connections 2024-04-22T06:32:41.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 -- 172.21.15.113:0/45483611 wait complete. 2024-04-22T06:32:41.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.637+0000 7f62ee779740 1 -- start start 2024-04-22T06:32:41.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62ee779740 1 Processor -- start 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62ee779740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 0x560f20a17de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62ee779740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a90b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62ee779740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a91060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62ee779740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x560f20a1b150 con 0x560f209e2ec0 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62ee779740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x560f20a00d10 con 0x560f209db7a0 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62ee779740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x560f20a1b800 con 0x560f20a21e40 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62ee779740 10 client.0 _ll_register_callbacks cb 0x7f62dc009f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62e9043640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a90b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62e9043640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a90b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51304/0 (socket says 172.21.15.113:51304) 2024-04-22T06:32:41.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.638+0000 7f62e9043640 1 -- 172.21.15.113:0/1597299751 learned_addr learned my addr 172.21.15.113:0/1597299751 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62e9844640 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 0x560f20a17de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ea045640 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a91060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62e9043640 1 -- 172.21.15.113:0/1597299751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 msgr2=0x560f20a91060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62e9043640 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a91060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62e9043640 1 -- 172.21.15.113:0/1597299751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 msgr2=0x560f20a17de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62e9043640 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 0x560f20a17de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62e9043640 1 -- 172.21.15.113:0/1597299751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f209f7fd0 con 0x560f209e2ec0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62e9043640 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a90b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62d407af60 tx=0x7f62d4007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d66134c5b7a44d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62c4ff9640 1 -- 172.21.15.113:0/1597299751 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4097070 con 0x560f209e2ec0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62c4ff9640 1 -- 172.21.15.113:0/1597299751 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f62d4007700 con 0x560f209e2ec0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 1 -- 172.21.15.113:0/1597299751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62d4030040 con 0x560f209e2ec0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62c4ff9640 1 -- 172.21.15.113:0/1597299751 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f62d40792d0 con 0x560f209e2ec0 2024-04-22T06:32:41.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 10 client.5226 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 1 -- 172.21.15.113:0/1597299751 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560f209f7fd0 con 0x560f209e2ec0 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62c4ff9640 1 -- 172.21.15.113:0/1597299751 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4030040 con 0x560f209e2ec0 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62c4ff9640 1 -- 172.21.15.113:0/1597299751 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f62d407a420 con 0x560f209e2ec0 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 10 client.5226 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 10 client.5226 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 20 client.5226 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x560f209ffb60 0x560f209fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 4 client.5226 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.639+0000 7f62ee779740 1 -- 172.21.15.113:0/1597299751 --> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] -- command(tid 0: {"prefix": "status"}) -- 0x560f2094d3a0 con 0x560f209ffb60 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62e9844640 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x560f209ffb60 0x560f209fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62c4ff9640 10 client.5226 ms_handle_connect on v2:172.21.15.113:6834/999776030 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62e9844640 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x560f209ffb60 0x560f209fff40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af9a292b25a3a8be server_cookie=3e3a0143ab6aecc9 in_seq=0 out_seq=0 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62c4ff9640 1 -- 172.21.15.113:0/1597299751 <== mds.2 v2:172.21.15.113:6834/999776030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560f2094d3a0 con 0x560f209ffb60 2024-04-22T06:32:41.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62c4ff9640 10 client.5226 handle_command_reply: tid=0 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 client.5226 shutdown 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 -- 172.21.15.113:0/1597299751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 msgr2=0x560f20a90b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a90b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62d407af60 tx=0x7f62d4007aa0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 -- 172.21.15.113:0/1597299751 shutdown_connections 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x560f20a21e40 0x560f20a91060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.113:6834/999776030,v1:172.21.15.113:6835/999776030] conn(0x560f209ffb60 0x560f209fff40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x560f209e2ec0 0x560f20a90b20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 --2- 172.21.15.113:0/1597299751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560f209db7a0 0x560f20a17de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62c4ff9640 0 client.5226 ms_handle_reset on v2:172.21.15.113:6834/999776030 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 -- 172.21.15.113:0/1597299751 >> 172.21.15.113:0/1597299751 conn(0x560f209deca0 msgr2=0x560f209e1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 -- 172.21.15.113:0/1597299751 shutdown_connections 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 1 -- 172.21.15.113:0/1597299751 wait complete. 2024-04-22T06:32:41.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.640+0000 7f62ee779740 20 client.5226 trim_cache size 0 max 16384 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 2, 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4305, 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 33.711344926000002, 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:41.647 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:41.648 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:41.648 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 71.036284619 2024-04-22T06:32:41.648 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 -- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f62c806c8f0 msgr2=0x7f62c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f62c806c8f0 0x7f62c806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f62e0000c00 tx=0x7f62e0009040 comp rx=0 tx=0).stop 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 -- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62e40ca6a0 msgr2=0x7f62e40cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62e40ca6a0 0x7f62e40cf8c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c5e0 tx=0x7f62d402e070 comp rx=0 tx=0).stop 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 -- 172.21.15.113:0/3310603609 shutdown_connections 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f62e40cfe00 0x7f62e40c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f62c806c8f0 0x7f62c806edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62e40ca6a0 0x7f62e40cf8c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 --2- 172.21.15.113:0/3310603609 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f62d0004800 0x7f62e41f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 -- 172.21.15.113:0/3310603609 >> 172.21.15.113:0/3310603609 conn(0x7f62e4074d50 msgr2=0x7f62e4150e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 -- 172.21.15.113:0/3310603609 shutdown_connections 2024-04-22T06:32:41.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.641+0000 7f62ebaa8640 1 -- 172.21.15.113:0/3310603609 wait complete. 2024-04-22T06:32:41.651 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-22T06:32:41.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.751+0000 7f918c8d2640 1 Processor -- start 2024-04-22T06:32:41.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.752+0000 7f918c8d2640 1 -- start start 2024-04-22T06:32:41.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.752+0000 7f918c8d2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91881554e0 0x7f918815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.752+0000 7f918c8d2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f91880d08a0 0x7f91880d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.752+0000 7f918c8d2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91881558c0 con 0x7f91880b3c00 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.752+0000 7f918c8d2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f91880b4a80 con 0x7f91880d08a0 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.752+0000 7f918c8d2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f918815f630 con 0x7f91881554e0 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f918659c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91881554e0 0x7f918815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f9186d9d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f91880d08a0 0x7f91880d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f917ffff640 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f91880b3c00 0x7f91880b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:41476/0 (socket says 172.21.15.113:41476) 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f917ffff640 1 -- 172.21.15.113:0/3049339764 learned_addr learned my addr 172.21.15.113:0/3049339764 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f9186d9d640 1 -- 172.21.15.113:0/3049339764 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91881554e0 msgr2=0x7f918815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f9186d9d640 1 --2- 172.21.15.113:0/3049339764 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91881554e0 0x7f918815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f9186d9d640 1 -- 172.21.15.113:0/3049339764 >> v1:172.21.15.145:6789/0 conn(0x7f91880b3c00 legacy=0x7f91880b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f9185d9b640 1 -- 172.21.15.113:0/3049339764 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983586515 0 0) 0x7f9170001110 con 0x7f91880b3c00 2024-04-22T06:32:41.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.753+0000 7f9186d9d640 1 -- 172.21.15.113:0/3049339764 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91880cb8c0 con 0x7f91880d08a0 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.754+0000 7f9186d9d640 1 --2- 172.21.15.113:0/3049339764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880d08a0 0x7f91880d0cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9180009d90 tx=0x7f918002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8688441a1e3f530e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.754+0000 7f9185d9b640 1 -- 172.21.15.113:0/3049339764 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180039070 con 0x7f91880d08a0 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.754+0000 7f9185d9b640 1 -- 172.21.15.113:0/3049339764 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918002cce0 con 0x7f91880d08a0 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.754+0000 7f9185d9b640 1 -- 172.21.15.113:0/3049339764 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180034660 con 0x7f91880d08a0 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.755+0000 7f918c8d2640 1 -- 172.21.15.113:0/3049339764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880d08a0 msgr2=0x7f91880d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.755+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3049339764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880d08a0 0x7f91880d0cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9180009d90 tx=0x7f918002bf30 comp rx=0 tx=0).stop 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.755+0000 7f918c8d2640 1 -- 172.21.15.113:0/3049339764 shutdown_connections 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.755+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3049339764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880d08a0 0x7f91880d0cf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.755+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3049339764 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91881554e0 0x7f918815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.755+0000 7f918c8d2640 1 -- 172.21.15.113:0/3049339764 >> 172.21.15.113:0/3049339764 conn(0x7f9188074d50 msgr2=0x7f9188075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.755+0000 7f918c8d2640 1 -- 172.21.15.113:0/3049339764 shutdown_connections 2024-04-22T06:32:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.755+0000 7f918c8d2640 1 -- 172.21.15.113:0/3049339764 wait complete. 2024-04-22T06:32:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.756+0000 7f918c8d2640 1 Processor -- start 2024-04-22T06:32:41.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.756+0000 7f918c8d2640 1 -- start start 2024-04-22T06:32:41.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918c8d2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880b3c00 0x7f918815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918c8d2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91880d08a0 0x7f918814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918c8d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91881554e0 0x7f91881e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918c8d2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f91880b4430 con 0x7f91881554e0 2024-04-22T06:32:41.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918c8d2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f91880b4150 con 0x7f91880b3c00 2024-04-22T06:32:41.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918c8d2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f91880b4710 con 0x7f91880d08a0 2024-04-22T06:32:41.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91881554e0 0x7f91881e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91881554e0 0x7f91881e52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51314/0 (socket says 172.21.15.113:51314) 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 -- 172.21.15.113:0/3275485414 learned_addr learned my addr 172.21.15.113:0/3275485414 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918659c640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880b3c00 0x7f918815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f917ffff640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91880d08a0 0x7f918814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 -- 172.21.15.113:0/3275485414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91880d08a0 msgr2=0x7f918814bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91880d08a0 0x7f918814bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 -- 172.21.15.113:0/3275485414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880b3c00 msgr2=0x7f918815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880b3c00 0x7f918815ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 -- 172.21.15.113:0/3275485414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91881e6700 con 0x7f91881554e0 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f9186d9d640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91881554e0 0x7f91881e52b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9180037040 tx=0x7f9180004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f917effd640 1 -- 172.21.15.113:0/3275485414 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180044020 con 0x7f91881554e0 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f917effd640 1 -- 172.21.15.113:0/3275485414 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918003a040 con 0x7f91881554e0 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918c8d2640 1 -- 172.21.15.113:0/3275485414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91880ca200 con 0x7f91881554e0 2024-04-22T06:32:41.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f917effd640 1 -- 172.21.15.113:0/3275485414 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180039050 con 0x7f91881554e0 2024-04-22T06:32:41.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.757+0000 7f918c8d2640 1 -- 172.21.15.113:0/3275485414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91881e69a0 con 0x7f91881554e0 2024-04-22T06:32:41.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.759+0000 7f917effd640 1 -- 172.21.15.113:0/3275485414 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9180003bb0 con 0x7f91881554e0 2024-04-22T06:32:41.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.759+0000 7f917effd640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f916806c920 0x7f916806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.759+0000 7f917effd640 1 -- 172.21.15.113:0/3275485414 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f91800ae4a0 con 0x7f91881554e0 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.759+0000 7f918659c640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f916806c920 0x7f916806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.760+0000 7f918659c640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f916806c920 0x7f916806ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9178009b40 tx=0x7f9178009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.760+0000 7f918f59f740 1 Processor -- start 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f918f59f740 1 -- start start 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f918f59f740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d1244f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f918f59f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d12454a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f918f59f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11f8ca0 0x5604d1220ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f918f59f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x5604d115fb10 con 0x5604d11f8ca0 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f918f59f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5604d10fd240 con 0x5604d11fcec0 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f918f59f740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5604d115bad0 con 0x5604d123be40 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f9186d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11f8ca0 0x5604d1220ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f9186d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11f8ca0 0x5604d1220ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51324/0 (socket says 172.21.15.113:51324) 2024-04-22T06:32:41.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f9186d9d640 1 -- 172.21.15.113:0/2868009397 learned_addr learned my addr 172.21.15.113:0/2868009397 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f917ffff640 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d12454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.761+0000 7f918659c640 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d1244f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9186d9d640 1 -- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 msgr2=0x5604d1244f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9186d9d640 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d1244f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9186d9d640 1 -- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 msgr2=0x5604d12454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9186d9d640 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d12454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9186d9d640 1 -- 172.21.15.113:0/2868009397 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604d0e722d0 con 0x5604d11f8ca0 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f918659c640 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d1244f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9186d9d640 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11f8ca0 0x5604d1220ee0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f91800ac600 tx=0x7f9180009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfadf5d80d53f28 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9167fff640 1 -- 172.21.15.113:0/2868009397 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91800aa070 con 0x5604d11f8ca0 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9167fff640 1 -- 172.21.15.113:0/2868009397 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9180080210 con 0x5604d11f8ca0 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f9167fff640 1 -- 172.21.15.113:0/2868009397 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180094030 con 0x5604d11f8ca0 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f918f59f740 1 -- 172.21.15.113:0/2868009397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11f8ca0 msgr2=0x5604d1220ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.768 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.762+0000 7f918f59f740 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11f8ca0 0x5604d1220ee0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f91800ac600 tx=0x7f9180009510 comp rx=0 tx=0).stop 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 -- 172.21.15.113:0/2868009397 shutdown_connections 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11f8ca0 0x5604d1220ee0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d12454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 --2- 172.21.15.113:0/2868009397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d1244f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 -- 172.21.15.113:0/2868009397 >> 172.21.15.113:0/2868009397 conn(0x5604d11f7990 msgr2=0x5604d11fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 -- 172.21.15.113:0/2868009397 shutdown_connections 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 -- 172.21.15.113:0/2868009397 wait complete. 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 -- start start 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.763+0000 7f918f59f740 1 Processor -- start 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f918f59f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d1243f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f918f59f740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d11f5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f918f59f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d12447a0 0x5604d124c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f918f59f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x5604d115fb10 con 0x5604d12447a0 2024-04-22T06:32:41.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f918f59f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5604d10e8190 con 0x5604d11fcec0 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f918f59f740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5604d11fb250 con 0x5604d123be40 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f918f59f740 10 client.0 _ll_register_callbacks cb 0x5604d10e38b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f9186d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d12447a0 0x5604d124c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f9186d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d12447a0 0x5604d124c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51330/0 (socket says 172.21.15.113:51330) 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f9186d9d640 1 -- 172.21.15.113:0/3898689788 learned_addr learned my addr 172.21.15.113:0/3898689788 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f918659c640 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d1243f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f917ffff640 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d11f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f9186d9d640 1 -- 172.21.15.113:0/3898689788 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 msgr2=0x5604d11f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f9186d9d640 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d11f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f9186d9d640 1 -- 172.21.15.113:0/3898689788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 msgr2=0x5604d1243f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f9186d9d640 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d1243f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.764+0000 7f9186d9d640 1 -- 172.21.15.113:0/3898689788 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604d0f3c6b0 con 0x5604d12447a0 2024-04-22T06:32:41.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f9186d9d640 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d12447a0 0x5604d124c280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9180009d90 tx=0x7f9180009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8def405a751946cb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f91657fa640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f91657fa640 1 -- 172.21.15.113:0/3898689788 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91800aa070 con 0x5604d12447a0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f91657fa640 1 -- 172.21.15.113:0/3898689788 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f918009b300 con 0x5604d12447a0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 1 -- 172.21.15.113:0/3898689788 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9180080210 con 0x5604d12447a0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f91657fa640 1 -- 172.21.15.113:0/3898689788 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f91800ae0c0 con 0x5604d12447a0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 10 client.5235 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 1 -- 172.21.15.113:0/3898689788 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5604d123d280 con 0x5604d12447a0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f91657fa640 1 -- 172.21.15.113:0/3898689788 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9180080210 con 0x5604d12447a0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f91657fa640 1 -- 172.21.15.113:0/3898689788 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f9180082440 con 0x5604d12447a0 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 10 client.5235 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 10 client.5235 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 20 client.5235 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x5604d1258f80 0x5604d125b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 4 client.5235 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918f59f740 1 -- 172.21.15.113:0/3898689788 --> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604d116d530 con 0x5604d1258f80 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.765+0000 7f918659c640 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x5604d1258f80 0x5604d125b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f91657fa640 10 client.5235 ms_handle_connect on v2:172.21.15.113:6836/1889319276 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918659c640 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x5604d1258f80 0x5604d125b370 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7df5923712fb88f server_cookie=6051c903b182908e in_seq=0 out_seq=0 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f91657fa640 1 -- 172.21.15.113:0/3898689788 <== mds.1 v2:172.21.15.113:6836/1889319276 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5604d116d530 con 0x5604d1258f80 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f91657fa640 10 client.5235 handle_command_reply: tid=0 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 client.5235 shutdown 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 -- 172.21.15.113:0/3898689788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d12447a0 msgr2=0x5604d124c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d12447a0 0x5604d124c280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9180009d90 tx=0x7f9180009750 comp rx=0 tx=0).stop 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 -- 172.21.15.113:0/3898689788 shutdown_connections 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x5604d1258f80 0x5604d125b370 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d12447a0 0x5604d124c280 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d123be40 0x5604d11f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 --2- 172.21.15.113:0/3898689788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d1243f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f91657fa640 0 client.5235 ms_handle_reset on v2:172.21.15.113:6836/1889319276 2024-04-22T06:32:41.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.766+0000 7f918f59f740 1 -- 172.21.15.113:0/3898689788 >> 172.21.15.113:0/3898689788 conn(0x5604d11f8ca0 msgr2=0x5604d11fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.767+0000 7f918f59f740 1 -- 172.21.15.113:0/3898689788 shutdown_connections 2024-04-22T06:32:41.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.767+0000 7f918f59f740 1 -- 172.21.15.113:0/3898689788 wait complete. 2024-04-22T06:32:41.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.767+0000 7f918f59f740 20 client.5235 trim_cache size 0 max 16384 2024-04-22T06:32:41.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.784+0000 7f918f59f740 1 Processor -- start 2024-04-22T06:32:41.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.784+0000 7f918f59f740 1 -- start start 2024-04-22T06:32:41.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f918f59f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d124ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f918f59f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d123be40 0x5604d124f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f918f59f740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 0x5604d11fba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f918f59f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f91881fd000 con 0x5604d123be40 2024-04-22T06:32:41.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f918f59f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5604d12404d0 con 0x5604d11fcec0 2024-04-22T06:32:41.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f918f59f740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5604d115fb10 con 0x5604d12447a0 2024-04-22T06:32:41.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f917ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d123be40 0x5604d124f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f917ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d123be40 0x5604d124f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51334/0 (socket says 172.21.15.113:51334) 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f917ffff640 1 -- 172.21.15.113:0/715030293 learned_addr learned my addr 172.21.15.113:0/715030293 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f917ffff640 1 -- 172.21.15.113:0/715030293 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 msgr2=0x5604d11fba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f917ffff640 1 --2- 172.21.15.113:0/715030293 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 0x5604d11fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f917ffff640 1 -- 172.21.15.113:0/715030293 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 msgr2=0x5604d124ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f917ffff640 1 --2- 172.21.15.113:0/715030293 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d124ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.785+0000 7f917ffff640 1 -- 172.21.15.113:0/715030293 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604d1244c50 con 0x5604d123be40 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f917ffff640 1 --2- 172.21.15.113:0/715030293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d123be40 0x5604d124f290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9170000f60 tx=0x7f9170005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e1a0e6d48f5ff server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f91677fe640 1 -- 172.21.15.113:0/715030293 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170014820 con 0x5604d123be40 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f91677fe640 1 -- 172.21.15.113:0/715030293 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91700149c0 con 0x5604d123be40 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f91677fe640 1 -- 172.21.15.113:0/715030293 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170014db0 con 0x5604d123be40 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 -- 172.21.15.113:0/715030293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d123be40 msgr2=0x5604d124f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 --2- 172.21.15.113:0/715030293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d123be40 0x5604d124f290 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9170000f60 tx=0x7f9170005bc0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 -- 172.21.15.113:0/715030293 shutdown_connections 2024-04-22T06:32:41.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 --2- 172.21.15.113:0/715030293 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 0x5604d11fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 --2- 172.21.15.113:0/715030293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d123be40 0x5604d124f290 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 --2- 172.21.15.113:0/715030293 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d11fcec0 0x5604d124ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 -- 172.21.15.113:0/715030293 >> 172.21.15.113:0/715030293 conn(0x5604d11f8ca0 msgr2=0x5604d1218bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 -- 172.21.15.113:0/715030293 shutdown_connections 2024-04-22T06:32:41.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.786+0000 7f918f59f740 1 -- 172.21.15.113:0/715030293 wait complete. 2024-04-22T06:32:41.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.787+0000 7f918f59f740 1 -- start start 2024-04-22T06:32:41.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.787+0000 7f918f59f740 1 Processor -- start 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918f59f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11fcec0 0x5604d1249170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918f59f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d123be40 0x5604d12ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918f59f740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 0x5604d121f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918f59f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x5604d11fb250 con 0x5604d11fcec0 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918f59f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5604d10e8190 con 0x5604d123be40 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918f59f740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5604d124fcc0 con 0x5604d12447a0 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918f59f740 10 client.0 _ll_register_callbacks cb 0x7f91800a8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11fcec0 0x5604d1249170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11fcec0 0x5604d1249170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51342/0 (socket says 172.21.15.113:51342) 2024-04-22T06:32:41.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 -- 172.21.15.113:0/2359235898 learned_addr learned my addr 172.21.15.113:0/2359235898 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f917ffff640 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d123be40 0x5604d12ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f9186d9d640 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 0x5604d121f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 -- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 msgr2=0x5604d121f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 0x5604d121f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 -- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d123be40 msgr2=0x5604d12ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d123be40 0x5604d12ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 -- 172.21.15.113:0/2359235898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604d12bab80 con 0x5604d11fcec0 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f9186d9d640 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 0x5604d121f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918659c640 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11fcec0 0x5604d1249170 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x5604d1250560 tx=0x7f91780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313db01bccf3f1e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f91657fa640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f91657fa640 1 -- 172.21.15.113:0/2359235898 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178011b30 con 0x5604d11fcec0 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f918f59f740 1 -- 172.21.15.113:0/2359235898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91700149c0 con 0x5604d11fcec0 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.788+0000 7f91657fa640 1 -- 172.21.15.113:0/2359235898 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f917802b370 con 0x5604d11fcec0 2024-04-22T06:32:41.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f91657fa640 1 -- 172.21.15.113:0/2359235898 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f917802b5b0 con 0x5604d11fcec0 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f918f59f740 10 client.5241 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f918f59f740 1 -- 172.21.15.113:0/2359235898 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5604d12bad90 con 0x5604d11fcec0 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f91657fa640 1 -- 172.21.15.113:0/2359235898 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91700149c0 con 0x5604d11fcec0 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f91657fa640 1 -- 172.21.15.113:0/2359235898 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f917802b750 con 0x5604d11fcec0 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f918f59f740 10 client.5241 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f918f59f740 10 client.5241 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f918f59f740 20 client.5241 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f918f59f740 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x5604d12b7a00 0x5604d12c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f918f59f740 4 client.5241 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f918f59f740 1 -- 172.21.15.113:0/2359235898 --> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] -- command(tid 0: {"prefix": "status"}) -- 0x5604d11673a0 con 0x5604d12b7a00 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f917ffff640 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x5604d12b7a00 0x5604d12c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f91657fa640 10 client.5241 ms_handle_connect on v2:172.21.15.113:6836/1889319276 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.789+0000 7f917ffff640 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x5604d12b7a00 0x5604d12c3a90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=958968c10a556fb8 server_cookie=d474fbd2c6b12e69 in_seq=0 out_seq=0 2024-04-22T06:32:41.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f91657fa640 1 -- 172.21.15.113:0/2359235898 <== mds.1 v2:172.21.15.113:6836/1889319276 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5604d11673a0 con 0x5604d12b7a00 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f91657fa640 10 client.5241 handle_command_reply: tid=0 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 client.5241 shutdown 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 -- 172.21.15.113:0/2359235898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11fcec0 msgr2=0x5604d1249170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11fcec0 0x5604d1249170 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x5604d1250560 tx=0x7f91780046c0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 -- 172.21.15.113:0/2359235898 shutdown_connections 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.113:6836/1889319276,v1:172.21.15.113:6838/1889319276] conn(0x5604d12b7a00 0x5604d12c3a90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5604d12447a0 0x5604d121f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5604d123be40 0x5604d12ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 --2- 172.21.15.113:0/2359235898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5604d11fcec0 0x5604d1249170 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f91657fa640 0 client.5241 ms_handle_reset on v2:172.21.15.113:6836/1889319276 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 -- 172.21.15.113:0/2359235898 >> 172.21.15.113:0/2359235898 conn(0x5604d11f8ca0 msgr2=0x5604d11fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 -- 172.21.15.113:0/2359235898 shutdown_connections 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 1 -- 172.21.15.113:0/2359235898 wait complete. 2024-04-22T06:32:41.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918f59f740 20 client.5241 trim_cache size 0 max 16384 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 1, 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4308, 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 39.090470224999997, 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:41.796 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:41.797 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:41.797 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 71.183067320999996 2024-04-22T06:32:41.797 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:41.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 -- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f916806c920 msgr2=0x7f916806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f916806c920 0x7f916806ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9178009b40 tx=0x7f9178009190 comp rx=0 tx=0).stop 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 -- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91881554e0 msgr2=0x7f91881e52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91881554e0 0x7f91881e52b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9180037040 tx=0x7f9180004a40 comp rx=0 tx=0).stop 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 -- 172.21.15.113:0/3275485414 shutdown_connections 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f916806c920 0x7f916806ede0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f91881554e0 0x7f91881e52b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91880d08a0 0x7f918814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 --2- 172.21.15.113:0/3275485414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91880b3c00 0x7f918815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 -- 172.21.15.113:0/3275485414 >> 172.21.15.113:0/3275485414 conn(0x7f9188074d50 msgr2=0x7f91880cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 -- 172.21.15.113:0/3275485414 shutdown_connections 2024-04-22T06:32:41.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.790+0000 7f918c8d2640 1 -- 172.21.15.113:0/3275485414 wait complete. 2024-04-22T06:32:41.800 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-22T06:32:41.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.901+0000 7fda2d2d3640 1 Processor -- start 2024-04-22T06:32:41.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.901+0000 7fda2d2d3640 1 -- start start 2024-04-22T06:32:41.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda2d2d3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fda281554e0 0x7fda2815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda2d2d3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda2d2d3640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda281558c0 con 0x7fda280b3c00 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda2d2d3640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fda280b4a80 con 0x7fda281554e0 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda2d2d3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fda2815f630 con 0x7fda280d08a0 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda26ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fda281554e0 0x7fda2815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda26ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fda281554e0 0x7fda2815f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51346/0 (socket says 172.21.15.113:51346) 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda26ffd640 1 -- 172.21.15.113:0/2690848010 learned_addr learned my addr 172.21.15.113:0/2690848010 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda277fe640 1 --2- 172.21.15.113:0/2690848010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda26ffd640 1 -- 172.21.15.113:0/2690848010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 msgr2=0x7fda280d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda26ffd640 1 --2- 172.21.15.113:0/2690848010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda26ffd640 1 -- 172.21.15.113:0/2690848010 >> v1:172.21.15.145:6789/0 conn(0x7fda280b3c00 legacy=0x7fda280b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda26ffd640 1 -- 172.21.15.113:0/2690848010 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda280cb8c0 con 0x7fda281554e0 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.902+0000 7fda277fe640 1 --2- 172.21.15.113:0/2690848010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.903+0000 7fda26ffd640 1 --2- 172.21.15.113:0/2690848010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda2815f0f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fda18009e50 tx=0x7fda1802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63caf3adb35de75 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.903+0000 7fda25ffb640 1 -- 172.21.15.113:0/2690848010 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1802cb90 con 0x7fda281554e0 2024-04-22T06:32:41.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.903+0000 7fda25ffb640 1 -- 172.21.15.113:0/2690848010 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1802cd30 con 0x7fda281554e0 2024-04-22T06:32:41.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.903+0000 7fda25ffb640 1 -- 172.21.15.113:0/2690848010 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18034610 con 0x7fda281554e0 2024-04-22T06:32:41.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.904+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2690848010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 msgr2=0x7fda2815f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.904+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2690848010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda2815f0f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fda18009e50 tx=0x7fda1802bff0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.904+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2690848010 shutdown_connections 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.904+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2690848010 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.904+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2690848010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda2815f0f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.904+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2690848010 >> 172.21.15.113:0/2690848010 conn(0x7fda28074d50 msgr2=0x7fda28075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.904+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2690848010 shutdown_connections 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.904+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2690848010 wait complete. 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.905+0000 7fda2d2d3640 1 Processor -- start 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.905+0000 7fda2d2d3640 1 -- start start 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda2d2d3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda280b3c00 0x7fda281537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda2d2d3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda2d2d3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda280c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda2d2d3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fda280b4430 con 0x7fda281554e0 2024-04-22T06:32:41.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda2d2d3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fda280b4150 con 0x7fda280b3c00 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda2d2d3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fda280b4710 con 0x7fda280d08a0 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda280c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda280c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51356/0 (socket says 172.21.15.113:51356) 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 -- 172.21.15.113:0/2137690009 learned_addr learned my addr 172.21.15.113:0/2137690009 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda26ffd640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda280b3c00 0x7fda281537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda267fc640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 -- 172.21.15.113:0/2137690009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 msgr2=0x7fda280c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 -- 172.21.15.113:0/2137690009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda280b3c00 msgr2=0x7fda281537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda280b3c00 0x7fda281537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 -- 172.21.15.113:0/2137690009 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda281f1130 con 0x7fda281554e0 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda277fe640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda280c97a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda2000e810 tx=0x7fda2000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda0f7fe640 1 -- 172.21.15.113:0/2137690009 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2000f040 con 0x7fda281554e0 2024-04-22T06:32:41.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda0f7fe640 1 -- 172.21.15.113:0/2137690009 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20004030 con 0x7fda281554e0 2024-04-22T06:32:41.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2137690009 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda281f4840 con 0x7fda281554e0 2024-04-22T06:32:41.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda0f7fe640 1 -- 172.21.15.113:0/2137690009 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200043e0 con 0x7fda281554e0 2024-04-22T06:32:41.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.906+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2137690009 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda281f4e00 con 0x7fda281554e0 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.908+0000 7fda0f7fe640 1 -- 172.21.15.113:0/2137690009 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda2000c6d0 con 0x7fda281554e0 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.908+0000 7fda0f7fe640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fda1406c920 0x7fda1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.908+0000 7fda0f7fe640 1 -- 172.21.15.113:0/2137690009 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fda2008bc40 con 0x7fda281554e0 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.908+0000 7fda26ffd640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fda1406c920 0x7fda1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.909+0000 7fda26ffd640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fda1406c920 0x7fda1406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fda18035000 tx=0x7fda18030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.909+0000 7fda2ff9d740 1 Processor -- start 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.909+0000 7fda2ff9d740 1 -- start start 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5a7ca0 0x56320c5cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x56320c50eb10 con 0x56320c5eae40 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56320c4ac240 con 0x56320c5abec0 2024-04-22T06:32:41.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56320c50aad0 con 0x56320c5a7ca0 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda26ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda26ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51358/0 (socket says 172.21.15.113:51358) 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda26ffd640 1 -- 172.21.15.113:0/3204099983 learned_addr learned my addr 172.21.15.113:0/3204099983 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda267fc640 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda277fe640 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5a7ca0 0x56320c5cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda26ffd640 1 -- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5a7ca0 msgr2=0x56320c5cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda26ffd640 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5a7ca0 0x56320c5cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda26ffd640 1 -- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 msgr2=0x56320c5f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.910+0000 7fda26ffd640 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda26ffd640 1 -- 172.21.15.113:0/3204099983 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56320c2212d0 con 0x56320c5eae40 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda277fe640 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5a7ca0 0x56320c5cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda26ffd640 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f3f60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda1802c030 tx=0x7fda1802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14b50a74a0ed090 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda0cff9640 1 -- 172.21.15.113:0/3204099983 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18050070 con 0x56320c5eae40 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda0cff9640 1 -- 172.21.15.113:0/3204099983 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1803f440 con 0x56320c5eae40 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda0cff9640 1 -- 172.21.15.113:0/3204099983 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1803f830 con 0x56320c5eae40 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3204099983 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 msgr2=0x56320c5f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f3f60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda1802c030 tx=0x7fda1802e000 comp rx=0 tx=0).stop 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3204099983 shutdown_connections 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5a7ca0 0x56320c5cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3204099983 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f3f60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.911+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3204099983 >> 172.21.15.113:0/3204099983 conn(0x56320c5a6990 msgr2=0x56320c5a9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.912+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3204099983 shutdown_connections 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.912+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3204099983 wait complete. 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.912+0000 7fda2ff9d740 1 -- start start 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.912+0000 7fda2ff9d740 1 Processor -- start 2024-04-22T06:32:41.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5abec0 0x56320c5f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5ff270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5eeeb0 0x56320c5ed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x56320c5aa250 con 0x56320c5eae40 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56320c497190 con 0x56320c5eeeb0 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56320c5aa530 con 0x56320c5abec0 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda2ff9d740 10 client.0 _ll_register_callbacks cb 0x56320c4928b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5ff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5ff270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51370/0 (socket says 172.21.15.113:51370) 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 -- 172.21.15.113:0/4246421718 learned_addr learned my addr 172.21.15.113:0/4246421718 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda26ffd640 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5abec0 0x56320c5f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda277fe640 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5eeeb0 0x56320c5ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 -- 172.21.15.113:0/4246421718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5abec0 msgr2=0x56320c5f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5abec0 0x56320c5f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 -- 172.21.15.113:0/4246421718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5eeeb0 msgr2=0x56320c5ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5eeeb0 0x56320c5ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 -- 172.21.15.113:0/4246421718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56320c2eb6b0 con 0x56320c5eae40 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda267fc640 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5ff270 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fda1c001de0 tx=0x7fda1c012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ceff0268566eb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.913+0000 7fda05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda05ffb640 1 -- 172.21.15.113:0/4246421718 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c005320 con 0x56320c5eae40 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda05ffb640 1 -- 172.21.15.113:0/4246421718 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fda1c018b80 con 0x56320c5eae40 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 1 -- 172.21.15.113:0/4246421718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda1803f440 con 0x56320c5eae40 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda05ffb640 1 -- 172.21.15.113:0/4246421718 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fda1c018d80 con 0x56320c5eae40 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 10 client.5253 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 1 -- 172.21.15.113:0/4246421718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56320c5ff7b0 con 0x56320c5eae40 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda05ffb640 1 -- 172.21.15.113:0/4246421718 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1803f440 con 0x56320c5eae40 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda05ffb640 1 -- 172.21.15.113:0/4246421718 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7fda1c0183f0 con 0x56320c5eae40 2024-04-22T06:32:41.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 10 client.5253 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 10 client.5253 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 20 client.5253 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x56320c5f1de0 0x56320c60adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 4 client.5253 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda2ff9d740 1 -- 172.21.15.113:0/4246421718 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56320c51c530 con 0x56320c5f1de0 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda26ffd640 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x56320c5f1de0 0x56320c60adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda05ffb640 10 client.5253 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.914+0000 7fda26ffd640 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x56320c5f1de0 0x56320c60adb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a6dbec1ec5718e6 server_cookie=e25a21418d15dbc0 in_seq=0 out_seq=0 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda05ffb640 1 -- 172.21.15.113:0/4246421718 <== mds.0 v2:172.21.15.113:6837/4160787448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56320c51c530 con 0x56320c5f1de0 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda05ffb640 10 client.5253 handle_command_reply: tid=0 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 client.5253 shutdown 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 -- 172.21.15.113:0/4246421718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 msgr2=0x56320c5ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5ff270 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fda1c001de0 tx=0x7fda1c012690 comp rx=0 tx=0).stop 2024-04-22T06:32:41.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 -- 172.21.15.113:0/4246421718 shutdown_connections 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x56320c5f1de0 0x56320c60adb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5eeeb0 0x56320c5ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5ff270 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/4246421718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5abec0 0x56320c5f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda05ffb640 0 client.5253 ms_handle_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 -- 172.21.15.113:0/4246421718 >> 172.21.15.113:0/4246421718 conn(0x56320c5a7ca0 msgr2=0x56320c5aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 -- 172.21.15.113:0/4246421718 shutdown_connections 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 1 -- 172.21.15.113:0/4246421718 wait complete. 2024-04-22T06:32:41.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.915+0000 7fda2ff9d740 20 client.5253 trim_cache size 0 max 16384 2024-04-22T06:32:41.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.933+0000 7fda2ff9d740 1 Processor -- start 2024-04-22T06:32:41.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.933+0000 7fda2ff9d740 1 -- start start 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5ff250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eae40 0x56320c5eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eeeb0 0x56320c5f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fda281fefd0 con 0x56320c5eeeb0 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fda281e60b0 con 0x56320c5abec0 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56320c5ec990 con 0x56320c5eae40 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eeeb0 0x56320c5f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eeeb0 0x56320c5f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51378/0 (socket says 172.21.15.113:51378) 2024-04-22T06:32:41.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 -- 172.21.15.113:0/2825425715 learned_addr learned my addr 172.21.15.113:0/2825425715 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda26ffd640 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda267fc640 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eae40 0x56320c5eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 -- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eae40 msgr2=0x56320c5eb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eae40 0x56320c5eb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 -- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 msgr2=0x56320c5ff250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5ff250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 -- 172.21.15.113:0/2825425715 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56320c5f10d0 con 0x56320c5eeeb0 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda26ffd640 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5ff250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda277fe640 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eeeb0 0x56320c5f3d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda20009fd0 tx=0x7fda20058ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c39e4d8c8d99d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda07fff640 1 -- 172.21.15.113:0/2825425715 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20020040 con 0x56320c5eeeb0 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda07fff640 1 -- 172.21.15.113:0/2825425715 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20055c00 con 0x56320c5eeeb0 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.934+0000 7fda07fff640 1 -- 172.21.15.113:0/2825425715 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20058c20 con 0x56320c5eeeb0 2024-04-22T06:32:41.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 -- 172.21.15.113:0/2825425715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eeeb0 msgr2=0x56320c5f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eeeb0 0x56320c5f3d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda20009fd0 tx=0x7fda20058ff0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 -- 172.21.15.113:0/2825425715 shutdown_connections 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eeeb0 0x56320c5f3d20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eae40 0x56320c5eb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/2825425715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5ff250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 -- 172.21.15.113:0/2825425715 >> 172.21.15.113:0/2825425715 conn(0x56320c5a7ca0 msgr2=0x56320c5a9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 -- 172.21.15.113:0/2825425715 shutdown_connections 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 -- 172.21.15.113:0/2825425715 wait complete. 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.935+0000 7fda2ff9d740 1 -- start start 2024-04-22T06:32:41.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda2ff9d740 1 Processor -- start 2024-04-22T06:32:41.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5fe000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda2ff9d740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eeeb0 0x56320c5a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x56320c5edd10 con 0x56320c5eae40 2024-04-22T06:32:41.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56320c5f2c10 con 0x56320c5abec0 2024-04-22T06:32:41.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda2ff9d740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x56320c5f21e0 con 0x56320c5eeeb0 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda2ff9d740 10 client.0 _ll_register_callbacks cb 0x7fda1c001a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda267fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda267fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:51384/0 (socket says 172.21.15.113:51384) 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda267fc640 1 -- 172.21.15.113:0/3598891718 learned_addr learned my addr 172.21.15.113:0/3598891718 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.936+0000 7fda26ffd640 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda277fe640 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eeeb0 0x56320c5a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda267fc640 1 -- 172.21.15.113:0/3598891718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eeeb0 msgr2=0x56320c5a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda267fc640 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eeeb0 0x56320c5a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda267fc640 1 -- 172.21.15.113:0/3598891718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 msgr2=0x56320c5fe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda267fc640 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5fe000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda267fc640 1 -- 172.21.15.113:0/3598891718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56320c5f9040 con 0x56320c5eae40 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda267fc640 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f8b00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fda1c001de0 tx=0x7fda1c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3c3d041ca56d04 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:41.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda05ffb640 1 -- 172.21.15.113:0/3598891718 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c018340 con 0x56320c5eae40 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda05ffb640 1 -- 172.21.15.113:0/3598891718 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fda1c0184e0 con 0x56320c5eae40 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3598891718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda20055c00 con 0x56320c5eae40 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda05ffb640 1 -- 172.21.15.113:0/3598891718 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fda1c018ba0 con 0x56320c5eae40 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 10 client.5259 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3598891718 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56320c5c77f0 con 0x56320c5eae40 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda05ffb640 1 -- 172.21.15.113:0/3598891718 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20055c00 con 0x56320c5eae40 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda05ffb640 1 -- 172.21.15.113:0/3598891718 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7fda1c032050 con 0x56320c5eae40 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 10 client.5259 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 10 client.5259 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 20 client.5259 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x56320c66a230 0x56320c66a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 4 client.5259 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T06:32:41.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.937+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3598891718 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "status"}) -- 0x56320c5163a0 con 0x56320c66a230 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda26ffd640 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x56320c66a230 0x56320c66a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda05ffb640 10 client.5259 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda26ffd640 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x56320c66a230 0x56320c66a610 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb91d20256a1d068 server_cookie=818b50a5bc8c50c3 in_seq=0 out_seq=0 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda05ffb640 1 -- 172.21.15.113:0/3598891718 <== mds.0 v2:172.21.15.113:6837/4160787448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56320c5163a0 con 0x56320c66a230 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda05ffb640 10 client.5259 handle_command_reply: tid=0 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 client.5259 shutdown 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3598891718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 msgr2=0x56320c5f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f8b00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fda1c001de0 tx=0x7fda1c000ed0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3598891718 shutdown_connections 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x56320c66a230 0x56320c66a610 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56320c5eeeb0 0x56320c5a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56320c5eae40 0x56320c5f8b00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 --2- 172.21.15.113:0/3598891718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56320c5abec0 0x56320c5fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3598891718 >> 172.21.15.113:0/3598891718 conn(0x56320c5a7ca0 msgr2=0x56320c5bfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda05ffb640 0 client.5259 ms_handle_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3598891718 shutdown_connections 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 1 -- 172.21.15.113:0/3598891718 wait complete. 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.938+0000 7fda2ff9d740 20 client.5259 trim_cache size 0 max 16384 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "3b8618c1-770c-4da4-9414-78b2efafbd55", 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4311, 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-04-22T06:32:41.945 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-04-22T06:32:41.946 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-04-22T06:32:41.946 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 64.111965913999995, 2024-04-22T06:32:41.946 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 17, 2024-04-22T06:32:41.946 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 26, 2024-04-22T06:32:41.946 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 26, 2024-04-22T06:32:41.946 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 71.331020125999999 2024-04-22T06:32:41.946 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fda1406c920 msgr2=0x7fda1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fda1406c920 0x7fda1406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fda18035000 tx=0x7fda18030000 comp rx=0 tx=0).stop 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 msgr2=0x7fda280c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda280c97a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda2000e810 tx=0x7fda2000ecd0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2137690009 shutdown_connections 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fda1406c920 0x7fda1406ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fda281554e0 0x7fda280c97a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda280d08a0 0x7fda280c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 --2- 172.21.15.113:0/2137690009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda280b3c00 0x7fda281537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:41.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2137690009 >> 172.21.15.113:0/2137690009 conn(0x7fda28074d50 msgr2=0x7fda280cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:41.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2137690009 shutdown_connections 2024-04-22T06:32:41.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:41.939+0000 7fda2d2d3640 1 -- 172.21.15.113:0/2137690009 wait complete. 2024-04-22T06:32:41.948 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-22T06:32:56.950 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.0 2024-04-22T06:32:56.950 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:32:57.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.062+0000 7f2ab4359640 1 Processor -- start 2024-04-22T06:32:57.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.062+0000 7f2ab4359640 1 -- start start 2024-04-22T06:32:57.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.063+0000 7f2ab4359640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2aac155380 0x7f2aac0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.063+0000 7f2ab4359640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aac15b5a0 con 0x7f2aac15b0f0 2024-04-22T06:32:57.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.063+0000 7f2ab4359640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aac15b880 con 0x7f2aac0c92f0 2024-04-22T06:32:57.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.063+0000 7f2ab4359640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f2aac06fab0 con 0x7f2aac155380 2024-04-22T06:32:57.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.063+0000 7f2ab18f4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2aac15b0f0 0x7f2aac06ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:34286/0 (socket says 172.21.15.113:34286) 2024-04-22T06:32:57.064 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.063+0000 7f2ab18f4640 1 -- 172.21.15.113:0/3942570828 learned_addr learned my addr 172.21.15.113:0/3942570828 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2399025167 0 0) 0x7f2aac15b5a0 con 0x7f2aac15b0f0 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a98003520 con 0x7f2aac15b0f0 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab20f5640 1 --2- 172.21.15.113:0/3942570828 >> v2:172.21.15.145:3300/0 conn(0x7f2aac155380 0x7f2aac0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 164512555 0 0) 0x7f2a98003520 con 0x7f2aac15b0f0 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 >> v2:172.21.15.145:3300/0 conn(0x7f2aac155380 msgr2=0x7f2aac0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 --2- 172.21.15.113:0/3942570828 >> v2:172.21.15.145:3300/0 conn(0x7f2aac155380 0x7f2aac0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 >> v1:172.21.15.145:6789/0 conn(0x7f2aac0c92f0 legacy=0x7f2aac165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac15bb60 con 0x7f2aac15b0f0 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f2a9c001670 con 0x7f2aac15b0f0 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 >> v1:172.21.15.113:6789/0 conn(0x7f2aac15b0f0 legacy=0x7f2aac06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a980039b0 0x7f2a98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a980052e0 0x7f2a9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac06fab0 con 0x7f2a98004800 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9800c1b0 con 0x7f2a980039b0 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9800c3b0 con 0x7f2a980052e0 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab20f5640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a980039b0 0x7f2a98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab18f4640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab28f6640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a980052e0 0x7f2a9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab18f4640 1 -- 172.21.15.113:0/3942570828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a980052e0 msgr2=0x7f2a9800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.064+0000 7f2ab18f4640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a980052e0 0x7f2a9800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.065+0000 7f2ab18f4640 1 -- 172.21.15.113:0/3942570828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a980039b0 msgr2=0x7f2a98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.065+0000 7f2ab18f4640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a980039b0 0x7f2a98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.065+0000 7f2ab18f4640 1 -- 172.21.15.113:0/3942570828 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a98003520 con 0x7f2a98004800 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.065+0000 7f2ab28f6640 1 -- 172.21.15.113:0/3942570828 reap_dead start 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.065+0000 7f2ab18f4640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c001eb0 tx=0x7f2a98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c027a8b5d86d21 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.065+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c007d30 con 0x7f2a98004800 2024-04-22T06:32:57.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.065+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c030070 con 0x7f2a98004800 2024-04-22T06:32:57.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.065+0000 7f2ab10f3640 1 -- 172.21.15.113:0/3942570828 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c005d70 con 0x7f2a98004800 2024-04-22T06:32:57.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.066+0000 7f2ab4359640 1 -- 172.21.15.113:0/3942570828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a98004800 msgr2=0x7f2a98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.066+0000 7f2ab4359640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c001eb0 tx=0x7f2a98005830 comp rx=0 tx=0).stop 2024-04-22T06:32:57.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.066+0000 7f2ab4359640 1 -- 172.21.15.113:0/3942570828 shutdown_connections 2024-04-22T06:32:57.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.066+0000 7f2ab4359640 1 --2- 172.21.15.113:0/3942570828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2a98004800 0x7f2a98004c80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.066+0000 7f2ab4359640 1 -- 172.21.15.113:0/3942570828 >> 172.21.15.113:0/3942570828 conn(0x7f2aac0ca0d0 msgr2=0x7f2aac0ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:57.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.066+0000 7f2ab4359640 1 -- 172.21.15.113:0/3942570828 shutdown_connections 2024-04-22T06:32:57.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.066+0000 7f2ab4359640 1 -- 172.21.15.113:0/3942570828 wait complete. 2024-04-22T06:32:57.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.067+0000 7f2ab4359640 1 Processor -- start 2024-04-22T06:32:57.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.067+0000 7f2ab4359640 1 -- start start 2024-04-22T06:32:57.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab4359640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a98004800 0x7f2aac145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab4359640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2aac0c62e0 0x7f2aac0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab4359640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2aac0cc720 0x7f2aac0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab4359640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac15f4a0 con 0x7f2aac0c62e0 2024-04-22T06:32:57.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab4359640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac155760 con 0x7f2aac0cc720 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab4359640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac15f620 con 0x7f2a98004800 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab18f4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2aac0c62e0 0x7f2aac0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab18f4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2aac0c62e0 0x7f2aac0c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48848/0 (socket says 172.21.15.113:48848) 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab18f4640 1 -- 172.21.15.113:0/1027445670 learned_addr learned my addr 172.21.15.113:0/1027445670 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab20f5640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a98004800 0x7f2aac145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab28f6640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2aac0cc720 0x7f2aac0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab18f4640 1 -- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a98004800 msgr2=0x7f2aac145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab18f4640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a98004800 0x7f2aac145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab18f4640 1 -- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2aac0cc720 msgr2=0x7f2aac0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab18f4640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2aac0cc720 0x7f2aac0ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab18f4640 1 -- 172.21.15.113:0/1027445670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac0cdd60 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.068+0000 7f2ab28f6640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2aac0cc720 0x7f2aac0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.069+0000 7f2ab18f4640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2aac0c62e0 0x7f2aac0c6720 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c2d0 tx=0x7f2a9c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.069+0000 7f2aa2ffd640 1 -- 172.21.15.113:0/1027445670 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c046070 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.069+0000 7f2aa2ffd640 1 -- 172.21.15.113:0/1027445670 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c004bf0 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.069+0000 7f2aa2ffd640 1 -- 172.21.15.113:0/1027445670 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c007d10 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.069+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac0cd0e0 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.069+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac0c7b70 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.070+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac068e40 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.070+0000 7f2aa2ffd640 1 -- 172.21.15.113:0/1027445670 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a9c007070 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.071+0000 7f2aa2ffd640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2a9006c920 0x7f2a9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.071+0000 7f2aa2ffd640 1 -- 172.21.15.113:0/1027445670 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2a9c0ad230 con 0x7f2aac0c62e0 2024-04-22T06:32:57.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.071+0000 7f2ab20f5640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2a9006c920 0x7f2a9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.071+0000 7f2ab20f5640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2a9006c920 0x7f2a9006ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8003b30 tx=0x7f2aa8009760 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:57.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.075+0000 7f2aa2ffd640 1 -- 172.21.15.113:0/1027445670 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2aac0cd0e0 con 0x7f2aac0c62e0 2024-04-22T06:32:57.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.289+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2aac15a4f0 con 0x7f2aac0c62e0 2024-04-22T06:32:57.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.290+0000 7f2aa2ffd640 1 -- 172.21.15.113:0/1027445670 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6917 (secure 0 0 0) 0x7f2a9c07ac40 con 0x7f2aac0c62e0 2024-04-22T06:32:57.288 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:32:57.288 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:25.981022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4308,"mds_2":4305,"mds_3":4264,"mds_4":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":4,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"a","rank":2,"incarnation":12,"state":"up:active","state_seq":12,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:active","state_seq":11,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4259,4311,4264,4305,4308]},"id":1}]} 2024-04-22T06:32:57.289 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 17 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2a9006c920 msgr2=0x7f2a9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2a9006c920 0x7f2a9006ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8003b30 tx=0x7f2aa8009760 comp rx=0 tx=0).stop 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2aac0c62e0 msgr2=0x7f2aac0c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2aac0c62e0 0x7f2aac0c6720 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c2d0 tx=0x7f2a9c02e070 comp rx=0 tx=0).stop 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 shutdown_connections 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2aac0cc720 0x7f2aac0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2a9006c920 0x7f2a9006ede0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2aac0c62e0 0x7f2aac0c6720 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 --2- 172.21.15.113:0/1027445670 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2a98004800 0x7f2aac145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 >> 172.21.15.113:0/1027445670 conn(0x7f2aac0ca0d0 msgr2=0x7f2aac154500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 shutdown_connections 2024-04-22T06:32:57.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.292+0000 7f2ab4359640 1 -- 172.21.15.113:0/1027445670 wait complete. 2024-04-22T06:32:57.301 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db / --timeout 60 --expiration 92.0 --await' 2024-04-22T06:32:57.302 DEBUG:teuthology.orchestra.run.smithi113:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db / --timeout 60 --expiration 92.0 --await 2024-04-22T06:32:57.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.409+0000 7f11a169a640 1 Processor -- start 2024-04-22T06:32:57.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.409+0000 7f11a169a640 1 -- start start 2024-04-22T06:32:57.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.410+0000 7f11a169a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f119c155320 0x7f119c073cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.410+0000 7f11a169a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f119c0cc560 0x7f119c15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.410+0000 7f11a169a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119c155700 con 0x7f119c15c9f0 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.410+0000 7f11a169a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f119c0cbfc0 con 0x7f119c155320 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.410+0000 7f11a169a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f119c15ba40 con 0x7f119c0cc560 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.410+0000 7f119affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f119c155320 0x7f119c073cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.410+0000 7f119affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f119c155320 0x7f119c073cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48852/0 (socket says 172.21.15.113:48852) 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.410+0000 7f119affd640 1 -- 172.21.15.113:0/1499819053 learned_addr learned my addr 172.21.15.113:0/1499819053 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.411+0000 7f119affd640 1 -- 172.21.15.113:0/1499819053 >> v2:172.21.15.145:3300/0 conn(0x7f119c0cc560 msgr2=0x7f119c15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.411+0000 7f119a7fc640 1 --2- 172.21.15.113:0/1499819053 >> v2:172.21.15.145:3300/0 conn(0x7f119c0cc560 0x7f119c15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.411+0000 7f119affd640 1 --2- 172.21.15.113:0/1499819053 >> v2:172.21.15.145:3300/0 conn(0x7f119c0cc560 0x7f119c15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.411+0000 7f119affd640 1 -- 172.21.15.113:0/1499819053 >> v1:172.21.15.145:6789/0 conn(0x7f119c15c9f0 legacy=0x7f119c06b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.411+0000 7f119affd640 1 -- 172.21.15.113:0/1499819053 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c15bce0 con 0x7f119c155320 2024-04-22T06:32:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.411+0000 7f119a7fc640 1 --2- 172.21.15.113:0/1499819053 >> v2:172.21.15.145:3300/0 conn(0x7f119c0cc560 0x7f119c15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.411+0000 7f119affd640 1 --2- 172.21.15.113:0/1499819053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f119c155320 0x7f119c073cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f119c073a00 tx=0x7f118c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35d0ece577d6ce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f1199ffb640 1 -- 172.21.15.113:0/1499819053 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c02ca80 con 0x7f119c155320 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f1199ffb640 1 -- 172.21.15.113:0/1499819053 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118c02cc20 con 0x7f119c155320 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f1199ffb640 1 -- 172.21.15.113:0/1499819053 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c0343f0 con 0x7f119c155320 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f11a169a640 1 -- 172.21.15.113:0/1499819053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f119c155320 msgr2=0x7f119c073cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f11a169a640 1 --2- 172.21.15.113:0/1499819053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f119c155320 0x7f119c073cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f119c073a00 tx=0x7f118c02bee0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f11a169a640 1 -- 172.21.15.113:0/1499819053 shutdown_connections 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f11a169a640 1 --2- 172.21.15.113:0/1499819053 >> v2:172.21.15.145:3300/0 conn(0x7f119c0cc560 0x7f119c15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f11a169a640 1 --2- 172.21.15.113:0/1499819053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f119c155320 0x7f119c073cb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f11a169a640 1 -- 172.21.15.113:0/1499819053 >> 172.21.15.113:0/1499819053 conn(0x7f119c070fb0 msgr2=0x7f119c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f11a169a640 1 -- 172.21.15.113:0/1499819053 shutdown_connections 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.412+0000 7f11a169a640 1 -- 172.21.15.113:0/1499819053 wait complete. 2024-04-22T06:32:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.413+0000 7f11a169a640 1 Processor -- start 2024-04-22T06:32:57.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.413+0000 7f11a169a640 1 -- start start 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f11a169a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f119c0cc560 0x7f119c1f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f11a169a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f119c155320 0x7f119c1e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f11a169a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c15c9f0 0x7f119c0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f11a169a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0cb7c0 con 0x7f119c0cc560 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f11a169a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0cb4e0 con 0x7f119c15c9f0 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f11a169a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f119c0cbaa0 con 0x7f119c155320 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f119affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f119c0cc560 0x7f119c1f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f119affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f119c0cc560 0x7f119c1f1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48856/0 (socket says 172.21.15.113:48856) 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f119affd640 1 -- 172.21.15.113:0/3048162636 learned_addr learned my addr 172.21.15.113:0/3048162636 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f119b7fe640 1 --2- 172.21.15.113:0/3048162636 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c15c9f0 0x7f119c0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f119a7fc640 1 --2- 172.21.15.113:0/3048162636 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f119c155320 0x7f119c1e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.414+0000 7f119affd640 1 -- 172.21.15.113:0/3048162636 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f119c155320 msgr2=0x7f119c1e43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f119affd640 1 --2- 172.21.15.113:0/3048162636 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f119c155320 0x7f119c1e43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f119affd640 1 -- 172.21.15.113:0/3048162636 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c15c9f0 msgr2=0x7f119c0ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f119affd640 1 --2- 172.21.15.113:0/3048162636 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f119c15c9f0 0x7f119c0ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f119affd640 1 -- 172.21.15.113:0/3048162636 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c1f0cf0 con 0x7f119c0cc560 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f119affd640 1 --2- 172.21.15.113:0/3048162636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f119c0cc560 0x7f119c1f1790 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f118c036040 tx=0x7f118c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f11837fe640 1 -- 172.21.15.113:0/3048162636 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c043020 con 0x7f119c0cc560 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f11837fe640 1 -- 172.21.15.113:0/3048162636 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118c03e450 con 0x7f119c0cc560 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f11a169a640 1 -- 172.21.15.113:0/3048162636 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c06c8f0 con 0x7f119c0cc560 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f11837fe640 1 -- 172.21.15.113:0/3048162636 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c009510 con 0x7f119c0cc560 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.415+0000 7f11a169a640 1 -- 172.21.15.113:0/3048162636 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c1f0f90 con 0x7f119c0cc560 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.416+0000 7f11837fe640 1 -- 172.21.15.113:0/3048162636 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f118c046020 con 0x7f119c0cc560 2024-04-22T06:32:57.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.417+0000 7f11837fe640 1 --2- 172.21.15.113:0/3048162636 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f118806c8f0 0x7f118806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.417+0000 7f11837fe640 1 -- 172.21.15.113:0/3048162636 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f118c0ae8c0 con 0x7f119c0cc560 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.417+0000 7f119a7fc640 1 --2- 172.21.15.113:0/3048162636 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f118806c8f0 0x7f118806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.417+0000 7f119a7fc640 1 --2- 172.21.15.113:0/3048162636 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f118806c8f0 0x7f118806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f119c1546e0 tx=0x7f1190008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.418+0000 7f11a436d740 1 Processor -- start 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.418+0000 7f11a436d740 1 -- start start 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f11a436d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fa6d8a5200 0x55fa6d8a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f11a436d740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f11a436d740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55fa6d8a3c60 0x55fa6d8e4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f11a436d740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x55fa6d8060b0 con 0x55fa6d8ef080 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f11a436d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fa6d7b7680 con 0x55fa6d8a5200 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f11a436d740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55fa6d7c3c60 con 0x55fa6d8a3c60 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8a5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48868/0 (socket says 172.21.15.113:48868) 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 -- 172.21.15.113:0/2840095366 learned_addr learned my addr 172.21.15.113:0/2840095366 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 -- 172.21.15.113:0/2840095366 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55fa6d8a3c60 msgr2=0x55fa6d8e4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 --2- 172.21.15.113:0/2840095366 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55fa6d8a3c60 0x55fa6d8e4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 -- 172.21.15.113:0/2840095366 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fa6d8a5200 msgr2=0x55fa6d8a55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 --2- 172.21.15.113:0/2840095366 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fa6d8a5200 0x55fa6d8a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 -- 172.21.15.113:0/2840095366 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6d5e8c90 con 0x55fa6d8ef080 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f119a7fc640 1 --2- 172.21.15.113:0/2840095366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8a5b20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f119000eb70 tx=0x7f1190011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c221d996f024409f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f1180ff9640 1 -- 172.21.15.113:0/2840095366 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119001a050 con 0x55fa6d8ef080 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f1180ff9640 1 -- 172.21.15.113:0/2840095366 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1190024070 con 0x55fa6d8ef080 2024-04-22T06:32:57.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.419+0000 7f1180ff9640 1 -- 172.21.15.113:0/2840095366 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190013e20 con 0x55fa6d8ef080 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 -- 172.21.15.113:0/2840095366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 msgr2=0x55fa6d8a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 --2- 172.21.15.113:0/2840095366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8a5b20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f119000eb70 tx=0x7f1190011000 comp rx=0 tx=0).stop 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 -- 172.21.15.113:0/2840095366 shutdown_connections 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 --2- 172.21.15.113:0/2840095366 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55fa6d8a3c60 0x55fa6d8e4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 --2- 172.21.15.113:0/2840095366 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8a5b20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 --2- 172.21.15.113:0/2840095366 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fa6d8a5200 0x55fa6d8a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 -- 172.21.15.113:0/2840095366 >> 172.21.15.113:0/2840095366 conn(0x55fa6d8a1c00 msgr2=0x55fa6d8a42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 -- 172.21.15.113:0/2840095366 shutdown_connections 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 -- 172.21.15.113:0/2840095366 wait complete. 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.420+0000 7f11a436d740 1 -- start start 2024-04-22T06:32:57.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f11a436d740 1 Processor -- start 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f11a436d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fa6d8a5200 0x55fa6d8f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f11a436d740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8ee590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f11a436d740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55fa6d8f68e0 0x55fa6d8c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f11a436d740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x55fa6d809400 con 0x55fa6d8ef080 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f11a436d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fa6d7c5840 con 0x55fa6d8a5200 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f11a436d740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x55fa6d80e720 con 0x55fa6d8f68e0 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f11a436d740 10 client.0 _ll_register_callbacks cb 0x55fa6d816ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f119a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f119a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8ee590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:48872/0 (socket says 172.21.15.113:48872) 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.421+0000 7f119a7fc640 1 -- 172.21.15.113:0/1770030872 learned_addr learned my addr 172.21.15.113:0/1770030872 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:32:57.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fa6d8a5200 0x55fa6d8f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f119b7fe640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55fa6d8f68e0 0x55fa6d8c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f119a7fc640 1 -- 172.21.15.113:0/1770030872 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55fa6d8f68e0 msgr2=0x55fa6d8c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f119a7fc640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55fa6d8f68e0 0x55fa6d8c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f119a7fc640 1 -- 172.21.15.113:0/1770030872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fa6d8a5200 msgr2=0x55fa6d8f9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f119a7fc640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fa6d8a5200 0x55fa6d8f9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f119a7fc640 1 -- 172.21.15.113:0/1770030872 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6d649420 con 0x55fa6d8ef080 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f119a7fc640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x55fa6d8ef080 0x55fa6d8ee590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1190005c60 tx=0x7f1190004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e73978f341dad2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f1179ffb640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f1179ffb640 1 -- 172.21.15.113:0/1770030872 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190006100 con 0x55fa6d8ef080 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f1179ffb640 1 -- 172.21.15.113:0/1770030872 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f11900062a0 con 0x55fa6d8ef080 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 1 -- 172.21.15.113:0/1770030872 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1190024070 con 0x55fa6d8ef080 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f1179ffb640 1 -- 172.21.15.113:0/1770030872 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f119001a020 con 0x55fa6d8ef080 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 10 client.5277 fetch_fsmap learned FSMap version 17 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 1 -- 172.21.15.113:0/1770030872 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55fa6d4dc580 con 0x55fa6d8ef080 2024-04-22T06:32:57.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f1179ffb640 1 -- 172.21.15.113:0/1770030872 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1190024070 con 0x55fa6d8ef080 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f1179ffb640 1 -- 172.21.15.113:0/1770030872 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f119003e080 con 0x55fa6d8ef080 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 10 client.5277 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 10 client.5277 resolve_mds: validated gid 4311 aka daemon mds.c 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 20 client.5277 populate_metadata read hostname 'smithi113' 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 4 client.5277 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.422+0000 7f11a436d740 1 -- 172.21.15.113:0/1770030872 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa6d817b10 con 0x55fa6d8c9050 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.423+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.423+0000 7f1179ffb640 10 client.5277 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.423+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bba9e42c2efcf87 server_cookie=53fa4bd9db2bd7c1 in_seq=0 out_seq=0 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.423+0000 7f119affd640 1 -- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 msgr2=0x55fa6d8ef5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.423+0000 7f119affd640 1 -- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 msgr2=0x55fa6d8ef5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-22T06:32:57.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.423+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T06:32:57.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.423+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 unknown :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-22T06:32:57.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.423+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=33 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:32:57.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.424+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 crc :-1 s=SESSION_RECONNECTING pgs=33 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-04-22T06:32:57.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.424+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 crc :-1 s=SESSION_RECONNECTING pgs=33 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-04-22T06:32:57.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.424+0000 7f1179ffb640 0 client.5277 ms_handle_remote_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:57.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.424+0000 7f1179ffb640 10 client.5277 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:32:57.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:32:57.424+0000 7f119affd640 1 --2- 172.21.15.113:0/1770030872 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x55fa6d8c9050 0x55fa6d8ef5c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff20c0ac02138d8d server_cookie=b32e603606a63698 in_seq=0 out_seq=0 2024-04-22T06:33:07.481 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:33:07.484 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:33:37.610 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:33:37.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:34:06.359 INFO:tasks.workunit.client.0.smithi113.stderr:Note: switching to '86f7587a5a09af35f0895e1a2d08527638fae697'. 2024-04-22T06:34:06.359 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-22T06:34:06.359 INFO:tasks.workunit.client.0.smithi113.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-22T06:34:06.359 INFO:tasks.workunit.client.0.smithi113.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-22T06:34:06.359 INFO:tasks.workunit.client.0.smithi113.stderr:state without impacting any branches by switching back to a branch. 2024-04-22T06:34:06.359 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-22T06:34:06.359 INFO:tasks.workunit.client.0.smithi113.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr: git switch -c 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr:Or undo this operation with: 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr: git switch - 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr: 2024-04-22T06:34:06.360 INFO:tasks.workunit.client.0.smithi113.stderr:HEAD is now at 86f7587a5a0 qa/fsx: use the master branch to build the xfstest-dev 2024-04-22T06:34:06.365 DEBUG:teuthology.orchestra.run.smithi113:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-22T06:34:06.398 INFO:tasks.workunit.client.0.smithi113.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-22T06:34:06.400 INFO:tasks.workunit.client.0.smithi113.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-22T06:34:06.401 INFO:tasks.workunit.client.0.smithi113.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-22T06:34:07.013 INFO:tasks.workunit.client.0.smithi113.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-22T06:34:07.071 INFO:tasks.workunit.client.0.smithi113.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-22T06:34:07.111 INFO:tasks.workunit.client.0.smithi113.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-22T06:34:07.113 INFO:tasks.workunit.client.0.smithi113.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-22T06:34:07.113 INFO:tasks.workunit.client.0.smithi113.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-22T06:34:07.152 INFO:tasks.workunit.client.0.smithi113.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-22T06:34:07.155 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:34:07.155 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-22T06:34:07.210 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-04-22T06:34:07.211 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-04-22T06:34:07.212 DEBUG:teuthology.orchestra.run.smithi113:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=86f7587a5a09af35f0895e1a2d08527638fae697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-04-22T06:34:07.748 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:34:07.751 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:34:09.281 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-22T06:34:09.281 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-22T06:34:09.326 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-04-22T06:34:09.326 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-22T06:34:09.589 DEBUG:teuthology.parallel:result is None 2024-04-22T06:34:09.589 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T06:34:09.619 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T06:34:09.619 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-22T06:34:09.630 INFO:tasks.quiescer:joining Quiescers 2024-04-22T06:34:09.630 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T06:34:09.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.757+0000 7f55e7e81640 1 Processor -- start 2024-04-22T06:34:09.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.757+0000 7f55e7e81640 1 -- start start 2024-04-22T06:34:09.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e7e81640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f55e015cdd0 0x7f55e00caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:09.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e7e81640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e00c9bb0 con 0x7f55e00cb440 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e7e81640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e00c5cc0 con 0x7f55e00c9fa0 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e7e81640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f55e00c5a70 con 0x7f55e015cdd0 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e541c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f55e015cdd0 0x7f55e00caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e5c1d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f55e00cb440 0x7f55e015c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44416/0 (socket says 172.21.15.113:44416) 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e5c1d640 1 -- 172.21.15.113:0/3195356668 learned_addr learned my addr 172.21.15.113:0/3195356668 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e541c640 1 -- 172.21.15.113:0/3195356668 >> v1:172.21.15.145:6789/0 conn(0x7f55e00c9fa0 legacy=0x7f55e01636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e541c640 1 -- 172.21.15.113:0/3195356668 >> v1:172.21.15.113:6789/0 conn(0x7f55e00cb440 legacy=0x7f55e015c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e4c1b640 1 -- 172.21.15.113:0/3195356668 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121295390 0 0) 0x7f55e00c9bb0 con 0x7f55e00cb440 2024-04-22T06:34:09.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.758+0000 7f55e541c640 1 -- 172.21.15.113:0/3195356668 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e00c5fa0 con 0x7f55e015cdd0 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.759+0000 7f55e541c640 1 --2- 172.21.15.113:0/3195356668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e00caa30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097d0 tx=0x7f55d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d89b162bf93b20a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.759+0000 7f55e4c1b640 1 -- 172.21.15.113:0/3195356668 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0035020 con 0x7f55e015cdd0 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.759+0000 7f55e4c1b640 1 -- 172.21.15.113:0/3195356668 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d0031830 con 0x7f55e015cdd0 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.759+0000 7f55e4c1b640 1 -- 172.21.15.113:0/3195356668 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0031c00 con 0x7f55e015cdd0 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.760+0000 7f55e7e81640 1 -- 172.21.15.113:0/3195356668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 msgr2=0x7f55e00caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.760+0000 7f55e7e81640 1 --2- 172.21.15.113:0/3195356668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e00caa30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097d0 tx=0x7f55d002b8d0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.760+0000 7f55e7e81640 1 -- 172.21.15.113:0/3195356668 shutdown_connections 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.760+0000 7f55e7e81640 1 --2- 172.21.15.113:0/3195356668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e00caa30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.760+0000 7f55e7e81640 1 -- 172.21.15.113:0/3195356668 >> 172.21.15.113:0/3195356668 conn(0x7f55e0074f30 msgr2=0x7f55e0075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.760+0000 7f55e7e81640 1 -- 172.21.15.113:0/3195356668 shutdown_connections 2024-04-22T06:34:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.760+0000 7f55e7e81640 1 -- 172.21.15.113:0/3195356668 wait complete. 2024-04-22T06:34:09.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.761+0000 7f55e7e81640 1 Processor -- start 2024-04-22T06:34:09.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.761+0000 7f55e7e81640 1 -- start start 2024-04-22T06:34:09.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.761+0000 7f55e7e81640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55e00c9fa0 0x7f55e014b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:09.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.761+0000 7f55e7e81640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55e00cb440 0x7f55e014ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:09.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.761+0000 7f55e7e81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e01ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:09.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.761+0000 7f55e7e81640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f55e00c9850 con 0x7f55e015cdd0 2024-04-22T06:34:09.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.761+0000 7f55e7e81640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f55e00ca720 con 0x7f55e00cb440 2024-04-22T06:34:09.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.761+0000 7f55e7e81640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f55e0153360 con 0x7f55e00c9fa0 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e01ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e01ee8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45822/0 (socket says 172.21.15.113:45822) 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 -- 172.21.15.113:0/683131711 learned_addr learned my addr 172.21.15.113:0/683131711 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e541c640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55e00cb440 0x7f55e014ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 -- 172.21.15.113:0/683131711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55e00c9fa0 msgr2=0x7f55e014b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55e00c9fa0 0x7f55e014b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 -- 172.21.15.113:0/683131711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55e00cb440 msgr2=0x7f55e014ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55e00cb440 0x7f55e014ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 -- 172.21.15.113:0/683131711 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e014d750 con 0x7f55e015cdd0 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e541c640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55e00cb440 0x7f55e014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e641e640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e01ee8b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c700 tx=0x7f55d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55d67fc640 1 -- 172.21.15.113:0/683131711 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8016020 con 0x7f55e015cdd0 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55d67fc640 1 -- 172.21.15.113:0/683131711 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d800a9f0 con 0x7f55e015cdd0 2024-04-22T06:34:09.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e014da30 con 0x7f55e015cdd0 2024-04-22T06:34:09.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55d67fc640 1 -- 172.21.15.113:0/683131711 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d800ae20 con 0x7f55e015cdd0 2024-04-22T06:34:09.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.762+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e0150480 con 0x7f55e015cdd0 2024-04-22T06:34:09.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.763+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e0068e40 con 0x7f55e015cdd0 2024-04-22T06:34:09.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.764+0000 7f55d67fc640 1 -- 172.21.15.113:0/683131711 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55d8019020 con 0x7f55e015cdd0 2024-04-22T06:34:09.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.764+0000 7f55d67fc640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f55c406c8f0 0x7f55c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:09.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.764+0000 7f55d67fc640 1 -- 172.21.15.113:0/683131711 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f55d808c170 con 0x7f55e015cdd0 2024-04-22T06:34:09.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.764+0000 7f55e5c1d640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f55c406c8f0 0x7f55c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:09.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.764+0000 7f55e5c1d640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f55c406c8f0 0x7f55c406edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55dc007fd0 tx=0x7f55dc007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:09.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.768+0000 7f55d67fc640 1 -- 172.21.15.113:0/683131711 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f55d8020020 con 0x7f55e015cdd0 2024-04-22T06:34:09.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.986+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55e0071c30 con 0x7f55e015cdd0 2024-04-22T06:34:09.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.987+0000 7f55d67fc640 1 -- 172.21.15.113:0/683131711 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6917 (secure 0 0 0) 0x7f55d80102e0 con 0x7f55e015cdd0 2024-04-22T06:34:09.986 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:34:09.986 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/1189730096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":1189730096},{"type":"v1","addr":"172.21.15.145:6835","nonce":1189730096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T06:31:37.179004+0000","modified":"2024-04-22T06:32:25.981022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4311,"mds_1":4308,"mds_2":4305,"mds_3":4264,"mds_4":4259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":4,"incarnation":16,"state":"up:active","state_seq":15,"addr":"172.21.15.145:6837/2093995968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2093995968},{"type":"v1","addr":"172.21.15.145:6837","nonce":2093995968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.145:6834/9331508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":9331508},{"type":"v1","addr":"172.21.15.145:6834","nonce":9331508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"a","rank":2,"incarnation":12,"state":"up:active","state_seq":12,"addr":"172.21.15.113:6835/999776030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":999776030},{"type":"v1","addr":"172.21.15.113:6835","nonce":999776030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"e","rank":1,"incarnation":8,"state":"up:active","state_seq":11,"addr":"172.21.15.113:6838/1889319276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":1889319276},{"type":"v1","addr":"172.21.15.113:6838","nonce":1889319276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.113:6839/4160787448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6837","nonce":4160787448},{"type":"v1","addr":"172.21.15.113:6839","nonce":4160787448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4311,"qdb_cluster":[4259,4311,4264,4305,4308]},"id":1}]} 2024-04-22T06:34:09.987 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 17 2024-04-22T06:34:09.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f55c406c8f0 msgr2=0x7f55c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:09.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f55c406c8f0 0x7f55c406edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55dc007fd0 tx=0x7f55dc007920 comp rx=0 tx=0).stop 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 msgr2=0x7f55e01ee8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e01ee8b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c700 tx=0x7f55d800cbc0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 shutdown_connections 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f55c406c8f0 0x7f55c406edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55e015cdd0 0x7f55e01ee8b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f55e00cb440 0x7f55e014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 --2- 172.21.15.113:0/683131711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f55e00c9fa0 0x7f55e014b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 >> 172.21.15.113:0/683131711 conn(0x7f55e0074f30 msgr2=0x7f55e0071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 shutdown_connections 2024-04-22T06:34:09.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:09.989+0000 7f55e7e81640 1 -- 172.21.15.113:0/683131711 wait complete. 2024-04-22T06:34:09.999 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4311 quiesce db --cancel --all' 2024-04-22T06:34:09.999 DEBUG:teuthology.orchestra.run.smithi113:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4311 quiesce db --cancel --all 2024-04-22T06:34:10.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.101+0000 7f3779c9a640 1 Processor -- start 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.101+0000 7f3779c9a640 1 -- start start 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.102+0000 7f3779c9a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37740c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.102+0000 7f3779c9a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3774152210 0x7f3774157d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.102+0000 7f3779c9a640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37741588c0 con 0x7f3774158270 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.102+0000 7f3779c9a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f3774158ba0 con 0x7f3774152210 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.102+0000 7f3779c9a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f377415b300 con 0x7f3774151e30 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f37737fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37740c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f3772ffd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3774152210 0x7f3774157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f37737fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37740c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:49126/0 (socket says 172.21.15.113:49126) 2024-04-22T06:34:10.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f37737fe640 1 -- 172.21.15.113:0/3109298880 learned_addr learned my addr 172.21.15.113:0/3109298880 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f3773fff640 1 --1- 172.21.15.113:0/3109298880 >> v1:172.21.15.145:6789/0 conn(0x7f3774158270 0x7f37740c9e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.113:38734/0 (socket says 172.21.15.113:38734) 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f3772ffd640 1 -- 172.21.15.113:0/3109298880 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 msgr2=0x7f37740c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f3772ffd640 1 --2- 172.21.15.113:0/3109298880 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37740c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f3772ffd640 1 -- 172.21.15.113:0/3109298880 >> v1:172.21.15.145:6789/0 conn(0x7f3774158270 legacy=0x7f37740c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f3772ffd640 1 -- 172.21.15.113:0/3109298880 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377415b5e0 con 0x7f3774152210 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.103+0000 7f37737fe640 1 --2- 172.21.15.113:0/3109298880 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37740c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3772ffd640 1 --2- 172.21.15.113:0/3109298880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774152210 0x7f3774157d30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37680097a0 tx=0x7f376802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9988fa6b7b1c0e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f37727fc640 1 -- 172.21.15.113:0/3109298880 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768034070 con 0x7f3774152210 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f37727fc640 1 -- 172.21.15.113:0/3109298880 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3768030610 con 0x7f3774152210 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f37727fc640 1 -- 172.21.15.113:0/3109298880 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37680309e0 con 0x7f3774152210 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3779c9a640 1 -- 172.21.15.113:0/3109298880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774152210 msgr2=0x7f3774157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3779c9a640 1 --2- 172.21.15.113:0/3109298880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774152210 0x7f3774157d30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37680097a0 tx=0x7f376802b960 comp rx=0 tx=0).stop 2024-04-22T06:34:10.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3779c9a640 1 -- 172.21.15.113:0/3109298880 shutdown_connections 2024-04-22T06:34:10.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3779c9a640 1 --2- 172.21.15.113:0/3109298880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774152210 0x7f3774157d30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3779c9a640 1 --2- 172.21.15.113:0/3109298880 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37740c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3779c9a640 1 -- 172.21.15.113:0/3109298880 >> 172.21.15.113:0/3109298880 conn(0x7f377406b920 msgr2=0x7f377406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:10.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3779c9a640 1 -- 172.21.15.113:0/3109298880 shutdown_connections 2024-04-22T06:34:10.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.104+0000 7f3779c9a640 1 -- 172.21.15.113:0/3109298880 wait complete. 2024-04-22T06:34:10.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.105+0000 7f3779c9a640 1 Processor -- start 2024-04-22T06:34:10.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.106+0000 7f3779c9a640 1 -- start start 2024-04-22T06:34:10.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.106+0000 7f3779c9a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37741f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.106+0000 7f3779c9a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3774152210 0x7f3774147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.106+0000 7f3779c9a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774158270 0x7f377413bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.106+0000 7f3779c9a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f377415c0c0 con 0x7f3774152210 2024-04-22T06:34:10.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.106+0000 7f3779c9a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f377415bba0 con 0x7f3774158270 2024-04-22T06:34:10.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.106+0000 7f3779c9a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f377413dde0 con 0x7f3774151e30 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.106+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3774152210 0x7f3774147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3774152210 0x7f3774147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45832/0 (socket says 172.21.15.113:45832) 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3772ffd640 1 -- 172.21.15.113:0/1575863667 learned_addr learned my addr 172.21.15.113:0/1575863667 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f37737fe640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37741f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3773fff640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774158270 0x7f377413bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3772ffd640 1 -- 172.21.15.113:0/1575863667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 msgr2=0x7f37741f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3772ffd640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37741f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3772ffd640 1 -- 172.21.15.113:0/1575863667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774158270 msgr2=0x7f377413bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3772ffd640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774158270 0x7f377413bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3772ffd640 1 -- 172.21.15.113:0/1575863667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37741f5620 con 0x7f3774152210 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3772ffd640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3774152210 0x7f3774147be0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f37680098c0 tx=0x7f37680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f375bfff640 1 -- 172.21.15.113:0/1575863667 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768034040 con 0x7f3774152210 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f375bfff640 1 -- 172.21.15.113:0/1575863667 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3768030410 con 0x7f3774152210 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3779c9a640 1 -- 172.21.15.113:0/1575863667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377414ba70 con 0x7f3774152210 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f375bfff640 1 -- 172.21.15.113:0/1575863667 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768039c30 con 0x7f3774152210 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.107+0000 7f3779c9a640 1 -- 172.21.15.113:0/1575863667 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37741f48e0 con 0x7f3774152210 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.109+0000 7f375bfff640 1 -- 172.21.15.113:0/1575863667 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3768037070 con 0x7f3774152210 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.109+0000 7f375bfff640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f376006c8f0 0x7f376006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.109+0000 7f375bfff640 1 -- 172.21.15.113:0/1575863667 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f37680adeb0 con 0x7f3774152210 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.109+0000 7f37737fe640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f376006c8f0 0x7f376006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.109+0000 7f37737fe640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f376006c8f0 0x7f376006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3764006ca0 tx=0x7f3764009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.110+0000 7f377c96f740 1 Processor -- start 2024-04-22T06:34:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.110+0000 7f377c96f740 1 -- start start 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f377c96f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 0x563681469e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f377c96f740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 0x5636814a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f377c96f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563681466240 0x5636814b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f377c96f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x5636813ce000 con 0x563681466240 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f377c96f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56368136ab20 con 0x5636814a9310 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f377c96f740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5636813c9fc0 con 0x5636814a96f0 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563681466240 0x5636814b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563681466240 0x5636814b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45842/0 (socket says 172.21.15.113:45842) 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 -- 172.21.15.113:0/3134698585 learned_addr learned my addr 172.21.15.113:0/3134698585 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3772ffd640 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 0x5636814a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f37737fe640 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 0x563681469e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 -- 172.21.15.113:0/3134698585 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 msgr2=0x5636814a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 0x5636814a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 -- 172.21.15.113:0/3134698585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 msgr2=0x563681469e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 0x563681469e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 -- 172.21.15.113:0/3134698585 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563681384ea0 con 0x563681466240 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f3773fff640 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563681466240 0x5636814b2420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f376c001cd0 tx=0x7f376c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fb13a05da126f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f37597fa640 1 -- 172.21.15.113:0/3134698585 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c019070 con 0x563681466240 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f37597fa640 1 -- 172.21.15.113:0/3134698585 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376c0078b0 con 0x563681466240 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.111+0000 7f37597fa640 1 -- 172.21.15.113:0/3134698585 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c014650 con 0x563681466240 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 -- 172.21.15.113:0/3134698585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563681466240 msgr2=0x5636814b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563681466240 0x5636814b2420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f376c001cd0 tx=0x7f376c002190 comp rx=0 tx=0).stop 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 -- 172.21.15.113:0/3134698585 shutdown_connections 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x563681466240 0x5636814b2420 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 0x5636814a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 --2- 172.21.15.113:0/3134698585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 0x563681469e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 -- 172.21.15.113:0/3134698585 >> 172.21.15.113:0/3134698585 conn(0x563681464ef0 msgr2=0x5636814677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 -- 172.21.15.113:0/3134698585 shutdown_connections 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.112+0000 7f377c96f740 1 -- 172.21.15.113:0/3134698585 wait complete. 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.113+0000 7f377c96f740 1 -- start start 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.113+0000 7f377c96f740 1 Processor -- start 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.113+0000 7f377c96f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.113+0000 7f377c96f740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 0x563681480600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.113+0000 7f377c96f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814ac230 0x5636814a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.113+0000 7f377c96f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x5636814b1f90 con 0x5636814a9310 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.113+0000 7f377c96f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563681368510 con 0x5636814ac230 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.113+0000 7f377c96f740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x5636814687b0 con 0x5636814a96f0 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f377c96f740 10 client.0 _ll_register_callbacks cb 0x563681367f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:34:10.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814a3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45848/0 (socket says 172.21.15.113:45848) 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 -- 172.21.15.113:0/3893433204 learned_addr learned my addr 172.21.15.113:0/3893433204 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f3773fff640 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814ac230 0x5636814a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f3772ffd640 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 0x563681480600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 -- 172.21.15.113:0/3893433204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 msgr2=0x563681480600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 0x563681480600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 -- 172.21.15.113:0/3893433204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814ac230 msgr2=0x5636814a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814ac230 0x5636814a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 -- 172.21.15.113:0/3893433204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636811aca20 con 0x5636814a9310 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37737fe640 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814a3bb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3764014a20 tx=0x7f37640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afb893b03ef3962 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37527fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37527fc640 1 -- 172.21.15.113:0/3893433204 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764026030 con 0x5636814a9310 2024-04-22T06:34:10.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37527fc640 1 -- 172.21.15.113:0/3893433204 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f376400f040 con 0x5636814a9310 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f377c96f740 1 -- 172.21.15.113:0/3893433204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f376c0078b0 con 0x5636814a9310 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37527fc640 1 -- 172.21.15.113:0/3893433204 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3764013670 con 0x5636814a9310 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f377c96f740 10 client.5295 fetch_fsmap learned FSMap version 17 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f377c96f740 1 -- 172.21.15.113:0/3893433204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56368120d1b0 con 0x5636814a9310 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.114+0000 7f37527fc640 1 -- 172.21.15.113:0/3893433204 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376c0078b0 con 0x5636814a9310 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f37527fc640 1 -- 172.21.15.113:0/3893433204 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f3764035080 con 0x5636814a9310 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f377c96f740 10 client.5295 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f377c96f740 10 client.5295 resolve_mds: validated gid 4311 aka daemon mds.c 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f377c96f740 20 client.5295 populate_metadata read hostname 'smithi113' 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f377c96f740 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x5636814a60e0 0x5636814be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f377c96f740 4 client.5295 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f377c96f740 1 -- 172.21.15.113:0/3893433204 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636813dba20 con 0x5636814a60e0 2024-04-22T06:34:10.122 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f3772ffd640 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x5636814a60e0 0x5636814be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f3772ffd640 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x5636814a60e0 0x5636814be0f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b060e0528ee62f server_cookie=75df26c5c35a4863 in_seq=0 out_seq=0 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.115+0000 7f37527fc640 10 client.5295 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f37527fc640 1 -- 172.21.15.113:0/3893433204 <== mds.0 v2:172.21.15.113:6837/4160787448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5636813dba20 con 0x5636814a60e0 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f37527fc640 10 client.5295 handle_command_reply: tid=0 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 client.5295 shutdown 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 -- 172.21.15.113:0/3893433204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 msgr2=0x5636814a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814a3bb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3764014a20 tx=0x7f37640046c0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 -- 172.21.15.113:0/3893433204 shutdown_connections 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x5636814a60e0 0x5636814be0f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814ac230 0x5636814a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f37527fc640 0 client.5295 ms_handle_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:34:10.123 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814a96f0 0x563681480600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 --2- 172.21.15.113:0/3893433204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814a3bb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 -- 172.21.15.113:0/3893433204 >> 172.21.15.113:0/3893433204 conn(0x563681466240 msgr2=0x563681468eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:10.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 -- 172.21.15.113:0/3893433204 shutdown_connections 2024-04-22T06:34:10.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 1 -- 172.21.15.113:0/3893433204 wait complete. 2024-04-22T06:34:10.124 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.116+0000 7f377c96f740 20 client.5295 trim_cache size 0 max 16384 2024-04-22T06:34:10.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.133+0000 7f377c96f740 1 Processor -- start 2024-04-22T06:34:10.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.133+0000 7f377c96f740 1 -- start start 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f377c96f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f377c96f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a96f0 0x56368147e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f377c96f740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814ac230 0x56368147ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f377c96f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f37741ffdf0 con 0x5636814a9310 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f377c96f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f37741fe2b0 con 0x5636814a96f0 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f377c96f740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f37741ff720 con 0x5636814ac230 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45858/0 (socket says 172.21.15.113:45858) 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 -- 172.21.15.113:0/4041033325 learned_addr learned my addr 172.21.15.113:0/4041033325 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 -- 172.21.15.113:0/4041033325 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814ac230 msgr2=0x56368147ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 --2- 172.21.15.113:0/4041033325 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814ac230 0x56368147ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 -- 172.21.15.113:0/4041033325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a96f0 msgr2=0x56368147e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 --2- 172.21.15.113:0/4041033325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a96f0 0x56368147e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 -- 172.21.15.113:0/4041033325 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636814a3f20 con 0x5636814a9310 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f37737fe640 1 --2- 172.21.15.113:0/4041033325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814b18f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3764014f50 tx=0x7f376401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ad5965a2dd1d87 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f3758ff9640 1 -- 172.21.15.113:0/4041033325 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764026050 con 0x5636814a9310 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f3758ff9640 1 -- 172.21.15.113:0/4041033325 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764027040 con 0x5636814a9310 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.134+0000 7f3758ff9640 1 -- 172.21.15.113:0/4041033325 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764013c60 con 0x5636814a9310 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 -- 172.21.15.113:0/4041033325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 msgr2=0x5636814b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 --2- 172.21.15.113:0/4041033325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814b18f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3764014f50 tx=0x7f376401d000 comp rx=0 tx=0).stop 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 -- 172.21.15.113:0/4041033325 shutdown_connections 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 --2- 172.21.15.113:0/4041033325 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814ac230 0x56368147ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 --2- 172.21.15.113:0/4041033325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a96f0 0x56368147e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 --2- 172.21.15.113:0/4041033325 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a9310 0x5636814b18f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 -- 172.21.15.113:0/4041033325 >> 172.21.15.113:0/4041033325 conn(0x563681466240 msgr2=0x56368145e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:10.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 -- 172.21.15.113:0/4041033325 shutdown_connections 2024-04-22T06:34:10.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 -- 172.21.15.113:0/4041033325 wait complete. 2024-04-22T06:34:10.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.135+0000 7f377c96f740 1 -- start start 2024-04-22T06:34:10.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f377c96f740 1 Processor -- start 2024-04-22T06:34:10.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f377c96f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 0x563681483930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f377c96f740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a96f0 0x56368149fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f377c96f740 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814ac230 0x563681466c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f377c96f740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f37741ff050 con 0x5636814a96f0 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f377c96f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f37741fe980 con 0x5636814a9310 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f377c96f740 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f37740cd1f0 con 0x5636814ac230 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f377c96f740 10 client.0 _ll_register_callbacks cb 0x7f3764011e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a96f0 0x56368149fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a96f0 0x56368149fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45870/0 (socket says 172.21.15.113:45870) 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.136+0000 7f3772ffd640 1 -- 172.21.15.113:0/1192414939 learned_addr learned my addr 172.21.15.113:0/1192414939 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f3772ffd640 1 -- 172.21.15.113:0/1192414939 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814ac230 msgr2=0x563681466c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f3772ffd640 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814ac230 0x563681466c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f3772ffd640 1 -- 172.21.15.113:0/1192414939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 msgr2=0x563681483930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:10.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f37737fe640 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 0x563681483930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f3772ffd640 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 0x563681483930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f3772ffd640 1 -- 172.21.15.113:0/1192414939 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636810a0310 con 0x5636814a96f0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f3772ffd640 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a96f0 0x56368149fc80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f376807b820 tx=0x7f376807b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85ca42292c7d35c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f37527fc640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f37527fc640 1 -- 172.21.15.113:0/1192414939 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37680843c0 con 0x5636814a96f0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f37527fc640 1 -- 172.21.15.113:0/1192414939 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f37680305c0 con 0x5636814a96f0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 1 -- 172.21.15.113:0/1192414939 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3764027040 con 0x5636814a96f0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f37527fc640 1 -- 172.21.15.113:0/1192414939 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3768089070 con 0x5636814a96f0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 10 client.5301 fetch_fsmap learned FSMap version 17 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 1 -- 172.21.15.113:0/1192414939 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5636814aa3c0 con 0x5636814a96f0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f37527fc640 1 -- 172.21.15.113:0/1192414939 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764027040 con 0x5636814a96f0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f37527fc640 1 -- 172.21.15.113:0/1192414939 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f3768041070 con 0x5636814a96f0 2024-04-22T06:34:10.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 10 client.5301 fetch_fsmap finished waiting for FSMap version 17 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 10 client.5301 resolve_mds: validated gid 4311 aka daemon mds.c 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 20 client.5301 populate_metadata read hostname 'smithi113' 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x5636814671a0 0x5636815281d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 4 client.5301 mds_command: new command op to 4311 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f377c96f740 1 -- 172.21.15.113:0/1192414939 --> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5636813d5890 con 0x5636814671a0 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.137+0000 7f37737fe640 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x5636814671a0 0x5636815281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f37737fe640 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x5636814671a0 0x5636815281d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0d59abd2bf0d855 server_cookie=1a9a973fcc15d571 in_seq=0 out_seq=0 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f37527fc640 10 client.5301 ms_handle_connect on v2:172.21.15.113:6837/4160787448 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f37527fc640 1 -- 172.21.15.113:0/1192414939 <== mds.0 v2:172.21.15.113:6837/4160787448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+78 (crc 0 0 0) 0x5636813d5890 con 0x5636814671a0 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f37527fc640 10 client.5301 handle_command_reply: tid=0 2024-04-22T06:34:10.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 client.5301 shutdown 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 -- 172.21.15.113:0/1192414939 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a96f0 msgr2=0x56368149fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a96f0 0x56368149fc80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f376807b820 tx=0x7f376807b950 comp rx=0 tx=0).stop 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 -- 172.21.15.113:0/1192414939 shutdown_connections 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.113:6837/4160787448,v1:172.21.15.113:6839/4160787448] conn(0x5636814671a0 0x5636815281d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5636814ac230 0x563681466c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x5636814a96f0 0x56368149fc80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f37527fc640 0 client.5301 ms_handle_reset on v2:172.21.15.113:6837/4160787448 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 --2- 172.21.15.113:0/1192414939 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5636814a9310 0x563681483930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 -- 172.21.15.113:0/1192414939 >> 172.21.15.113:0/1192414939 conn(0x563681466240 msgr2=0x5636814a9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 -- 172.21.15.113:0/1192414939 shutdown_connections 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 1 -- 172.21.15.113:0/1192414939 wait complete. 2024-04-22T06:34:10.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.138+0000 7f377c96f740 20 client.5301 trim_cache size 0 max 16384 2024-04-22T06:34:10.145 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:34:10.145 INFO:teuthology.orchestra.run.smithi113.stdout: "epoch": 17, 2024-04-22T06:34:10.145 INFO:teuthology.orchestra.run.smithi113.stdout: "leader": 4311, 2024-04-22T06:34:10.145 INFO:teuthology.orchestra.run.smithi113.stdout: "set_version": 0, 2024-04-22T06:34:10.145 INFO:teuthology.orchestra.run.smithi113.stdout: "sets": {} 2024-04-22T06:34:10.145 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 -- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f376006c8f0 msgr2=0x7f376006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f376006c8f0 0x7f376006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3764006ca0 tx=0x7f3764009240 comp rx=0 tx=0).stop 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 -- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3774152210 msgr2=0x7f3774147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3774152210 0x7f3774147be0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f37680098c0 tx=0x7f37680046c0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 -- 172.21.15.113:0/1575863667 shutdown_connections 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3774158270 0x7f377413bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f376006c8f0 0x7f376006edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3774152210 0x7f3774147be0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 --2- 172.21.15.113:0/1575863667 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3774151e30 0x7f37741f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 -- 172.21.15.113:0/1575863667 >> 172.21.15.113:0/1575863667 conn(0x7f377406b920 msgr2=0x7f37740ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:10.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 -- 172.21.15.113:0/1575863667 shutdown_connections 2024-04-22T06:34:10.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:10.139+0000 7f3779c9a640 1 -- 172.21.15.113:0/1575863667 wait complete. 2024-04-22T06:34:38.975 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:34:38.979 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:34:57.332 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-22T06:34:57.332 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't parse response with error Expecting value: line 1 column 1 (char 0); stdout: 2024-04-22T06:34:57.333 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 185, in do_quiesce response = json.loads(stdout) File "/usr/lib/python3.8/json/__init__.py", line 357, in loads return _default_decoder.decode(s) File "/usr/lib/python3.8/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.8/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 240, in _run self.do_quiesce(d) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 189, in do_quiesce raise RuntimeError(f"Error parsing quiesce response: {e}") RuntimeError: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) 2024-04-22T06:34:57.368 ERROR:teuthology.run_tasks:Manager failed: quiescer Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) 2024-04-22T06:34:57.369 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-22T06:34:57.378 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-22T06:34:57.378 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:34:57.379 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T06:34:57.397 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:34:57.398 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T06:34:57.456 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:34:57.601 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.602+0000 7f38c04b3640 1 Processor -- start 2024-04-22T06:34:57.601 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.602+0000 7f38c04b3640 1 -- start start 2024-04-22T06:34:57.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38c04b3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f38b8068290 0x7f38b815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38c04b3640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b81557c0 con 0x7f38b81553e0 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38c04b3640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b80c2100 con 0x7f38b80c28c0 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38c04b3640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f38b80c1eb0 con 0x7f38b8068290 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38bda4e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f38b8068290 0x7f38b815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38be24f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f38b81553e0 0x7f38b806dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60986/0 (socket says 172.21.15.113:60986) 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38be24f640 1 -- 172.21.15.113:0/873032617 learned_addr learned my addr 172.21.15.113:0/873032617 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38bda4e640 1 -- 172.21.15.113:0/873032617 >> v1:172.21.15.145:6789/0 conn(0x7f38b80c28c0 legacy=0x7f38b80c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38bda4e640 1 -- 172.21.15.113:0/873032617 >> v1:172.21.15.113:6789/0 conn(0x7f38b81553e0 legacy=0x7f38b806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38bda4e640 1 -- 172.21.15.113:0/873032617 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b80c23e0 con 0x7f38b8068290 2024-04-22T06:34:57.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.603+0000 7f38bd24d640 1 -- 172.21.15.113:0/873032617 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719296892 0 0) 0x7f38b81557c0 con 0x7f38b81553e0 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.604+0000 7f38bda4e640 1 --2- 172.21.15.113:0/873032617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b815baf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f38a80097a0 tx=0x7f38a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdee63fe643097f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.604+0000 7f38bd24d640 1 -- 172.21.15.113:0/873032617 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a80315a0 con 0x7f38b8068290 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.604+0000 7f38bd24d640 1 -- 172.21.15.113:0/873032617 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a8037070 con 0x7f38b8068290 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.604+0000 7f38bd24d640 1 -- 172.21.15.113:0/873032617 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8031960 con 0x7f38b8068290 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.604+0000 7f38c04b3640 1 -- 172.21.15.113:0/873032617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 msgr2=0x7f38b815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.605+0000 7f38c04b3640 1 --2- 172.21.15.113:0/873032617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b815baf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f38a80097a0 tx=0x7f38a802b840 comp rx=0 tx=0).stop 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.605+0000 7f38c04b3640 1 -- 172.21.15.113:0/873032617 shutdown_connections 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.605+0000 7f38c04b3640 1 --2- 172.21.15.113:0/873032617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b815baf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.605+0000 7f38c04b3640 1 -- 172.21.15.113:0/873032617 >> 172.21.15.113:0/873032617 conn(0x7f38b806f2f0 msgr2=0x7f38b806f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:57.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.605+0000 7f38c04b3640 1 -- 172.21.15.113:0/873032617 shutdown_connections 2024-04-22T06:34:57.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.605+0000 7f38c04b3640 1 -- 172.21.15.113:0/873032617 wait complete. 2024-04-22T06:34:57.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38c04b3640 1 Processor -- start 2024-04-22T06:34:57.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38c04b3640 1 -- start start 2024-04-22T06:34:57.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38c04b3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b814bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38c04b3640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38b80c28c0 0x7f38b81f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38c04b3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38b81553e0 0x7f38b8156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38c04b3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f38b806dad0 con 0x7f38b8068290 2024-04-22T06:34:57.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38c04b3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f38b80c26c0 con 0x7f38b81553e0 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38c04b3640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f38b806e700 con 0x7f38b80c28c0 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.606+0000 7f38be24f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b814bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38be24f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b814bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49078/0 (socket says 172.21.15.113:49078) 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38be24f640 1 -- 172.21.15.113:0/642107977 learned_addr learned my addr 172.21.15.113:0/642107977 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38bea50640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38b81553e0 0x7f38b8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38be24f640 1 -- 172.21.15.113:0/642107977 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38b80c28c0 msgr2=0x7f38b81f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38be24f640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38b80c28c0 0x7f38b81f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38be24f640 1 -- 172.21.15.113:0/642107977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38b81553e0 msgr2=0x7f38b8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38be24f640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38b81553e0 0x7f38b8156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38be24f640 1 -- 172.21.15.113:0/642107977 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b8158220 con 0x7f38b8068290 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38be24f640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b814bde0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c490 tx=0x7f38b400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38aeffd640 1 -- 172.21.15.113:0/642107977 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4018070 con 0x7f38b8068290 2024-04-22T06:34:57.609 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38aeffd640 1 -- 172.21.15.113:0/642107977 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b4007500 con 0x7f38b8068290 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b8158500 con 0x7f38b8068290 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38aeffd640 1 -- 172.21.15.113:0/642107977 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4004a20 con 0x7f38b8068290 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.607+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b80cba30 con 0x7f38b8068290 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.608+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b8068e40 con 0x7f38b8068290 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.609+0000 7f38aeffd640 1 -- 172.21.15.113:0/642107977 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38b401b070 con 0x7f38b8068290 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.609+0000 7f38aeffd640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f389c06c8f0 0x7f389c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.609+0000 7f38aeffd640 1 -- 172.21.15.113:0/642107977 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f38b408b210 con 0x7f38b8068290 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.609+0000 7f38bda4e640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f389c06c8f0 0x7f389c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.610+0000 7f38bda4e640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f389c06c8f0 0x7f389c06edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f38a8036000 tx=0x7f38a8030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:57.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.614+0000 7f38aeffd640 1 -- 172.21.15.113:0/642107977 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38b4059240 con 0x7f38b8068290 2024-04-22T06:34:57.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.789+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38b806eae0 con 0x7f38b8068290 2024-04-22T06:34:57.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.790+0000 7f38aeffd640 1 -- 172.21.15.113:0/642107977 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f38b4058b40 con 0x7f38b8068290 2024-04-22T06:34:57.790 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:34:57.790 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:34:57.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f389c06c8f0 msgr2=0x7f389c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f389c06c8f0 0x7f389c06edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f38a8036000 tx=0x7f38a8030000 comp rx=0 tx=0).stop 2024-04-22T06:34:57.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 msgr2=0x7f38b814bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b814bde0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c490 tx=0x7f38b400c950 comp rx=0 tx=0).stop 2024-04-22T06:34:57.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 shutdown_connections 2024-04-22T06:34:57.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38b81553e0 0x7f38b8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38b80c28c0 0x7f38b81f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f389c06c8f0 0x7f389c06edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 --2- 172.21.15.113:0/642107977 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38b8068290 0x7f38b814bde0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 >> 172.21.15.113:0/642107977 conn(0x7f38b806f2f0 msgr2=0x7f38b80c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:57.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 shutdown_connections 2024-04-22T06:34:57.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.792+0000 7f38c04b3640 1 -- 172.21.15.113:0/642107977 wait complete. 2024-04-22T06:34:57.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:34:57.804 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:34:57.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.905+0000 7fc1dc6a7640 1 Processor -- start 2024-04-22T06:34:57.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.905+0000 7fc1dc6a7640 1 -- start start 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.906+0000 7fc1dc6a7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc1d40c8720 0x7fc1d4151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.906+0000 7fc1dc6a7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d4157d70 con 0x7fc1d40c8340 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.906+0000 7fc1dc6a7640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d415be10 con 0x7fc1d4158b10 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.906+0000 7fc1dc6a7640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fc1d4158680 con 0x7fc1d40c8720 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.906+0000 7fc1da443640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc1d40c8340 0x7fc1d40723b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:60996/0 (socket says 172.21.15.113:60996) 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1da443640 1 -- 172.21.15.113:0/4419132 learned_addr learned my addr 172.21.15.113:0/4419132 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1dac44640 1 --2- 172.21.15.113:0/4419132 >> v2:172.21.15.145:3300/0 conn(0x7fc1d40c8720 0x7fc1d4151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057142394 0 0) 0x7fc1d4157d70 con 0x7fc1d40c8340 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c0003520 con 0x7fc1d40c8340 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2117572291 0 0) 0x7fc1c0003520 con 0x7fc1d40c8340 2024-04-22T06:34:57.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 >> v2:172.21.15.145:3300/0 conn(0x7fc1d40c8720 msgr2=0x7fc1d4151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 --2- 172.21.15.113:0/4419132 >> v2:172.21.15.145:3300/0 conn(0x7fc1d40c8720 0x7fc1d4151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 >> v1:172.21.15.145:6789/0 conn(0x7fc1d4158b10 legacy=0x7fc1d415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d415c0f0 con 0x7fc1d40c8340 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fc1cc001670 con 0x7fc1d40c8340 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 >> v1:172.21.15.113:6789/0 conn(0x7fc1d40c8340 legacy=0x7fc1d40723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1c00039b0 0x7fc1c0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1c00043d0 0x7fc1c00048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d4158680 con 0x7fc1c00050a0 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c000bfe0 con 0x7fc1c00039b0 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c000c1e0 con 0x7fc1c00043d0 2024-04-22T06:34:57.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1dac44640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1da443640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1c00039b0 0x7fc1c0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1d9c42640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1c00043d0 0x7fc1c00048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1dac44640 1 -- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1c00043d0 msgr2=0x7fc1c00048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1dac44640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1c00043d0 0x7fc1c00048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1dac44640 1 -- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1c00039b0 msgr2=0x7fc1c0003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1dac44640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1c00039b0 0x7fc1c0003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.907+0000 7fc1dac44640 1 -- 172.21.15.113:0/4419132 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c0003520 con 0x7fc1c00050a0 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.908+0000 7fc1d9c42640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1c00043d0 0x7fc1c00048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.908+0000 7fc1dac44640 1 -- 172.21.15.113:0/4419132 reap_dead start 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.908+0000 7fc1dac44640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1c000b9c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009f90 tx=0x7fc1c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fe7074dd1c2a28 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.908+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0009c10 con 0x7fc1c00050a0 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.908+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d002cc20 con 0x7fc1c00050a0 2024-04-22T06:34:57.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.908+0000 7fc1d9441640 1 -- 172.21.15.113:0/4419132 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0003990 con 0x7fc1c00050a0 2024-04-22T06:34:57.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.909+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/4419132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 msgr2=0x7fc1c000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.909+0000 7fc1dc6a7640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1c000b9c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009f90 tx=0x7fc1c0005830 comp rx=0 tx=0).stop 2024-04-22T06:34:57.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.909+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/4419132 shutdown_connections 2024-04-22T06:34:57.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.909+0000 7fc1dc6a7640 1 --2- 172.21.15.113:0/4419132 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1c000b9c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.909+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/4419132 >> 172.21.15.113:0/4419132 conn(0x7fc1d406d660 msgr2=0x7fc1d4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:57.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.909+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/4419132 shutdown_connections 2024-04-22T06:34:57.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.909+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/4419132 wait complete. 2024-04-22T06:34:57.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.910+0000 7fc1dc6a7640 1 Processor -- start 2024-04-22T06:34:57.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.910+0000 7fc1dc6a7640 1 -- start start 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dc6a7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1d415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dc6a7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d4149cd0 0x7fc1d40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dc6a7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1d41f0520 0x7fc1d41f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dc6a7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d4071c60 con 0x7fc1c00050a0 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dc6a7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d4158310 con 0x7fc1d4149cd0 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dc6a7640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d4071de0 con 0x7fc1d41f0520 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1d415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1d415a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49102/0 (socket says 172.21.15.113:49102) 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 -- 172.21.15.113:0/3330309676 learned_addr learned my addr 172.21.15.113:0/3330309676 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dac44640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1d41f0520 0x7fc1d41f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1d9c42640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d4149cd0 0x7fc1d40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 -- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1d41f0520 msgr2=0x7fc1d41f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1d41f0520 0x7fc1d41f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 -- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d4149cd0 msgr2=0x7fc1d40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d4149cd0 0x7fc1d40ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 -- 172.21.15.113:0/3330309676 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d4158fd0 con 0x7fc1c00050a0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dac44640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1d41f0520 0x7fc1d41f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1da443640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1d415a570 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc007340 tx=0x7fc1cc007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1caffd640 1 -- 172.21.15.113:0/3330309676 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc01a070 con 0x7fc1c00050a0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1caffd640 1 -- 172.21.15.113:0/3330309676 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc00f860 con 0x7fc1c00050a0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.911+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d415aab0 con 0x7fc1c00050a0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.912+0000 7fc1caffd640 1 -- 172.21.15.113:0/3330309676 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00fc50 con 0x7fc1c00050a0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.912+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d4159270 con 0x7fc1c00050a0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.912+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d4068f50 con 0x7fc1c00050a0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.913+0000 7fc1caffd640 1 -- 172.21.15.113:0/3330309676 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1cc01d070 con 0x7fc1c00050a0 2024-04-22T06:34:57.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.913+0000 7fc1caffd640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1b806c920 0x7fc1b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:57.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.913+0000 7fc1caffd640 1 -- 172.21.15.113:0/3330309676 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc1cc08b780 con 0x7fc1c00050a0 2024-04-22T06:34:57.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.913+0000 7fc1d9c42640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1b806c920 0x7fc1b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:57.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.914+0000 7fc1d9c42640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1b806c920 0x7fc1b806ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4157db0 tx=0x7fc1c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:57.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:57.918+0000 7fc1caffd640 1 -- 172.21.15.113:0/3330309676 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc1cc059840 con 0x7fc1c00050a0 2024-04-22T06:34:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.092+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1d4071830 con 0x7fc1c00050a0 2024-04-22T06:34:58.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.092+0000 7fc1caffd640 1 -- 172.21.15.113:0/3330309676 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fc1cc059140 con 0x7fc1c00050a0 2024-04-22T06:34:58.091 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:34:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1b806c920 msgr2=0x7fc1b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1b806c920 0x7fc1b806ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4157db0 tx=0x7fc1c4009040 comp rx=0 tx=0).stop 2024-04-22T06:34:58.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 msgr2=0x7fc1d415a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1d415a570 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc007340 tx=0x7fc1cc007800 comp rx=0 tx=0).stop 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 shutdown_connections 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc1d41f0520 0x7fc1d41f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1d4149cd0 0x7fc1d40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc1b806c920 0x7fc1b806ede0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 --2- 172.21.15.113:0/3330309676 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1c00050a0 0x7fc1d415a570 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 >> 172.21.15.113:0/3330309676 conn(0x7fc1d406d660 msgr2=0x7fc1d40c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 shutdown_connections 2024-04-22T06:34:58.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.094+0000 7fc1dc6a7640 1 -- 172.21.15.113:0/3330309676 wait complete. 2024-04-22T06:34:58.104 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:34:58.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.204+0000 7f5291f04640 1 Processor -- start 2024-04-22T06:34:58.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f5291f04640 1 -- start start 2024-04-22T06:34:58.206 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f5291f04640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.206 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f5291f04640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f528c0cbae0 0x7f528c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f5291f04640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c0c5c80 con 0x7f528c1553c0 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f5291f04640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f528c15e660 con 0x7f528c0cbae0 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f5291f04640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f528c1557a0 con 0x7f528c15b070 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f528bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f528c0cbae0 0x7f528c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f528b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f528c1553c0 0x7f528c15edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:32768/0 (socket says 172.21.15.113:32768) 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.205+0000 7f528b7fe640 1 -- 172.21.15.113:0/841699701 learned_addr learned my addr 172.21.15.113:0/841699701 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.206+0000 7f528affd640 1 --2- 172.21.15.113:0/841699701 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.206+0000 7f528bfff640 1 -- 172.21.15.113:0/841699701 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 msgr2=0x7f528c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.206+0000 7f528bfff640 1 --2- 172.21.15.113:0/841699701 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.206+0000 7f528bfff640 1 -- 172.21.15.113:0/841699701 >> v1:172.21.15.113:6789/0 conn(0x7f528c1553c0 legacy=0x7f528c15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.206+0000 7f528bfff640 1 -- 172.21.15.113:0/841699701 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c15b5d0 con 0x7f528c0cbae0 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.206+0000 7f528a7fc640 1 -- 172.21.15.113:0/841699701 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683904821 0 0) 0x7f528c0c5c80 con 0x7f528c1553c0 2024-04-22T06:34:58.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.206+0000 7f528affd640 1 --2- 172.21.15.113:0/841699701 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.206+0000 7f528bfff640 1 --2- 172.21.15.113:0/841699701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c0cbae0 0x7f528c0d0820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a578d978ac3a3d41 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f528a7fc640 1 -- 172.21.15.113:0/841699701 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284039070 con 0x7f528c0cbae0 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f528a7fc640 1 -- 172.21.15.113:0/841699701 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528402cc50 con 0x7f528c0cbae0 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f528a7fc640 1 -- 172.21.15.113:0/841699701 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284034440 con 0x7f528c0cbae0 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f5291f04640 1 -- 172.21.15.113:0/841699701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c0cbae0 msgr2=0x7f528c0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f5291f04640 1 --2- 172.21.15.113:0/841699701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c0cbae0 0x7f528c0d0820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528402bea0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f5291f04640 1 -- 172.21.15.113:0/841699701 shutdown_connections 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f5291f04640 1 --2- 172.21.15.113:0/841699701 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c0cbae0 0x7f528c0d0820 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f5291f04640 1 --2- 172.21.15.113:0/841699701 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f5291f04640 1 -- 172.21.15.113:0/841699701 >> 172.21.15.113:0/841699701 conn(0x7f528c072360 msgr2=0x7f528c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:58.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f5291f04640 1 -- 172.21.15.113:0/841699701 shutdown_connections 2024-04-22T06:34:58.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.207+0000 7f5291f04640 1 -- 172.21.15.113:0/841699701 wait complete. 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.208+0000 7f5291f04640 1 Processor -- start 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f5291f04640 1 -- start start 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f5291f04640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f528c0cbae0 0x7f528c15d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f5291f04640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c1553c0 0x7f528c0cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f5291f04640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c14b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f5291f04640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f528c15be70 con 0x7f528c1553c0 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f5291f04640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f528c15bb90 con 0x7f528c0cbae0 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f5291f04640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f528c15e8b0 con 0x7f528c15b070 2024-04-22T06:34:58.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f528affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c1553c0 0x7f528c0cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f528affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c1553c0 0x7f528c0cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49122/0 (socket says 172.21.15.113:49122) 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f528affd640 1 -- 172.21.15.113:0/4268212920 learned_addr learned my addr 172.21.15.113:0/4268212920 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f528b7fe640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f528c0cbae0 0x7f528c15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.209+0000 7f528bfff640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f528affd640 1 -- 172.21.15.113:0/4268212920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 msgr2=0x7f528c14b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f528affd640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c14b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f528affd640 1 -- 172.21.15.113:0/4268212920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f528c0cbae0 msgr2=0x7f528c15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f528affd640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f528c0cbae0 0x7f528c15d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f528affd640 1 -- 172.21.15.113:0/4268212920 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c1f5340 con 0x7f528c1553c0 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f528affd640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c1553c0 0x7f528c0cfb80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f528000d800 tx=0x7f528000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f5273fff640 1 -- 172.21.15.113:0/4268212920 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280018020 con 0x7f528c1553c0 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f5273fff640 1 -- 172.21.15.113:0/4268212920 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5280004030 con 0x7f528c1553c0 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c15c850 con 0x7f528c1553c0 2024-04-22T06:34:58.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f5273fff640 1 -- 172.21.15.113:0/4268212920 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280004420 con 0x7f528c1553c0 2024-04-22T06:34:58.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.210+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c1f5050 con 0x7f528c1553c0 2024-04-22T06:34:58.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.211+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c0ce130 con 0x7f528c1553c0 2024-04-22T06:34:58.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.211+0000 7f5273fff640 1 -- 172.21.15.113:0/4268212920 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5280005990 con 0x7f528c1553c0 2024-04-22T06:34:58.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.212+0000 7f5273fff640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f527806c8f0 0x7f527806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.212+0000 7f5273fff640 1 -- 172.21.15.113:0/4268212920 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f528008bfa0 con 0x7f528c1553c0 2024-04-22T06:34:58.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.212+0000 7f528b7fe640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f527806c8f0 0x7f527806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.212+0000 7f528b7fe640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f527806c8f0 0x7f527806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f527c0010e0 tx=0x7f527c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.216+0000 7f5273fff640 1 -- 172.21.15.113:0/4268212920 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5280022020 con 0x7f528c1553c0 2024-04-22T06:34:58.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.391+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f528c0cc0e0 con 0x7f528c1553c0 2024-04-22T06:34:58.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.391+0000 7f5273fff640 1 -- 172.21.15.113:0/4268212920 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f528005a060 con 0x7f528c1553c0 2024-04-22T06:34:58.391 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:34:58.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f527806c8f0 msgr2=0x7f527806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f527806c8f0 0x7f527806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f527c0010e0 tx=0x7f527c009040 comp rx=0 tx=0).stop 2024-04-22T06:34:58.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c1553c0 msgr2=0x7f528c0cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c1553c0 0x7f528c0cfb80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f528000d800 tx=0x7f528000dcc0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 shutdown_connections 2024-04-22T06:34:58.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f528c15b070 0x7f528c14b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f527806c8f0 0x7f527806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f528c1553c0 0x7f528c0cfb80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 --2- 172.21.15.113:0/4268212920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f528c0cbae0 0x7f528c15d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 >> 172.21.15.113:0/4268212920 conn(0x7f528c072360 msgr2=0x7f528c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:58.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.393+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 shutdown_connections 2024-04-22T06:34:58.394 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.394+0000 7f5291f04640 1 -- 172.21.15.113:0/4268212920 wait complete. 2024-04-22T06:34:58.404 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:34:58.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.504+0000 7f9b7c1ef640 1 Processor -- start 2024-04-22T06:34:58.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.504+0000 7f9b7c1ef640 1 -- start start 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b7c1ef640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9b7415d190 0x7f9b74073d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b7c1ef640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b7415e950 con 0x7f9b74155250 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b7c1ef640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b7415f470 con 0x7f9b74074360 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b7c1ef640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7415ebf0 con 0x7f9b7415d190 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b79f8b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9b74155250 0x7f9b740ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39764/0 (socket says 172.21.15.113:39764) 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b79f8b640 1 -- 172.21.15.113:0/3886514853 learned_addr learned my addr 172.21.15.113:0/3886514853 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b7a78c640 1 --2- 172.21.15.113:0/3886514853 >> v2:172.21.15.145:3300/0 conn(0x7f9b7415d190 0x7f9b74073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899392913 0 0) 0x7f9b7415e950 con 0x7f9b74155250 2024-04-22T06:34:58.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b60003520 con 0x7f9b74155250 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.505+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 328159024 0 0) 0x7f9b60003520 con 0x7f9b74155250 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 >> v2:172.21.15.145:3300/0 conn(0x7f9b7415d190 msgr2=0x7f9b74073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 --2- 172.21.15.113:0/3886514853 >> v2:172.21.15.145:3300/0 conn(0x7f9b7415d190 0x7f9b74073d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 >> v1:172.21.15.145:6789/0 conn(0x7f9b74074360 legacy=0x7f9b7415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7415eeb0 con 0x7f9b74155250 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f9b700019f0 con 0x7f9b74155250 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 >> v1:172.21.15.113:6789/0 conn(0x7f9b74155250 legacy=0x7f9b740ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b600039b0 0x7f9b60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b60004800 0x7f9b60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b600051c0 0x7f9b6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7415ebf0 con 0x7f9b60004800 2024-04-22T06:34:58.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6000c060 con 0x7f9b600039b0 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6000c260 con 0x7f9b600051c0 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7978a640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b60004800 0x7f9b60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b79f8b640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b600039b0 0x7f9b60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7a78c640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b600051c0 0x7f9b6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7978a640 1 -- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b600051c0 msgr2=0x7f9b6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7978a640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b600051c0 0x7f9b6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7978a640 1 -- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b600039b0 msgr2=0x7f9b60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7978a640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b600039b0 0x7f9b60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7978a640 1 -- 172.21.15.113:0/3886514853 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b60003520 con 0x7f9b60004800 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7a78c640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b600051c0 0x7f9b6000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.506+0000 7f9b7a78c640 1 -- 172.21.15.113:0/3886514853 reap_dead start 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b7978a640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b60004800 0x7f9b60004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9b64001750 tx=0x7f9b60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef09bd1394956977 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64001370 con 0x7f9b60004800 2024-04-22T06:34:58.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b640052d0 con 0x7f9b60004800 2024-04-22T06:34:58.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b78f89640 1 -- 172.21.15.113:0/3886514853 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64003830 con 0x7f9b60004800 2024-04-22T06:34:58.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/3886514853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b60004800 msgr2=0x7f9b60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b7c1ef640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b60004800 0x7f9b60004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9b64001750 tx=0x7f9b60005830 comp rx=0 tx=0).stop 2024-04-22T06:34:58.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/3886514853 shutdown_connections 2024-04-22T06:34:58.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b7c1ef640 1 --2- 172.21.15.113:0/3886514853 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b60004800 0x7f9b60004c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/3886514853 >> 172.21.15.113:0/3886514853 conn(0x7f9b74068570 msgr2=0x7f9b74074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:58.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/3886514853 shutdown_connections 2024-04-22T06:34:58.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.507+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/3886514853 wait complete. 2024-04-22T06:34:58.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7c1ef640 1 Processor -- start 2024-04-22T06:34:58.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7c1ef640 1 -- start start 2024-04-22T06:34:58.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7c1ef640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b60004800 0x7f9b741f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7c1ef640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b74150ee0 0x7f9b740ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7c1ef640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b740c56d0 0x7f9b7414b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7c1ef640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7406c3e0 con 0x7f9b740c56d0 2024-04-22T06:34:58.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7c1ef640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7415c560 con 0x7f9b60004800 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7c1ef640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9b74155630 con 0x7f9b74150ee0 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7a78c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b740c56d0 0x7f9b7414b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7a78c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b740c56d0 0x7f9b7414b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49500/0 (socket says 172.21.15.113:49500) 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.509+0000 7f9b7a78c640 1 -- 172.21.15.113:0/1394969598 learned_addr learned my addr 172.21.15.113:0/1394969598 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b79f8b640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b60004800 0x7f9b741f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7978a640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b74150ee0 0x7f9b740ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7a78c640 1 -- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b74150ee0 msgr2=0x7f9b740ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7a78c640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b74150ee0 0x7f9b740ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7a78c640 1 -- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b60004800 msgr2=0x7f9b741f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7a78c640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b60004800 0x7f9b741f1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7a78c640 1 -- 172.21.15.113:0/1394969598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7414e860 con 0x7f9b740c56d0 2024-04-22T06:34:58.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b79f8b640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b60004800 0x7f9b741f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7a78c640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b740c56d0 0x7f9b7414b0f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9b74070590 tx=0x7f9b6c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b6a7fc640 1 -- 172.21.15.113:0/1394969598 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c003610 con 0x7f9b740c56d0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b6a7fc640 1 -- 172.21.15.113:0/1394969598 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b6c01b070 con 0x7f9b740c56d0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b6a7fc640 1 -- 172.21.15.113:0/1394969598 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0039f0 con 0x7f9b740c56d0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7414f3a0 con 0x7f9b740c56d0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.510+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7414ede0 con 0x7f9b740c56d0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.511+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b74074080 con 0x7f9b740c56d0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.511+0000 7f9b6a7fc640 1 -- 172.21.15.113:0/1394969598 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b6c003b90 con 0x7f9b740c56d0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.512+0000 7f9b6a7fc640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9b5806c8f0 0x7f9b5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.512+0000 7f9b6a7fc640 1 -- 172.21.15.113:0/1394969598 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9b6c08c120 con 0x7f9b740c56d0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.512+0000 7f9b79f8b640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9b5806c8f0 0x7f9b5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.512+0000 7f9b79f8b640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9b5806c8f0 0x7f9b5806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b70004b60 tx=0x7f9b70006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.516+0000 7f9b6a7fc640 1 -- 172.21.15.113:0/1394969598 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b74074080 con 0x7f9b740c56d0 2024-04-22T06:34:58.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.690+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9b74068f50 con 0x7f9b740c56d0 2024-04-22T06:34:58.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.691+0000 7f9b6a7fc640 1 -- 172.21.15.113:0/1394969598 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f9b6c025020 con 0x7f9b740c56d0 2024-04-22T06:34:58.690 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:34:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9b5806c8f0 msgr2=0x7f9b5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9b5806c8f0 0x7f9b5806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b70004b60 tx=0x7f9b70006040 comp rx=0 tx=0).stop 2024-04-22T06:34:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b740c56d0 msgr2=0x7f9b7414b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b740c56d0 0x7f9b7414b0f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9b74070590 tx=0x7f9b6c011920 comp rx=0 tx=0).stop 2024-04-22T06:34:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 shutdown_connections 2024-04-22T06:34:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9b5806c8f0 0x7f9b5806edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9b740c56d0 0x7f9b7414b0f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9b74150ee0 0x7f9b740ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 --2- 172.21.15.113:0/1394969598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b60004800 0x7f9b741f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 >> 172.21.15.113:0/1394969598 conn(0x7f9b74068570 msgr2=0x7f9b740cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 shutdown_connections 2024-04-22T06:34:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.693+0000 7f9b7c1ef640 1 -- 172.21.15.113:0/1394969598 wait complete. 2024-04-22T06:34:58.703 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:34:58.802 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.803+0000 7f4523115640 1 Processor -- start 2024-04-22T06:34:58.802 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.803+0000 7f4523115640 1 -- start start 2024-04-22T06:34:58.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.803+0000 7f4523115640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f451c1553c0 0x7f451c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.803+0000 7f4523115640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f451c15f310 0x7f451c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.803+0000 7f4523115640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 0x7f451c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.803+0000 7f4523115640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f451c15e660 con 0x7f451c1553c0 2024-04-22T06:34:58.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.803+0000 7f4523115640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f451c1557a0 con 0x7f451c15f310 2024-04-22T06:34:58.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.803+0000 7f4523115640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f451c0c5c80 con 0x7f451c15b070 2024-04-22T06:34:58.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f4520eb1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f451c1553c0 0x7f451c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f4520eb1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f451c1553c0 0x7f451c15edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49502/0 (socket says 172.21.15.113:49502) 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f4520eb1640 1 -- 172.21.15.113:0/2413664101 learned_addr learned my addr 172.21.15.113:0/2413664101 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f451bfff640 1 --2- 172.21.15.113:0/2413664101 >> v2:172.21.15.145:3300/0 conn(0x7f451c15f310 0x7f451c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f45216b2640 1 --2- 172.21.15.113:0/2413664101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 0x7f451c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f4520eb1640 1 -- 172.21.15.113:0/2413664101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 msgr2=0x7f451c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f4520eb1640 1 --2- 172.21.15.113:0/2413664101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 0x7f451c0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f4520eb1640 1 -- 172.21.15.113:0/2413664101 >> v2:172.21.15.145:3300/0 conn(0x7f451c15f310 msgr2=0x7f451c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f4520eb1640 1 --2- 172.21.15.113:0/2413664101 >> v2:172.21.15.145:3300/0 conn(0x7f451c15f310 0x7f451c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.804+0000 7f4520eb1640 1 -- 172.21.15.113:0/2413664101 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c15b5d0 con 0x7f451c1553c0 2024-04-22T06:34:58.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4520eb1640 1 --2- 172.21.15.113:0/2413664101 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c1553c0 0x7f451c15edd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f451c08ea60 tx=0x7f451002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c79f53263d39b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f451b7fe640 1 -- 172.21.15.113:0/2413664101 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451002d040 con 0x7f451c1553c0 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f451b7fe640 1 -- 172.21.15.113:0/2413664101 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4510004230 con 0x7f451c1553c0 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f451b7fe640 1 -- 172.21.15.113:0/2413664101 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510003610 con 0x7f451c1553c0 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 -- 172.21.15.113:0/2413664101 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c1553c0 msgr2=0x7f451c15edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 --2- 172.21.15.113:0/2413664101 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c1553c0 0x7f451c15edd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f451c08ea60 tx=0x7f451002b8f0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 -- 172.21.15.113:0/2413664101 shutdown_connections 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 --2- 172.21.15.113:0/2413664101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 0x7f451c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 --2- 172.21.15.113:0/2413664101 >> v2:172.21.15.145:3300/0 conn(0x7f451c15f310 0x7f451c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 --2- 172.21.15.113:0/2413664101 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c1553c0 0x7f451c15edd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 -- 172.21.15.113:0/2413664101 >> 172.21.15.113:0/2413664101 conn(0x7f451c072360 msgr2=0x7f451c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:58.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 -- 172.21.15.113:0/2413664101 shutdown_connections 2024-04-22T06:34:58.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.805+0000 7f4523115640 1 -- 172.21.15.113:0/2413664101 wait complete. 2024-04-22T06:34:58.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.806+0000 7f4523115640 1 Processor -- start 2024-04-22T06:34:58.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.806+0000 7f4523115640 1 -- start start 2024-04-22T06:34:58.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f4523115640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f451c1553c0 0x7f451c1e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f4523115640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 0x7f451c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f4523115640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c15f310 0x7f451c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f4523115640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f451c15be70 con 0x7f451c15f310 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f4523115640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f451c15bb90 con 0x7f451c1553c0 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f4523115640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f451c15e8b0 con 0x7f451c15b070 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f45216b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c15f310 0x7f451c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f45216b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c15f310 0x7f451c156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49506/0 (socket says 172.21.15.113:49506) 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f45216b2640 1 -- 172.21.15.113:0/848324072 learned_addr learned my addr 172.21.15.113:0/848324072 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.807+0000 7f4520eb1640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f451c1553c0 0x7f451c1e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f451bfff640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 0x7f451c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45216b2640 1 -- 172.21.15.113:0/848324072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 msgr2=0x7f451c157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45216b2640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 0x7f451c157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45216b2640 1 -- 172.21.15.113:0/848324072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f451c1553c0 msgr2=0x7f451c1e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45216b2640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f451c1553c0 0x7f451c1e6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45216b2640 1 -- 172.21.15.113:0/848324072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c155bb0 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45216b2640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c15f310 0x7f451c156c50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4514007e60 tx=0x7f451400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45197fa640 1 -- 172.21.15.113:0/848324072 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514014620 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45197fa640 1 -- 172.21.15.113:0/848324072 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4514019070 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c155e90 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f45197fa640 1 -- 172.21.15.113:0/848324072 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514014a20 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.808+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c156450 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.809+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451c068f50 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.810+0000 7f45197fa640 1 -- 172.21.15.113:0/848324072 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4514014bc0 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.810+0000 7f45197fa640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f450006c920 0x7f450006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.810+0000 7f45197fa640 1 -- 172.21.15.113:0/848324072 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f451408c6c0 con 0x7f451c15f310 2024-04-22T06:34:58.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.810+0000 7f4520eb1640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f450006c920 0x7f450006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:58.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.811+0000 7f4520eb1640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f450006c920 0x7f450006ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4510035000 tx=0x7f451003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:58.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.814+0000 7f45197fa640 1 -- 172.21.15.113:0/848324072 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f451405a010 con 0x7f451c15f310 2024-04-22T06:34:58.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.989+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f451c0b6180 con 0x7f451c15f310 2024-04-22T06:34:58.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.989+0000 7f45197fa640 1 -- 172.21.15.113:0/848324072 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f451405e310 con 0x7f451c15f310 2024-04-22T06:34:58.989 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:34:58.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f450006c920 msgr2=0x7f450006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f450006c920 0x7f450006ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4510035000 tx=0x7f451003c040 comp rx=0 tx=0).stop 2024-04-22T06:34:58.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c15f310 msgr2=0x7f451c156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:58.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c15f310 0x7f451c156c50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4514007e60 tx=0x7f451400e4b0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 shutdown_connections 2024-04-22T06:34:58.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f450006c920 0x7f450006ede0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f451c15f310 0x7f451c156c50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f451c15b070 0x7f451c157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 --2- 172.21.15.113:0/848324072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f451c1553c0 0x7f451c1e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:58.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 >> 172.21.15.113:0/848324072 conn(0x7f451c072360 msgr2=0x7f451c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:58.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 shutdown_connections 2024-04-22T06:34:58.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:58.991+0000 7f4523115640 1 -- 172.21.15.113:0/848324072 wait complete. 2024-04-22T06:34:59.002 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T06:34:59.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.100+0000 7f4a69eeb640 1 Processor -- start 2024-04-22T06:34:59.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.100+0000 7f4a69eeb640 1 -- start start 2024-04-22T06:34:59.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a69eeb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4a64151ea0 0x7f4a640c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a69eeb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a64152280 0x7f4a640c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a69eeb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a6415b610 con 0x7f4a640c3cb0 2024-04-22T06:34:59.103 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a69eeb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f4a6406f300 con 0x7f4a64151ea0 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a69eeb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6406e6f0 con 0x7f4a64152280 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a63fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4a640c3cb0 0x7f4a641591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39780/0 (socket says 172.21.15.113:39780) 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a63fff640 1 -- 172.21.15.113:0/2628464823 learned_addr learned my addr 172.21.15.113:0/2628464823 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a62ffd640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a64152280 0x7f4a640c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a637fe640 1 --2- 172.21.15.113:0/2628464823 >> v2:172.21.15.145:3300/0 conn(0x7f4a64151ea0 0x7f4a640c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606466907 0 0) 0x7f4a6415b610 con 0x7f4a640c3cb0 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a4c003520 con 0x7f4a640c3cb0 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1017487009 0 0) 0x7f4a4c003520 con 0x7f4a640c3cb0 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a64152280 msgr2=0x7f4a640c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a64152280 0x7f4a640c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.104 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 >> v2:172.21.15.145:3300/0 conn(0x7f4a64151ea0 msgr2=0x7f4a640c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 --2- 172.21.15.113:0/2628464823 >> v2:172.21.15.145:3300/0 conn(0x7f4a64151ea0 0x7f4a640c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6406e9d0 con 0x7f4a640c3cb0 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f4a5c0019f0 con 0x7f4a640c3cb0 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 >> v1:172.21.15.113:6789/0 conn(0x7f4a640c3cb0 legacy=0x7f4a641591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c0039b0 0x7f4a4c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c004800 0x7f4a4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.101+0000 7f4a627fc640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a4c005180 0x7f4a4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6406f300 con 0x7f4a4c005180 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6406e6f0 con 0x7f4a4c0039b0 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4a4c00e110 con 0x7f4a4c004800 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a63fff640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a4c005180 0x7f4a4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a637fe640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c0039b0 0x7f4a4c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a62ffd640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c004800 0x7f4a4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a63fff640 1 -- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c004800 msgr2=0x7f4a4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a63fff640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c004800 0x7f4a4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a63fff640 1 -- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c0039b0 msgr2=0x7f4a4c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a63fff640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c0039b0 0x7f4a4c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.102+0000 7f4a63fff640 1 -- 172.21.15.113:0/2628464823 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4c003520 con 0x7f4a4c005180 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a63fff640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a4c005180 0x7f4a4c00b9c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00a880 tx=0x7f4a4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2239adf968dd69c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c00a4a0 con 0x7f4a4c005180 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c034650 con 0x7f4a4c005180 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a627fc640 1 -- 172.21.15.113:0/2628464823 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c034a40 con 0x7f4a4c005180 2024-04-22T06:34:59.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2628464823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a4c005180 msgr2=0x7f4a4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a69eeb640 1 --2- 172.21.15.113:0/2628464823 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a4c005180 0x7f4a4c00b9c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00a880 tx=0x7f4a4c005830 comp rx=0 tx=0).stop 2024-04-22T06:34:59.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a63fff640 1 -- 172.21.15.113:0/2628464823 reap_dead start 2024-04-22T06:34:59.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2628464823 shutdown_connections 2024-04-22T06:34:59.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2628464823 >> 172.21.15.113:0/2628464823 conn(0x7f4a640c8f00 msgr2=0x7f4a640c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:59.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2628464823 shutdown_connections 2024-04-22T06:34:59.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.103+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2628464823 wait complete. 2024-04-22T06:34:59.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.104+0000 7f4a69eeb640 1 Processor -- start 2024-04-22T06:34:59.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a69eeb640 1 -- start start 2024-04-22T06:34:59.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a69eeb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a640c5ca0 0x7f4a641ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a69eeb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a640c6080 0x7f4a641eff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a69eeb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a641ef880 0x7f4a641f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a69eeb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640c8cb0 con 0x7f4a640c6080 2024-04-22T06:34:59.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a69eeb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6406ef90 con 0x7f4a640c5ca0 2024-04-22T06:34:59.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a69eeb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6415b2d0 con 0x7f4a641ef880 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a62ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a640c6080 0x7f4a641eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a62ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a640c6080 0x7f4a641eff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49528/0 (socket says 172.21.15.113:49528) 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a62ffd640 1 -- 172.21.15.113:0/2420527935 learned_addr learned my addr 172.21.15.113:0/2420527935 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a637fe640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a640c5ca0 0x7f4a641ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.105+0000 7f4a63fff640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a641ef880 0x7f4a641f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a62ffd640 1 -- 172.21.15.113:0/2420527935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a641ef880 msgr2=0x7f4a641f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a62ffd640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a641ef880 0x7f4a641f0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a62ffd640 1 -- 172.21.15.113:0/2420527935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a640c5ca0 msgr2=0x7f4a641ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a62ffd640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a640c5ca0 0x7f4a641ecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a62ffd640 1 -- 172.21.15.113:0/2420527935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6414e9d0 con 0x7f4a640c6080 2024-04-22T06:34:59.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a62ffd640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a640c6080 0x7f4a641eff00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4a580119a0 tx=0x7f4a58011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a4bfff640 1 -- 172.21.15.113:0/2420527935 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800fa30 con 0x7f4a640c6080 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a4bfff640 1 -- 172.21.15.113:0/2420527935 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5800fbd0 con 0x7f4a640c6080 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a641ed260 con 0x7f4a640c6080 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a4bfff640 1 -- 172.21.15.113:0/2420527935 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58014440 con 0x7f4a640c6080 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.106+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a64141d80 con 0x7f4a640c6080 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.107+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a64068e40 con 0x7f4a640c6080 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.107+0000 7f4a4bfff640 1 -- 172.21.15.113:0/2420527935 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a58012040 con 0x7f4a640c6080 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.108+0000 7f4a4bfff640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4a5006c8f0 0x7f4a5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.108+0000 7f4a637fe640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4a5006c8f0 0x7f4a5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.108+0000 7f4a4bfff640 1 -- 172.21.15.113:0/2420527935 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4a5808c560 con 0x7f4a640c6080 2024-04-22T06:34:59.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.108+0000 7f4a637fe640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4a5006c8f0 0x7f4a5006edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009bc0 tx=0x7f4a54009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.112+0000 7f4a4bfff640 1 -- 172.21.15.113:0/2420527935 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a58019030 con 0x7f4a640c6080 2024-04-22T06:34:59.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.305+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a64072100 con 0x7f4a640c6080 2024-04-22T06:34:59.305 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.305+0000 7f4a4bfff640 1 -- 172.21.15.113:0/2420527935 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f4a5805a590 con 0x7f4a640c6080 2024-04-22T06:34:59.305 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4a5006c8f0 msgr2=0x7f4a5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4a5006c8f0 0x7f4a5006edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009bc0 tx=0x7f4a54009190 comp rx=0 tx=0).stop 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a640c6080 msgr2=0x7f4a641eff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a640c6080 0x7f4a641eff00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4a580119a0 tx=0x7f4a58011da0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 shutdown_connections 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a641ef880 0x7f4a641f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f4a5006c8f0 0x7f4a5006edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a640c6080 0x7f4a641eff00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 --2- 172.21.15.113:0/2420527935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a640c5ca0 0x7f4a641ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 >> 172.21.15.113:0/2420527935 conn(0x7f4a640c8f00 msgr2=0x7f4a6414fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:59.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 shutdown_connections 2024-04-22T06:34:59.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.307+0000 7f4a69eeb640 1 -- 172.21.15.113:0/2420527935 wait complete. 2024-04-22T06:34:59.318 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:34:59.318 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T06:34:59.333 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:34:59.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.470+0000 7fb1e0bce640 1 Processor -- start 2024-04-22T06:34:59.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.470+0000 7fb1e0bce640 1 -- start start 2024-04-22T06:34:59.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1e0bce640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb1dc155380 0x7fb1dc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1e0bce640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc0c92f0 0x7fb1dc0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1e0bce640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1dc15b5a0 con 0x7fb1dc15b0f0 2024-04-22T06:34:59.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1e0bce640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb1dc06fab0 con 0x7fb1dc155380 2024-04-22T06:34:59.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1e0bce640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb1dc15b880 con 0x7fb1dc0c92f0 2024-04-22T06:34:59.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d3fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb1dc15b0f0 0x7fb1dc06ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39796/0 (socket says 172.21.15.113:39796) 2024-04-22T06:34:59.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d3fff640 1 -- 172.21.15.113:0/2418839470 learned_addr learned my addr 172.21.15.113:0/2418839470 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737577822 0 0) 0x7fb1dc15b5a0 con 0x7fb1dc15b0f0 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1da59c640 1 --2- 172.21.15.113:0/2418839470 >> v2:172.21.15.145:3300/0 conn(0x7fb1dc155380 0x7fb1dc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1c8003520 con 0x7fb1dc15b0f0 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1dad9d640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc0c92f0 0x7fb1dc0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3680698401 0 0) 0x7fb1c8003520 con 0x7fb1dc15b0f0 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc0c92f0 msgr2=0x7fb1dc0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc0c92f0 0x7fb1dc0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 >> v2:172.21.15.145:3300/0 conn(0x7fb1dc155380 msgr2=0x7fb1dc0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 --2- 172.21.15.113:0/2418839470 >> v2:172.21.15.145:3300/0 conn(0x7fb1dc155380 0x7fb1dc0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc15bb60 con 0x7fb1dc15b0f0 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fb1c4001670 con 0x7fb1dc15b0f0 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 >> v1:172.21.15.113:6789/0 conn(0x7fb1dc15b0f0 legacy=0x7fb1dc06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc0c92f0 0x7fb1c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.471+0000 7fb1d9d9b640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1c8004d40 0x7fb1c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc06fab0 con 0x7fb1c8003f30 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc15b880 con 0x7fb1c8004d40 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c800ba10 con 0x7fb1dc0c92f0 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d3fff640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1da59c640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc0c92f0 0x7fb1c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1dad9d640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1c8004d40 0x7fb1c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d3fff640 1 -- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc0c92f0 msgr2=0x7fb1c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d3fff640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc0c92f0 0x7fb1c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d3fff640 1 -- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1c8004d40 msgr2=0x7fb1c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d3fff640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1c8004d40 0x7fb1c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.472+0000 7fb1d3fff640 1 -- 172.21.15.113:0/2418839470 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c8003520 con 0x7fb1c8003f30 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1d3fff640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1c8004800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400c210 tx=0x7fb1c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988b744d74d5aeeb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4007d70 con 0x7fb1c8003f30 2024-04-22T06:34:59.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c4030070 con 0x7fb1c8003f30 2024-04-22T06:34:59.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1d9d9b640 1 -- 172.21.15.113:0/2418839470 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c402cd60 con 0x7fb1c8003f30 2024-04-22T06:34:59.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1e0bce640 1 -- 172.21.15.113:0/2418839470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 msgr2=0x7fb1c8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1e0bce640 1 --2- 172.21.15.113:0/2418839470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1c8004800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400c210 tx=0x7fb1c8005830 comp rx=0 tx=0).stop 2024-04-22T06:34:59.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1dad9d640 1 -- 172.21.15.113:0/2418839470 reap_dead start 2024-04-22T06:34:59.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1e0bce640 1 -- 172.21.15.113:0/2418839470 shutdown_connections 2024-04-22T06:34:59.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1e0bce640 1 -- 172.21.15.113:0/2418839470 >> 172.21.15.113:0/2418839470 conn(0x7fb1dc0ca0d0 msgr2=0x7fb1dc0ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:59.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1e0bce640 1 -- 172.21.15.113:0/2418839470 shutdown_connections 2024-04-22T06:34:59.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.473+0000 7fb1e0bce640 1 -- 172.21.15.113:0/2418839470 wait complete. 2024-04-22T06:34:59.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1e0bce640 1 Processor -- start 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1e0bce640 1 -- start start 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1e0bce640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1dc0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1e0bce640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc14ef70 0x7fb1dc1485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1e0bce640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1dc148b20 0x7fb1dc0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1e0bce640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc0c8510 con 0x7fb1c8003f30 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1e0bce640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc155760 con 0x7fb1dc148b20 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1e0bce640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb1dc0c8690 con 0x7fb1dc14ef70 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1da59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1dc0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1da59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1dc0cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49540/0 (socket says 172.21.15.113:49540) 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1da59c640 1 -- 172.21.15.113:0/3866753571 learned_addr learned my addr 172.21.15.113:0/3866753571 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1d3fff640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc14ef70 0x7fb1dc1485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.475+0000 7fb1dad9d640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1dc148b20 0x7fb1dc0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1da59c640 1 -- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc14ef70 msgr2=0x7fb1dc1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1da59c640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc14ef70 0x7fb1dc1485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1da59c640 1 -- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1dc148b20 msgr2=0x7fb1dc0c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1da59c640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1dc148b20 0x7fb1dc0c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1da59c640 1 -- 172.21.15.113:0/3866753571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc151480 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1dad9d640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1dc148b20 0x7fb1dc0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1da59c640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1dc0cd760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc011990 tx=0x7fb1cc011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1d2ffd640 1 -- 172.21.15.113:0/3866753571 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00fad0 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1d2ffd640 1 -- 172.21.15.113:0/3866753571 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc00fc70 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1dc151720 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1d2ffd640 1 -- 172.21.15.113:0/3866753571 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc014440 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.476+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1dc1519c0 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.477+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1dc068e20 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.477+0000 7fb1d2ffd640 1 -- 172.21.15.113:0/3866753571 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1cc012040 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.478+0000 7fb1d2ffd640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb1bc06c920 0x7fb1bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.478+0000 7fb1d2ffd640 1 -- 172.21.15.113:0/3866753571 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb1cc08c5f0 con 0x7fb1c8003f30 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.478+0000 7fb1d3fff640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb1bc06c920 0x7fb1bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.478+0000 7fb1d3fff640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb1bc06c920 0x7fb1bc06ede0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4034000 tx=0x7fb1c4007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.482+0000 7fb1d2ffd640 1 -- 172.21.15.113:0/3866753571 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1cc019030 con 0x7fb1c8003f30 2024-04-22T06:34:59.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.660+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1dc0c4730 con 0x7fb1c8003f30 2024-04-22T06:34:59.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.661+0000 7fb1d2ffd640 1 -- 172.21.15.113:0/3866753571 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7fb1cc05a590 con 0x7fb1c8003f30 2024-04-22T06:34:59.661 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:34:59.661 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:34:59.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb1bc06c920 msgr2=0x7fb1bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb1bc06c920 0x7fb1bc06ede0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4034000 tx=0x7fb1c4007000 comp rx=0 tx=0).stop 2024-04-22T06:34:59.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 msgr2=0x7fb1dc0cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1dc0cd760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc011990 tx=0x7fb1cc011e50 comp rx=0 tx=0).stop 2024-04-22T06:34:59.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 shutdown_connections 2024-04-22T06:34:59.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1dc148b20 0x7fb1dc0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb1dc14ef70 0x7fb1dc1485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fb1bc06c920 0x7fb1bc06ede0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 --2- 172.21.15.113:0/3866753571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1c8003f30 0x7fb1dc0cd760 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 >> 172.21.15.113:0/3866753571 conn(0x7fb1dc0ca0d0 msgr2=0x7fb1dc0c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:59.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 shutdown_connections 2024-04-22T06:34:59.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.663+0000 7fb1e0bce640 1 -- 172.21.15.113:0/3866753571 wait complete. 2024-04-22T06:34:59.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:34:59.674 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:34:59.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.774+0000 7f9abe4e4640 1 Processor -- start 2024-04-22T06:34:59.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.774+0000 7f9abe4e4640 1 -- start start 2024-04-22T06:34:59.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9abe4e4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ab81553c0 0x7f9ab815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9abe4e4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab815f310 0x7f9ab80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9abe4e4640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9ab815b070 0x7f9ab80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9abe4e4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab815e660 con 0x7f9ab81553c0 2024-04-22T06:34:59.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9abe4e4640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab81557a0 con 0x7f9ab815b070 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9abe4e4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab80c5c80 con 0x7f9ab815f310 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9ab7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ab81553c0 0x7f9ab815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9ab7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9ab81553c0 0x7f9ab815edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49548/0 (socket says 172.21.15.113:49548) 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.775+0000 7f9ab7fff640 1 -- 172.21.15.113:0/499864573 learned_addr learned my addr 172.21.15.113:0/499864573 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9ab77fe640 1 --2- 172.21.15.113:0/499864573 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab815f310 0x7f9ab80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9abca81640 1 --2- 172.21.15.113:0/499864573 >> v2:172.21.15.145:3300/0 conn(0x7f9ab815b070 0x7f9ab80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9ab7fff640 1 -- 172.21.15.113:0/499864573 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab815f310 msgr2=0x7f9ab80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9ab7fff640 1 --2- 172.21.15.113:0/499864573 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab815f310 0x7f9ab80cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9ab7fff640 1 -- 172.21.15.113:0/499864573 >> v2:172.21.15.145:3300/0 conn(0x7f9ab815b070 msgr2=0x7f9ab80cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9ab7fff640 1 --2- 172.21.15.113:0/499864573 >> v2:172.21.15.145:3300/0 conn(0x7f9ab815b070 0x7f9ab80cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9ab7fff640 1 -- 172.21.15.113:0/499864573 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab815b5d0 con 0x7f9ab81553c0 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9abca81640 1 --2- 172.21.15.113:0/499864573 >> v2:172.21.15.145:3300/0 conn(0x7f9ab815b070 0x7f9ab80cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:34:59.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9ab7fff640 1 --2- 172.21.15.113:0/499864573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab81553c0 0x7f9ab815edd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ab806c830 tx=0x7f9aa802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a5cd97b822f358 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.776+0000 7f9ab6ffd640 1 -- 172.21.15.113:0/499864573 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa802d040 con 0x7f9ab81553c0 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9ab6ffd640 1 -- 172.21.15.113:0/499864573 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa8004230 con 0x7f9ab81553c0 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9ab6ffd640 1 -- 172.21.15.113:0/499864573 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8003610 con 0x7f9ab81553c0 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 -- 172.21.15.113:0/499864573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab81553c0 msgr2=0x7f9ab815edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/499864573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab81553c0 0x7f9ab815edd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ab806c830 tx=0x7f9aa802b8f0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 -- 172.21.15.113:0/499864573 shutdown_connections 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/499864573 >> v2:172.21.15.145:3300/0 conn(0x7f9ab815b070 0x7f9ab80cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/499864573 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab815f310 0x7f9ab80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/499864573 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab81553c0 0x7f9ab815edd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 -- 172.21.15.113:0/499864573 >> 172.21.15.113:0/499864573 conn(0x7f9ab8072360 msgr2=0x7f9ab8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 -- 172.21.15.113:0/499864573 shutdown_connections 2024-04-22T06:34:59.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.777+0000 7f9abe4e4640 1 -- 172.21.15.113:0/499864573 wait complete. 2024-04-22T06:34:59.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.778+0000 7f9abe4e4640 1 Processor -- start 2024-04-22T06:34:59.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.778+0000 7f9abe4e4640 1 -- start start 2024-04-22T06:34:59.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abe4e4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab81553c0 0x7f9ab8159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abe4e4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ab815b070 0x7f9ab81f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abe4e4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab815f310 0x7f9ab81e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abe4e4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab815be70 con 0x7f9ab815f310 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abe4e4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab815bb90 con 0x7f9ab815b070 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abe4e4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab815e8b0 con 0x7f9ab81553c0 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abca81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab815f310 0x7f9ab81e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abca81640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab815f310 0x7f9ab81e44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49554/0 (socket says 172.21.15.113:49554) 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abca81640 1 -- 172.21.15.113:0/481760174 learned_addr learned my addr 172.21.15.113:0/481760174 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9ab7fff640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab81553c0 0x7f9ab8159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9ab77fe640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ab815b070 0x7f9ab81f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abca81640 1 -- 172.21.15.113:0/481760174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab81553c0 msgr2=0x7f9ab8159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abca81640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab81553c0 0x7f9ab8159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abca81640 1 -- 172.21.15.113:0/481760174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ab815b070 msgr2=0x7f9ab81f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.779+0000 7f9abca81640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ab815b070 0x7f9ab81f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.780+0000 7f9abca81640 1 -- 172.21.15.113:0/481760174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab80ce800 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.780+0000 7f9abca81640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab815f310 0x7f9ab81e44c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000cef0 tx=0x7f9ab000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.780+0000 7f9ab4ff9640 1 -- 172.21.15.113:0/481760174 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab001a070 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.780+0000 7f9ab4ff9640 1 -- 172.21.15.113:0/481760174 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab000d840 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.780+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab8156110 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.780+0000 7f9ab4ff9640 1 -- 172.21.15.113:0/481760174 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000dc30 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.780+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab80cf1f0 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.781+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab8068f50 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.781+0000 7f9ab4ff9640 1 -- 172.21.15.113:0/481760174 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ab001d070 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.782+0000 7f9ab4ff9640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9aa406c920 0x7f9aa406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.782+0000 7f9ab7fff640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9aa406c920 0x7f9aa406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.782+0000 7f9ab4ff9640 1 -- 172.21.15.113:0/481760174 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9ab008c810 con 0x7f9ab815f310 2024-04-22T06:34:59.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.782+0000 7f9ab7fff640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9aa406c920 0x7f9aa406ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8035000 tx=0x7f9aa8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:34:59.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.786+0000 7f9ab4ff9640 1 -- 172.21.15.113:0/481760174 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ab005a7b0 con 0x7f9ab815f310 2024-04-22T06:34:59.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.962+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9ab80cc0e0 con 0x7f9ab815f310 2024-04-22T06:34:59.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.963+0000 7f9ab4ff9640 1 -- 172.21.15.113:0/481760174 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f9ab005a0b0 con 0x7f9ab815f310 2024-04-22T06:34:59.963 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:34:59.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9aa406c920 msgr2=0x7f9aa406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9aa406c920 0x7f9aa406ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8035000 tx=0x7f9aa8008030 comp rx=0 tx=0).stop 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab815f310 msgr2=0x7f9ab81e44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab815f310 0x7f9ab81e44c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000cef0 tx=0x7f9ab000a710 comp rx=0 tx=0).stop 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 shutdown_connections 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9aa406c920 0x7f9aa406ede0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9ab815f310 0x7f9ab81e44c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ab815b070 0x7f9ab81f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 --2- 172.21.15.113:0/481760174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ab81553c0 0x7f9ab8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 >> 172.21.15.113:0/481760174 conn(0x7f9ab8072360 msgr2=0x7f9ab80c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 shutdown_connections 2024-04-22T06:34:59.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:34:59.965+0000 7f9abe4e4640 1 -- 172.21.15.113:0/481760174 wait complete. 2024-04-22T06:34:59.975 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:35:00.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.076+0000 7fc49bad2640 1 Processor -- start 2024-04-22T06:35:00.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.076+0000 7fc49bad2640 1 -- start start 2024-04-22T06:35:00.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49bad2640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc494074360 0x7fc494073d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49bad2640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc49415e950 con 0x7fc49415ca80 2024-04-22T06:35:00.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49bad2640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc49415f470 con 0x7fc494155250 2024-04-22T06:35:00.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49bad2640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fc49415ebf0 con 0x7fc494074360 2024-04-22T06:35:00.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49a06f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc49415ca80 0x7fc49415ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39802/0 (socket says 172.21.15.113:39802) 2024-04-22T06:35:00.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49a06f640 1 -- 172.21.15.113:0/3191075662 learned_addr learned my addr 172.21.15.113:0/3191075662 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:00.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49906d640 1 --2- 172.21.15.113:0/3191075662 >> v2:172.21.15.145:3300/0 conn(0x7fc494074360 0x7fc494073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1120896484 0 0) 0x7fc49415e950 con 0x7fc49415ca80 2024-04-22T06:35:00.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc480003520 con 0x7fc49415ca80 2024-04-22T06:35:00.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2076012114 0 0) 0x7fc480003520 con 0x7fc49415ca80 2024-04-22T06:35:00.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 >> v2:172.21.15.145:3300/0 conn(0x7fc494074360 msgr2=0x7fc494073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 --2- 172.21.15.113:0/3191075662 >> v2:172.21.15.145:3300/0 conn(0x7fc494074360 0x7fc494073d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 >> v1:172.21.15.145:6789/0 conn(0x7fc494155250 legacy=0x7fc4940ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49415eeb0 con 0x7fc49415ca80 2024-04-22T06:35:00.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fc48c001a10 con 0x7fc49415ca80 2024-04-22T06:35:00.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 >> v1:172.21.15.113:6789/0 conn(0x7fc49415ca80 legacy=0x7fc49415ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4800039b0 0x7fc480003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004800 0x7fc480004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4800051c0 0x7fc48000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc49415ebf0 con 0x7fc480004800 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc48000c060 con 0x7fc4800039b0 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.077+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc48000c260 con 0x7fc4800051c0 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49906d640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004800 0x7fc480004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49986e640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4800039b0 0x7fc480003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49a06f640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4800051c0 0x7fc48000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49906d640 1 -- 172.21.15.113:0/3191075662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4800051c0 msgr2=0x7fc48000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49906d640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc4800051c0 0x7fc48000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49906d640 1 -- 172.21.15.113:0/3191075662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4800039b0 msgr2=0x7fc480003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49906d640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4800039b0 0x7fc480003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49906d640 1 -- 172.21.15.113:0/3191075662 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc480003520 con 0x7fc480004800 2024-04-22T06:35:00.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.078+0000 7fc49a06f640 1 -- 172.21.15.113:0/3191075662 reap_dead start 2024-04-22T06:35:00.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49906d640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004800 0x7fc480004c80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc484009ac0 tx=0x7fc480005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8baf964f3ae870e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484039070 con 0x7fc480004800 2024-04-22T06:35:00.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48402c6b0 con 0x7fc480004800 2024-04-22T06:35:00.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49886c640 1 -- 172.21.15.113:0/3191075662 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484009690 con 0x7fc480004800 2024-04-22T06:35:00.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49bad2640 1 -- 172.21.15.113:0/3191075662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004800 msgr2=0x7fc480004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49bad2640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004800 0x7fc480004c80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc484009ac0 tx=0x7fc480005830 comp rx=0 tx=0).stop 2024-04-22T06:35:00.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49bad2640 1 -- 172.21.15.113:0/3191075662 shutdown_connections 2024-04-22T06:35:00.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49bad2640 1 --2- 172.21.15.113:0/3191075662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc480004800 0x7fc480004c80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49bad2640 1 -- 172.21.15.113:0/3191075662 >> 172.21.15.113:0/3191075662 conn(0x7fc494068570 msgr2=0x7fc494074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:00.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49bad2640 1 -- 172.21.15.113:0/3191075662 shutdown_connections 2024-04-22T06:35:00.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.079+0000 7fc49bad2640 1 -- 172.21.15.113:0/3191075662 wait complete. 2024-04-22T06:35:00.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.080+0000 7fc49bad2640 1 Processor -- start 2024-04-22T06:35:00.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.080+0000 7fc49bad2640 1 -- start start 2024-04-22T06:35:00.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49bad2640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc480004800 0x7fc4941f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49bad2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4941e4370 0x7fc4940ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49bad2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc494156f50 0x7fc49414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49bad2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc49406c3e0 con 0x7fc4941e4370 2024-04-22T06:35:00.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49bad2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc49415c560 con 0x7fc494156f50 2024-04-22T06:35:00.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49bad2640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc494155630 con 0x7fc480004800 2024-04-22T06:35:00.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49906d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4941e4370 0x7fc4940ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49906d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4941e4370 0x7fc4940ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49582/0 (socket says 172.21.15.113:49582) 2024-04-22T06:35:00.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49906d640 1 -- 172.21.15.113:0/2481985241 learned_addr learned my addr 172.21.15.113:0/2481985241 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:00.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49986e640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc480004800 0x7fc4941f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49a06f640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc494156f50 0x7fc49414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49906d640 1 -- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc480004800 msgr2=0x7fc4941f15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49906d640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc480004800 0x7fc4941f15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49906d640 1 -- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc494156f50 msgr2=0x7fc49414af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49906d640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc494156f50 0x7fc49414af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49906d640 1 -- 172.21.15.113:0/2481985241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc494157920 con 0x7fc4941e4370 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49986e640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc480004800 0x7fc4941f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.081+0000 7fc49a06f640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc494156f50 0x7fc49414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.082+0000 7fc49906d640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4941e4370 0x7fc4940ce890 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc484037040 tx=0x7fc484004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.082+0000 7fc48a7fc640 1 -- 172.21.15.113:0/2481985241 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484042020 con 0x7fc4941e4370 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.082+0000 7fc48a7fc640 1 -- 172.21.15.113:0/2481985241 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48403a040 con 0x7fc4941e4370 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.082+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4941f0e20 con 0x7fc4941e4370 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.082+0000 7fc48a7fc640 1 -- 172.21.15.113:0/2481985241 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484039070 con 0x7fc4941e4370 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.082+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4941f10c0 con 0x7fc4941e4370 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.083+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4941f0c10 con 0x7fc4941e4370 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.083+0000 7fc48a7fc640 1 -- 172.21.15.113:0/2481985241 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc484045020 con 0x7fc4941e4370 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.084+0000 7fc48a7fc640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc47806c920 0x7fc47806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.084+0000 7fc49986e640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc47806c920 0x7fc47806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.084+0000 7fc48a7fc640 1 -- 172.21.15.113:0/2481985241 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc4840ad400 con 0x7fc4941e4370 2024-04-22T06:35:00.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.084+0000 7fc49986e640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc47806c920 0x7fc47806ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc490005580 tx=0x7fc490009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.088+0000 7fc48a7fc640 1 -- 172.21.15.113:0/2481985241 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc48404c070 con 0x7fc4941e4370 2024-04-22T06:35:00.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.261+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc494068f50 con 0x7fc4941e4370 2024-04-22T06:35:00.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.261+0000 7fc48a7fc640 1 -- 172.21.15.113:0/2481985241 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fc48407b3a0 con 0x7fc4941e4370 2024-04-22T06:35:00.261 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc47806c920 msgr2=0x7fc47806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc47806c920 0x7fc47806ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc490005580 tx=0x7fc490009040 comp rx=0 tx=0).stop 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4941e4370 msgr2=0x7fc4940ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4941e4370 0x7fc4940ce890 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc484037040 tx=0x7fc484004730 comp rx=0 tx=0).stop 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 shutdown_connections 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc494156f50 0x7fc49414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc47806c920 0x7fc47806ede0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4941e4370 0x7fc4940ce890 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 --2- 172.21.15.113:0/2481985241 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc480004800 0x7fc4941f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.263+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 >> 172.21.15.113:0/2481985241 conn(0x7fc494068570 msgr2=0x7fc49414d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:00.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.264+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 shutdown_connections 2024-04-22T06:35:00.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.264+0000 7fc49bad2640 1 -- 172.21.15.113:0/2481985241 wait complete. 2024-04-22T06:35:00.274 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:35:00.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.374+0000 7fd394ba4640 1 Processor -- start 2024-04-22T06:35:00.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd394ba4640 1 -- start start 2024-04-22T06:35:00.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd394ba4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd390152f20 0x7fd3900cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd394ba4640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd390153300 0x7fd3900cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd394ba4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3900c9ca0 0x7fd3900ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd394ba4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fd3900c9810 con 0x7fd390152f20 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd394ba4640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fd3900c7b20 con 0x7fd390153300 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd394ba4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd3900ca650 con 0x7fd3900c9ca0 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd38e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd390152f20 0x7fd3900cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd38e59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd390152f20 0x7fd3900cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49586/0 (socket says 172.21.15.113:49586) 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.375+0000 7fd38e59c640 1 -- 172.21.15.113:0/1683684756 learned_addr learned my addr 172.21.15.113:0/1683684756 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.376+0000 7fd387fff640 1 --2- 172.21.15.113:0/1683684756 >> v2:172.21.15.145:3300/0 conn(0x7fd390153300 0x7fd3900cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.376+0000 7fd38e59c640 1 -- 172.21.15.113:0/1683684756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3900c9ca0 msgr2=0x7fd3900ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.376+0000 7fd38e59c640 1 --2- 172.21.15.113:0/1683684756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3900c9ca0 0x7fd3900ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.376+0000 7fd38e59c640 1 -- 172.21.15.113:0/1683684756 >> v2:172.21.15.145:3300/0 conn(0x7fd390153300 msgr2=0x7fd3900cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.376+0000 7fd38e59c640 1 --2- 172.21.15.113:0/1683684756 >> v2:172.21.15.145:3300/0 conn(0x7fd390153300 0x7fd3900cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.376+0000 7fd38e59c640 1 -- 172.21.15.113:0/1683684756 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3900cac60 con 0x7fd390152f20 2024-04-22T06:35:00.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.376+0000 7fd38e59c640 1 --2- 172.21.15.113:0/1683684756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900cb3c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd3900cf6b0 tx=0x7fd38002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00f9a94609f6e36 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd38dd9b640 1 -- 172.21.15.113:0/1683684756 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380034070 con 0x7fd390152f20 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd38dd9b640 1 -- 172.21.15.113:0/1683684756 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd380030840 con 0x7fd390152f20 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd38dd9b640 1 -- 172.21.15.113:0/1683684756 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380030c10 con 0x7fd390152f20 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 -- 172.21.15.113:0/1683684756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 msgr2=0x7fd3900cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 --2- 172.21.15.113:0/1683684756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900cb3c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd3900cf6b0 tx=0x7fd38002b980 comp rx=0 tx=0).stop 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 -- 172.21.15.113:0/1683684756 shutdown_connections 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 --2- 172.21.15.113:0/1683684756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd3900c9ca0 0x7fd3900ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 --2- 172.21.15.113:0/1683684756 >> v2:172.21.15.145:3300/0 conn(0x7fd390153300 0x7fd3900cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 --2- 172.21.15.113:0/1683684756 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900cb3c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 -- 172.21.15.113:0/1683684756 >> 172.21.15.113:0/1683684756 conn(0x7fd390074f30 msgr2=0x7fd390075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:00.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 -- 172.21.15.113:0/1683684756 shutdown_connections 2024-04-22T06:35:00.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.377+0000 7fd394ba4640 1 -- 172.21.15.113:0/1683684756 wait complete. 2024-04-22T06:35:00.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.378+0000 7fd394ba4640 1 Processor -- start 2024-04-22T06:35:00.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd394ba4640 1 -- start start 2024-04-22T06:35:00.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd394ba4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3900c9ca0 0x7fd3901ef190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd394ba4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd394ba4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd390153300 0x7fd390155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd394ba4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900c8350 con 0x7fd390152f20 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd394ba4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900c8070 con 0x7fd3900c9ca0 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd394ba4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd3900c8630 con 0x7fd390153300 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd387fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd387fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49598/0 (socket says 172.21.15.113:49598) 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.379+0000 7fd387fff640 1 -- 172.21.15.113:0/45172877 learned_addr learned my addr 172.21.15.113:0/45172877 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd38e59c640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3900c9ca0 0x7fd3901ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd38ed9d640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd390153300 0x7fd390155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd387fff640 1 -- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd390153300 msgr2=0x7fd390155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd387fff640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd390153300 0x7fd390155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd387fff640 1 -- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3900c9ca0 msgr2=0x7fd3901ef190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd387fff640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3900c9ca0 0x7fd3901ef190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd387fff640 1 -- 172.21.15.113:0/45172877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3901f29b0 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd38ed9d640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd390153300 0x7fd390155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd387fff640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900c5be0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd37800c7f0 tx=0x7fd37800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd386ffd640 1 -- 172.21.15.113:0/45172877 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378015070 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd386ffd640 1 -- 172.21.15.113:0/45172877 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd378007820 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3901ee990 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd386ffd640 1 -- 172.21.15.113:0/45172877 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378007bd0 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.380+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd390151f80 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.381+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd390068f50 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.381+0000 7fd386ffd640 1 -- 172.21.15.113:0/45172877 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd378018070 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.382+0000 7fd386ffd640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd37006c8f0 0x7fd37006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.382+0000 7fd386ffd640 1 -- 172.21.15.113:0/45172877 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd37808bca0 con 0x7fd390152f20 2024-04-22T06:35:00.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.382+0000 7fd38e59c640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd37006c8f0 0x7fd37006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.382+0000 7fd38e59c640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd37006c8f0 0x7fd37006edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd380036000 tx=0x7fd38003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.386+0000 7fd386ffd640 1 -- 172.21.15.113:0/45172877 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd378059cd0 con 0x7fd390152f20 2024-04-22T06:35:00.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.560+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd3901f2b80 con 0x7fd390152f20 2024-04-22T06:35:00.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.561+0000 7fd386ffd640 1 -- 172.21.15.113:0/45172877 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fd3780595d0 con 0x7fd390152f20 2024-04-22T06:35:00.560 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:35:00.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd37006c8f0 msgr2=0x7fd37006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd37006c8f0 0x7fd37006edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd380036000 tx=0x7fd38003b040 comp rx=0 tx=0).stop 2024-04-22T06:35:00.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 msgr2=0x7fd3900c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900c5be0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd37800c7f0 tx=0x7fd37800ccb0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 shutdown_connections 2024-04-22T06:35:00.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd390153300 0x7fd390155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd37006c8f0 0x7fd37006edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd390152f20 0x7fd3900c5be0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 --2- 172.21.15.113:0/45172877 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3900c9ca0 0x7fd3901ef190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 >> 172.21.15.113:0/45172877 conn(0x7fd390074f30 msgr2=0x7fd3901490b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:00.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 shutdown_connections 2024-04-22T06:35:00.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.563+0000 7fd394ba4640 1 -- 172.21.15.113:0/45172877 wait complete. 2024-04-22T06:35:00.573 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:35:00.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.673+0000 7f0a1e8e0640 1 Processor -- start 2024-04-22T06:35:00.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.673+0000 7f0a1e8e0640 1 -- start start 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.674+0000 7f0a1e8e0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a18153300 0x7f0a180c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.674+0000 7f0a1e8e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a180ca1e0 0x7f0a180c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.674+0000 7f0a1e8e0640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a180c7b20 con 0x7f0a18152f20 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.674+0000 7f0a1e8e0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f0a180c9810 con 0x7f0a18153300 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.674+0000 7f0a1e8e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f0a180ca650 con 0x7f0a180ca1e0 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.674+0000 7f0a177fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a18153300 0x7f0a180c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.674+0000 7f0a177fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0a18153300 0x7f0a180c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49606/0 (socket says 172.21.15.113:49606) 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.674+0000 7f0a177fe640 1 -- 172.21.15.113:0/763483630 learned_addr learned my addr 172.21.15.113:0/763483630 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.675+0000 7f0a1ce7d640 1 --2- 172.21.15.113:0/763483630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a180ca1e0 0x7f0a180c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.675+0000 7f0a177fe640 1 -- 172.21.15.113:0/763483630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a180ca1e0 msgr2=0x7f0a180c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.675+0000 7f0a177fe640 1 --2- 172.21.15.113:0/763483630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a180ca1e0 0x7f0a180c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.675+0000 7f0a177fe640 1 -- 172.21.15.113:0/763483630 >> v1:172.21.15.145:6789/0 conn(0x7f0a18152f20 legacy=0x7f0a180cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.675+0000 7f0a177fe640 1 -- 172.21.15.113:0/763483630 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a180cac60 con 0x7f0a18153300 2024-04-22T06:35:00.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.675+0000 7f0a1ce7d640 1 --2- 172.21.15.113:0/763483630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a180ca1e0 0x7f0a180c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:00.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.675+0000 7f0a177fe640 1 --2- 172.21.15.113:0/763483630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a180c9ca0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009870 tx=0x7f0a0c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5d00003de356fa server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a16ffd640 1 -- 172.21.15.113:0/763483630 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c02f840 con 0x7f0a18153300 2024-04-22T06:35:00.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a16ffd640 1 -- 172.21.15.113:0/763483630 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a0c02f9e0 con 0x7f0a18153300 2024-04-22T06:35:00.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a16ffd640 1 -- 172.21.15.113:0/763483630 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c02fdb0 con 0x7f0a18153300 2024-04-22T06:35:00.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/763483630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 msgr2=0x7f0a180c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/763483630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a180c9ca0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009870 tx=0x7f0a0c02ba20 comp rx=0 tx=0).stop 2024-04-22T06:35:00.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/763483630 shutdown_connections 2024-04-22T06:35:00.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/763483630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a180ca1e0 0x7f0a180c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/763483630 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a180c9ca0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/763483630 >> 172.21.15.113:0/763483630 conn(0x7f0a18074f30 msgr2=0x7f0a18075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/763483630 shutdown_connections 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.676+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/763483630 wait complete. 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.677+0000 7f0a1e8e0640 1 Processor -- start 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.677+0000 7f0a1e8e0640 1 -- start start 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1e8e0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a180ca1e0 0x7f0a18158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1e8e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a18152f20 0x7f0a180cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1e8e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a1814e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1e8e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f0a180c8350 con 0x7f0a18153300 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1e8e0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0a180c8070 con 0x7f0a180ca1e0 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1e8e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f0a180c8630 con 0x7f0a18152f20 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1ce7d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a1814e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1ce7d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a1814e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49620/0 (socket says 172.21.15.113:49620) 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1ce7d640 1 -- 172.21.15.113:0/937023650 learned_addr learned my addr 172.21.15.113:0/937023650 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a177fe640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a18152f20 0x7f0a180cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a17fff640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a180ca1e0 0x7f0a18158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1ce7d640 1 -- 172.21.15.113:0/937023650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a18152f20 msgr2=0x7f0a180cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1ce7d640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a18152f20 0x7f0a180cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1ce7d640 1 -- 172.21.15.113:0/937023650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a180ca1e0 msgr2=0x7f0a18158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.678+0000 7f0a1ce7d640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a180ca1e0 0x7f0a18158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.679+0000 7f0a1ce7d640 1 -- 172.21.15.113:0/937023650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a181f2d80 con 0x7f0a18153300 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.679+0000 7f0a1ce7d640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a1814e470 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009fa0 tx=0x7f0a1000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.679+0000 7f0a14ff9640 1 -- 172.21.15.113:0/937023650 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1001a070 con 0x7f0a18153300 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.679+0000 7f0a14ff9640 1 -- 172.21.15.113:0/937023650 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10003bb0 con 0x7f0a18153300 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.679+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a18159b70 con 0x7f0a18153300 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.679+0000 7f0a14ff9640 1 -- 172.21.15.113:0/937023650 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10004030 con 0x7f0a18153300 2024-04-22T06:35:00.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.679+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a181f1fc0 con 0x7f0a18153300 2024-04-22T06:35:00.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.680+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a18068f50 con 0x7f0a18153300 2024-04-22T06:35:00.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.680+0000 7f0a14ff9640 1 -- 172.21.15.113:0/937023650 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a1001d070 con 0x7f0a18153300 2024-04-22T06:35:00.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.681+0000 7f0a14ff9640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0a0406c8f0 0x7f0a0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.681+0000 7f0a14ff9640 1 -- 172.21.15.113:0/937023650 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0a1008c150 con 0x7f0a18153300 2024-04-22T06:35:00.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.681+0000 7f0a17fff640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0a0406c8f0 0x7f0a0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.681+0000 7f0a17fff640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0a0406c8f0 0x7f0a0406edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001780 tx=0x7f0a08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.685+0000 7f0a14ff9640 1 -- 172.21.15.113:0/937023650 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a10010070 con 0x7f0a18153300 2024-04-22T06:35:00.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.861+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0a18075750 con 0x7f0a18153300 2024-04-22T06:35:00.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.861+0000 7f0a14ff9640 1 -- 172.21.15.113:0/937023650 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f0a10059bc0 con 0x7f0a18153300 2024-04-22T06:35:00.860 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:35:00.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0a0406c8f0 msgr2=0x7f0a0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0a0406c8f0 0x7f0a0406edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001780 tx=0x7f0a08009040 comp rx=0 tx=0).stop 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 msgr2=0x7f0a1814e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a1814e470 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009fa0 tx=0x7f0a1000d560 comp rx=0 tx=0).stop 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 shutdown_connections 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0a0406c8f0 0x7f0a0406edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a18153300 0x7f0a1814e470 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0a18152f20 0x7f0a180cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 --2- 172.21.15.113:0/937023650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a180ca1e0 0x7f0a18158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 >> 172.21.15.113:0/937023650 conn(0x7f0a18074f30 msgr2=0x7f0a181521d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 shutdown_connections 2024-04-22T06:35:00.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.863+0000 7f0a1e8e0640 1 -- 172.21.15.113:0/937023650 wait complete. 2024-04-22T06:35:00.874 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T06:35:00.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.973+0000 7fe9a193b640 1 Processor -- start 2024-04-22T06:35:00.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.973+0000 7fe9a193b640 1 -- start start 2024-04-22T06:35:00.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.973+0000 7fe9a193b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 0x7fe99c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.973+0000 7fe9a193b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99c1558c0 con 0x7fe99c0b3c00 2024-04-22T06:35:00.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.973+0000 7fe9a193b640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99c15f630 con 0x7fe99c0d08a0 2024-04-22T06:35:00.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.973+0000 7fe9a193b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0b4a80 con 0x7fe99c1554e0 2024-04-22T06:35:00.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99a7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe99c0b3c00 0x7fe99c0b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39808/0 (socket says 172.21.15.113:39808) 2024-04-22T06:35:00.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99a7fc640 1 -- 172.21.15.113:0/744486414 learned_addr learned my addr 172.21.15.113:0/744486414 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99affd640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 0x7fe99c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905860785 0 0) 0x7fe990001110 con 0x7fe99c0b3c00 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe984003520 con 0x7fe99c0b3c00 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167082957 0 0) 0x7fe99c15f630 con 0x7fe99c0d08a0 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe990001110 con 0x7fe99c0d08a0 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4030172270 0 0) 0x7fe984003520 con 0x7fe99c0b3c00 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 msgr2=0x7fe99c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 0x7fe99c15f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 >> v1:172.21.15.145:6789/0 conn(0x7fe99c0d08a0 legacy=0x7fe99c165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c0cb8c0 con 0x7fe99c0b3c00 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fe990001840 con 0x7fe99c0b3c00 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99affd640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 0x7fe99c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 >> v1:172.21.15.113:6789/0 conn(0x7fe99c0b3c00 legacy=0x7fe99c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984003b70 0x7fe984003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe984004800 0x7fe984004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 0x7fe9840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0b4a80 con 0x7fe984004800 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe98400b9f0 con 0x7fe984003b70 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe98400bbf0 con 0x7fe99c1554e0 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99a7fc640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe984004800 0x7fe984004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99affd640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984003b70 0x7fe984003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99b7fe640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 0x7fe9840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99a7fc640 1 -- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 msgr2=0x7fe9840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99a7fc640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c1554e0 0x7fe9840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99a7fc640 1 -- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984003b70 msgr2=0x7fe984003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99a7fc640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984003b70 0x7fe984003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99a7fc640 1 -- 172.21.15.113:0/744486414 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe984003520 con 0x7fe984004800 2024-04-22T06:35:00.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.974+0000 7fe99affd640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984003b70 0x7fe984003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.975+0000 7fe99a7fc640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe984004800 0x7fe984004c80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe990001eb0 tx=0x7fe984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86697dc2d603385 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.975+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99000c0e0 con 0x7fe984004800 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.975+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe990030070 con 0x7fe984004800 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.975+0000 7fe999ffb640 1 -- 172.21.15.113:0/744486414 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99002ce50 con 0x7fe984004800 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.976+0000 7fe9a193b640 1 -- 172.21.15.113:0/744486414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe984004800 msgr2=0x7fe984004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.976+0000 7fe9a193b640 1 --2- 172.21.15.113:0/744486414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe984004800 0x7fe984004c80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe990001eb0 tx=0x7fe984005830 comp rx=0 tx=0).stop 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.976+0000 7fe99b7fe640 1 -- 172.21.15.113:0/744486414 reap_dead start 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.976+0000 7fe9a193b640 1 -- 172.21.15.113:0/744486414 shutdown_connections 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.976+0000 7fe9a193b640 1 -- 172.21.15.113:0/744486414 >> 172.21.15.113:0/744486414 conn(0x7fe99c074d50 msgr2=0x7fe99c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.976+0000 7fe9a193b640 1 -- 172.21.15.113:0/744486414 shutdown_connections 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.976+0000 7fe9a193b640 1 -- 172.21.15.113:0/744486414 wait complete. 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.977+0000 7fe9a193b640 1 Processor -- start 2024-04-22T06:35:00.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.977+0000 7fe9a193b640 1 -- start start 2024-04-22T06:35:00.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe9a193b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984004800 0x7fe99c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe9a193b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99c152450 0x7fe99c0c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe9a193b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c15af10 0x7fe99c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe9a193b640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0b4430 con 0x7fe99c152450 2024-04-22T06:35:00.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe9a193b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0b4150 con 0x7fe984004800 2024-04-22T06:35:00.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe9a193b640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0b4710 con 0x7fe99c15af10 2024-04-22T06:35:00.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99c152450 0x7fe99c0c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99c152450 0x7fe99c0c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49640/0 (socket says 172.21.15.113:49640) 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 -- 172.21.15.113:0/2023505744 learned_addr learned my addr 172.21.15.113:0/2023505744 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99affd640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984004800 0x7fe99c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99b7fe640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c15af10 0x7fe99c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 -- 172.21.15.113:0/2023505744 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c15af10 msgr2=0x7fe99c0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c15af10 0x7fe99c0c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 -- 172.21.15.113:0/2023505744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984004800 msgr2=0x7fe99c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984004800 0x7fe99c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 -- 172.21.15.113:0/2023505744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c15b690 con 0x7fe99c152450 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.978+0000 7fe99a7fc640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99c152450 0x7fe99c0c4a30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe990001eb0 tx=0x7fe990001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.979+0000 7fe983fff640 1 -- 172.21.15.113:0/2023505744 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990007270 con 0x7fe99c152450 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.979+0000 7fe983fff640 1 -- 172.21.15.113:0/2023505744 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe990007410 con 0x7fe99c152450 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.979+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c1f1780 con 0x7fe99c152450 2024-04-22T06:35:00.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.979+0000 7fe983fff640 1 -- 172.21.15.113:0/2023505744 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9900077c0 con 0x7fe99c152450 2024-04-22T06:35:00.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.979+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c151f40 con 0x7fe99c152450 2024-04-22T06:35:00.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.980+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c0cc260 con 0x7fe99c152450 2024-04-22T06:35:00.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.980+0000 7fe983fff640 1 -- 172.21.15.113:0/2023505744 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe990035470 con 0x7fe99c152450 2024-04-22T06:35:00.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.980+0000 7fe983fff640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe98806c920 0x7fe98806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:00.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.980+0000 7fe983fff640 1 -- 172.21.15.113:0/2023505744 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe9900ad5b0 con 0x7fe99c152450 2024-04-22T06:35:00.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.980+0000 7fe99affd640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe98806c920 0x7fe98806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:00.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.981+0000 7fe99affd640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe98806c920 0x7fe98806ede0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe98c003b80 tx=0x7fe98c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:00.984 INFO:tasks.daemonwatchdog.daemon_watchdog:quiescer.fs.[cephfs] failed 2024-04-22T06:35:00.984 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-04-22T06:35:00.985 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-04-22T06:35:00.985 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T06:35:00.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:00.985+0000 7fe983fff640 1 -- 172.21.15.113:0/2023505744 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe99c1558c0 con 0x7fe99c152450 2024-04-22T06:35:01.000 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:35:01.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.139+0000 7f4210bf4640 1 Processor -- start 2024-04-22T06:35:01.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.139+0000 7f4210bf4640 1 -- start start 2024-04-22T06:35:01.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f4210bf4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c0c8070 0x7f420c15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f4210bf4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f420c06c850 con 0x7f420c1553a0 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f4210bf4640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f420c06cb30 con 0x7f420c0c8e10 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f4210bf4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f420c06ce10 con 0x7f420c0c8070 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420a59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f420c1553a0 0x7f420c0c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39810/0 (socket says 172.21.15.113:39810) 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420a59c640 1 -- 172.21.15.113:0/1211703324 learned_addr learned my addr 172.21.15.113:0/1211703324 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420ad9d640 1 --2- 172.21.15.113:0/1211703324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c0c8070 0x7f420c15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420959a640 1 -- 172.21.15.113:0/1211703324 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3066574255 0 0) 0x7f420c06c850 con 0x7f420c1553a0 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420959a640 1 -- 172.21.15.113:0/1211703324 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f4003520 con 0x7f420c1553a0 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420959a640 1 -- 172.21.15.113:0/1211703324 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020609088 0 0) 0x7f420c06cb30 con 0x7f420c0c8e10 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420959a640 1 -- 172.21.15.113:0/1211703324 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f420c06c850 con 0x7f420c0c8e10 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420ad9d640 1 -- 172.21.15.113:0/1211703324 >> v1:172.21.15.145:6789/0 conn(0x7f420c0c8e10 legacy=0x7f420c15e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420959a640 1 -- 172.21.15.113:0/1211703324 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1444594758 0 0) 0x7f41f4003520 con 0x7f420c1553a0 2024-04-22T06:35:01.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420ad9d640 1 -- 172.21.15.113:0/1211703324 >> v1:172.21.15.113:6789/0 conn(0x7f420c1553a0 legacy=0x7f420c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.140+0000 7f420ad9d640 1 -- 172.21.15.113:0/1211703324 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c06d0f0 con 0x7f420c0c8070 2024-04-22T06:35:01.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.141+0000 7f420ad9d640 1 --2- 172.21.15.113:0/1211703324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c0c8070 0x7f420c15ed80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4204009dc0 tx=0x7f420402be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb66fefbc07a050 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.141+0000 7f420959a640 1 -- 172.21.15.113:0/1211703324 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204039070 con 0x7f420c0c8070 2024-04-22T06:35:01.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.141+0000 7f420959a640 1 -- 172.21.15.113:0/1211703324 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420402c9a0 con 0x7f420c0c8070 2024-04-22T06:35:01.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.141+0000 7f420959a640 1 -- 172.21.15.113:0/1211703324 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc001670 con 0x7f420c0c8070 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.142+0000 7f4210bf4640 1 -- 172.21.15.113:0/1211703324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c0c8070 msgr2=0x7f420c15ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.142+0000 7f4210bf4640 1 --2- 172.21.15.113:0/1211703324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c0c8070 0x7f420c15ed80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4204009dc0 tx=0x7f420402be70 comp rx=0 tx=0).stop 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.142+0000 7f4210bf4640 1 -- 172.21.15.113:0/1211703324 shutdown_connections 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.142+0000 7f4210bf4640 1 --2- 172.21.15.113:0/1211703324 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c0c8070 0x7f420c15ed80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.142+0000 7f4210bf4640 1 -- 172.21.15.113:0/1211703324 >> 172.21.15.113:0/1211703324 conn(0x7f420c073010 msgr2=0x7f420c073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.142+0000 7f4210bf4640 1 -- 172.21.15.113:0/1211703324 shutdown_connections 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.142+0000 7f4210bf4640 1 -- 172.21.15.113:0/1211703324 wait complete. 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.143+0000 7f4210bf4640 1 Processor -- start 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.143+0000 7f4210bf4640 1 -- start start 2024-04-22T06:35:01.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4210bf4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f420c0c8070 0x7f420c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4210bf4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0c8e10 0x7f420c1f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4210bf4640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c1553a0 0x7f420c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4210bf4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f420c15f2c0 con 0x7f420c0c8e10 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4210bf4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f420c155780 con 0x7f420c0c8070 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4210bf4640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f420c15f440 con 0x7f420c1553a0 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4209d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0c8e10 0x7f420c1f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4209d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0c8e10 0x7f420c1f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49644/0 (socket says 172.21.15.113:49644) 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4209d9b640 1 -- 172.21.15.113:0/2497416605 learned_addr learned my addr 172.21.15.113:0/2497416605 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f420a59c640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f420c0c8070 0x7f420c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f420ad9d640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c1553a0 0x7f420c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4209d9b640 1 -- 172.21.15.113:0/2497416605 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c1553a0 msgr2=0x7f420c0cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4209d9b640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c1553a0 0x7f420c0cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4209d9b640 1 -- 172.21.15.113:0/2497416605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f420c0c8070 msgr2=0x7f420c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4209d9b640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f420c0c8070 0x7f420c1582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.144+0000 7f4209d9b640 1 -- 172.21.15.113:0/2497416605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c1f48d0 con 0x7f420c0c8e10 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.145+0000 7f4209d9b640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0c8e10 0x7f420c1f3ef0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f420000c4c0 tx=0x7f420000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.145+0000 7f41faffd640 1 -- 172.21.15.113:0/2497416605 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42000052d0 con 0x7f420c0c8e10 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.145+0000 7f41faffd640 1 -- 172.21.15.113:0/2497416605 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4200005470 con 0x7f420c0c8e10 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.145+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420c0cd740 con 0x7f420c0c8e10 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.145+0000 7f41faffd640 1 -- 172.21.15.113:0/2497416605 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200012870 con 0x7f420c0c8e10 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.145+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420c15f030 con 0x7f420c0c8e10 2024-04-22T06:35:01.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.146+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f420c068e40 con 0x7f420c0c8e10 2024-04-22T06:35:01.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.146+0000 7f41faffd640 1 -- 172.21.15.113:0/2497416605 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4200012a10 con 0x7f420c0c8e10 2024-04-22T06:35:01.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.147+0000 7f41faffd640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f41ec06c920 0x7f41ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.147+0000 7f41faffd640 1 -- 172.21.15.113:0/2497416605 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f420008ba50 con 0x7f420c0c8e10 2024-04-22T06:35:01.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.147+0000 7f420a59c640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f41ec06c920 0x7f41ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.147+0000 7f420a59c640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f41ec06c920 0x7f41ec06ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0011e0 tx=0x7f41fc001690 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.151+0000 7f41faffd640 1 -- 172.21.15.113:0/2497416605 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4200059430 con 0x7f420c0c8e10 2024-04-22T06:35:01.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.182+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe99c068e20 con 0x7fe99c152450 2024-04-22T06:35:01.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.182+0000 7fe983fff640 1 -- 172.21.15.113:0/2023505744 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fe990004e20 con 0x7fe99c152450 2024-04-22T06:35:01.181 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-04-22T06:35:01.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.184+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe98806c920 msgr2=0x7fe98806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.184+0000 7fe9a193b640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe98806c920 0x7fe98806ede0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe98c003b80 tx=0x7fe98c00b040 comp rx=0 tx=0).stop 2024-04-22T06:35:01.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.184+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99c152450 msgr2=0x7fe99c0c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.184+0000 7fe9a193b640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99c152450 0x7fe99c0c4a30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe990001eb0 tx=0x7fe990001c00 comp rx=0 tx=0).stop 2024-04-22T06:35:01.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.184+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 shutdown_connections 2024-04-22T06:35:01.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.184+0000 7fe9a193b640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe99c15af10 0x7fe99c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.185+0000 7fe9a193b640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fe98806c920 0x7fe98806ede0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.185+0000 7fe9a193b640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe99c152450 0x7fe99c0c4a30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.185+0000 7fe9a193b640 1 --2- 172.21.15.113:0/2023505744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe984004800 0x7fe99c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.185+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 >> 172.21.15.113:0/2023505744 conn(0x7fe99c074d50 msgr2=0x7fe99c0cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.185+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 shutdown_connections 2024-04-22T06:35:01.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.185+0000 7fe9a193b640 1 -- 172.21.15.113:0/2023505744 wait complete. 2024-04-22T06:35:01.195 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi113.front.sepia.ceph.com... 2024-04-22T06:35:01.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:35:01.196 DEBUG:teuthology.orchestra.run.smithi113:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-22T06:35:01.219 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:35:01.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:35:01.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:35:01.219 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-22T06:35:01.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:35:01.274 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-04-22T06:35:01.328 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-22T06:35:01.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:35:01.329 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T06:35:01.336 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.337+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f420c15e030 con 0x7f420c0c8e10 2024-04-22T06:35:01.338 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:35:01.338 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.338+0000 7f41faffd640 1 -- 172.21.15.113:0/2497416605 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f420005d730 con 0x7f420c0c8e10 2024-04-22T06:35:01.338 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:35:01.339 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f41ec06c920 msgr2=0x7f41ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f41ec06c920 0x7f41ec06ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0011e0 tx=0x7f41fc001690 comp rx=0 tx=0).stop 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0c8e10 msgr2=0x7f420c1f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0c8e10 0x7f420c1f3ef0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f420000c4c0 tx=0x7f420000c980 comp rx=0 tx=0).stop 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 shutdown_connections 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f420c1553a0 0x7f420c0cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f41ec06c920 0x7f41ec06ede0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f420c0c8e10 0x7f420c1f3ef0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 --2- 172.21.15.113:0/2497416605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f420c0c8070 0x7f420c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 >> 172.21.15.113:0/2497416605 conn(0x7f420c073010 msgr2=0x7f420c150250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 shutdown_connections 2024-04-22T06:35:01.340 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.340+0000 7f4210bf4640 1 -- 172.21.15.113:0/2497416605 wait complete. 2024-04-22T06:35:01.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T06:31:24.983891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T06:31:35.014748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T06:31:36.130266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-22T06:31:39.850561+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-22T06:35:01.351 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T06:35:01.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T06:35:01.359 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2024-04-22T06:35:01.475 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-22T06:35:01.487 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T06:35:01.487 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:35:01.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.503+0000 7fa6f1811640 1 Processor -- start 2024-04-22T06:35:01.502 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.503+0000 7fa6f1811640 1 -- start start 2024-04-22T06:35:01.503 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6f1811640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa6ec1587a0 0x7fa6ec0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6f1811640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ec0cd3e0 con 0x7fa6ec151fa0 2024-04-22T06:35:01.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6f1811640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ec0cc510 con 0x7fa6ec0c8610 2024-04-22T06:35:01.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6f1811640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fa6ec0cc7d0 con 0x7fa6ec1587a0 2024-04-22T06:35:01.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6eaffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa6ec151fa0 0x7fa6ec0c95e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39814/0 (socket says 172.21.15.113:39814) 2024-04-22T06:35:01.504 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6eaffd640 1 -- 172.21.15.113:0/3823676072 learned_addr learned my addr 172.21.15.113:0/3823676072 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:01.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968145836 0 0) 0x7fa6ec0cd3e0 con 0x7fa6ec151fa0 2024-04-22T06:35:01.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6d4003520 con 0x7fa6ec151fa0 2024-04-22T06:35:01.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6ea7fc640 1 --2- 172.21.15.113:0/3823676072 >> v2:172.21.15.145:3300/0 conn(0x7fa6ec1587a0 0x7fa6ec0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.505 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.504+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1616763861 0 0) 0x7fa6d4003520 con 0x7fa6ec151fa0 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 >> v2:172.21.15.145:3300/0 conn(0x7fa6ec1587a0 msgr2=0x7fa6ec0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 --2- 172.21.15.113:0/3823676072 >> v2:172.21.15.145:3300/0 conn(0x7fa6ec1587a0 0x7fa6ec0c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 >> v1:172.21.15.145:6789/0 conn(0x7fa6ec0c8610 legacy=0x7fa6ec0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ec0ccab0 con 0x7fa6ec151fa0 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fa6dc0019f0 con 0x7fa6ec151fa0 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 >> v1:172.21.15.113:6789/0 conn(0x7fa6ec151fa0 legacy=0x7fa6ec0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6d4004800 0x7fa6d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6d40051c0 0x7fa6d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec0cc7d0 con 0x7fa6d40039b0 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d400c070 con 0x7fa6d4004800 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d400c270 con 0x7fa6d40051c0 2024-04-22T06:35:01.506 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6eaffd640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6ea7fc640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6d4004800 0x7fa6d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6eb7fe640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6d40051c0 0x7fa6d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6eaffd640 1 -- 172.21.15.113:0/3823676072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6d40051c0 msgr2=0x7fa6d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6eaffd640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6d40051c0 0x7fa6d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6eaffd640 1 -- 172.21.15.113:0/3823676072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6d4004800 msgr2=0x7fa6d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6eaffd640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6d4004800 0x7fa6d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6eaffd640 1 -- 172.21.15.113:0/3823676072 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d4003520 con 0x7fa6d40039b0 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.505+0000 7fa6eb7fe640 1 -- 172.21.15.113:0/3823676072 reap_dead start 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.506+0000 7fa6eaffd640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6d4003dd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00a840 tx=0x7fa6d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2c0489e90d45b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.506+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00a460 con 0x7fa6d40039b0 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.506+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6dc034650 con 0x7fa6d40039b0 2024-04-22T06:35:01.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.506+0000 7fa6e9ffb640 1 -- 172.21.15.113:0/3823676072 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc034a80 con 0x7fa6d40039b0 2024-04-22T06:35:01.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.507+0000 7fa6f1811640 1 -- 172.21.15.113:0/3823676072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 msgr2=0x7fa6d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.507+0000 7fa6f1811640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6d4003dd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00a840 tx=0x7fa6d4005830 comp rx=0 tx=0).stop 2024-04-22T06:35:01.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.507+0000 7fa6f1811640 1 -- 172.21.15.113:0/3823676072 shutdown_connections 2024-04-22T06:35:01.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.507+0000 7fa6f1811640 1 --2- 172.21.15.113:0/3823676072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6d4003dd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.507+0000 7fa6f1811640 1 -- 172.21.15.113:0/3823676072 >> 172.21.15.113:0/3823676072 conn(0x7fa6ec06d660 msgr2=0x7fa6ec074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.507+0000 7fa6f1811640 1 -- 172.21.15.113:0/3823676072 shutdown_connections 2024-04-22T06:35:01.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.507+0000 7fa6f1811640 1 -- 172.21.15.113:0/3823676072 wait complete. 2024-04-22T06:35:01.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.508+0000 7fa6f1811640 1 Processor -- start 2024-04-22T06:35:01.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.508+0000 7fa6f1811640 1 -- start start 2024-04-22T06:35:01.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6f1811640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6ec155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6f1811640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6ec151380 0x7fa6ec0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6f1811640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6ec157490 0x7fa6ec1468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6f1811640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec158bd0 con 0x7fa6d40039b0 2024-04-22T06:35:01.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6f1811640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec0cd070 con 0x7fa6ec151380 2024-04-22T06:35:01.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6f1811640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ec0c9ef0 con 0x7fa6ec157490 2024-04-22T06:35:01.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6eaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6ec155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6eaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6ec155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49652/0 (socket says 172.21.15.113:49652) 2024-04-22T06:35:01.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6eaffd640 1 -- 172.21.15.113:0/2284411104 learned_addr learned my addr 172.21.15.113:0/2284411104 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:01.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6ea7fc640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6ec151380 0x7fa6ec0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.509+0000 7fa6eb7fe640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6ec157490 0x7fa6ec1468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6eaffd640 1 -- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6ec157490 msgr2=0x7fa6ec1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6eaffd640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6ec157490 0x7fa6ec1468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6eaffd640 1 -- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6ec151380 msgr2=0x7fa6ec0721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6eaffd640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6ec151380 0x7fa6ec0721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6eaffd640 1 -- 172.21.15.113:0/2284411104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ec1571b0 con 0x7fa6d40039b0 2024-04-22T06:35:01.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6ea7fc640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6ec151380 0x7fa6ec0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:35:01.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6eb7fe640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6ec157490 0x7fa6ec1468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:35:01.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6eaffd640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6ec155b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00a960 tx=0x7fa6ec0cd350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6d3fff640 1 -- 172.21.15.113:0/2284411104 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc039040 con 0x7fa6d40039b0 2024-04-22T06:35:01.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ec073c00 con 0x7fa6d40039b0 2024-04-22T06:35:01.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6d3fff640 1 -- 172.21.15.113:0/2284411104 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6dc043070 con 0x7fa6d40039b0 2024-04-22T06:35:01.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6d3fff640 1 -- 172.21.15.113:0/2284411104 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc004d60 con 0x7fa6d40039b0 2024-04-22T06:35:01.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.510+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ec14f7c0 con 0x7fa6d40039b0 2024-04-22T06:35:01.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.511+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ec068f50 con 0x7fa6d40039b0 2024-04-22T06:35:01.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.512+0000 7fa6d3fff640 1 -- 172.21.15.113:0/2284411104 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6dc034650 con 0x7fa6d40039b0 2024-04-22T06:35:01.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.512+0000 7fa6d3fff640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa6d806c920 0x7fa6d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.512+0000 7fa6d3fff640 1 -- 172.21.15.113:0/2284411104 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa6dc0addf0 con 0x7fa6d40039b0 2024-04-22T06:35:01.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.512+0000 7fa6ea7fc640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa6d806c920 0x7fa6d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.512+0000 7fa6ea7fc640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa6d806c920 0x7fa6d806ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec1f0a90 tx=0x7fa6e0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.516+0000 7fa6d3fff640 1 -- 172.21.15.113:0/2284411104 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa6dc07be30 con 0x7fa6d40039b0 2024-04-22T06:35:01.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.603+0000 7ffa15055640 1 Processor -- start 2024-04-22T06:35:01.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.603+0000 7ffa15055640 1 -- start start 2024-04-22T06:35:01.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa15055640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa101553a0 0x7ffa100c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa15055640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ffa1015bb80 0x7ffa100c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa15055640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1006c850 con 0x7ffa100c8070 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa15055640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1006cb30 con 0x7ffa1015bb80 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa15055640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1006ce10 con 0x7ffa101553a0 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa0e59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ffa100c8070 0x7ffa100ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39822/0 (socket says 172.21.15.113:39822) 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa0e59c640 1 -- 172.21.15.113:0/394616498 learned_addr learned my addr 172.21.15.113:0/394616498 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa0f59e640 1 --2- 172.21.15.113:0/394616498 >> v2:172.21.15.145:3300/0 conn(0x7ffa1015bb80 0x7ffa100c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa0ed9d640 1 --2- 172.21.15.113:0/394616498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa101553a0 0x7ffa100c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa0dd9b640 1 -- 172.21.15.113:0/394616498 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469934680 0 0) 0x7ffa1006c850 con 0x7ffa100c8070 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.604+0000 7ffa0dd9b640 1 -- 172.21.15.113:0/394616498 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f8003520 con 0x7ffa100c8070 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.605+0000 7ffa0f59e640 1 -- 172.21.15.113:0/394616498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa101553a0 msgr2=0x7ffa100c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.605+0000 7ffa0f59e640 1 --2- 172.21.15.113:0/394616498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa101553a0 0x7ffa100c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.605+0000 7ffa0f59e640 1 -- 172.21.15.113:0/394616498 >> v1:172.21.15.113:6789/0 conn(0x7ffa100c8070 legacy=0x7ffa100ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.605+0000 7ffa0f59e640 1 -- 172.21.15.113:0/394616498 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1006d0f0 con 0x7ffa1015bb80 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.605+0000 7ffa0f59e640 1 --2- 172.21.15.113:0/394616498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 0x7ffa100c8c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009d90 tx=0x7ffa0802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f71b78587d00e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa0dd9b640 1 -- 172.21.15.113:0/394616498 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08039070 con 0x7ffa1015bb80 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa0dd9b640 1 -- 172.21.15.113:0/394616498 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0802cce0 con 0x7ffa1015bb80 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa0dd9b640 1 -- 172.21.15.113:0/394616498 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08034660 con 0x7ffa1015bb80 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa15055640 1 -- 172.21.15.113:0/394616498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 msgr2=0x7ffa100c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa15055640 1 --2- 172.21.15.113:0/394616498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 0x7ffa100c8c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009d90 tx=0x7ffa0802bf30 comp rx=0 tx=0).stop 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa15055640 1 -- 172.21.15.113:0/394616498 shutdown_connections 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa15055640 1 --2- 172.21.15.113:0/394616498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 0x7ffa100c8c40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa15055640 1 --2- 172.21.15.113:0/394616498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa101553a0 0x7ffa100c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa15055640 1 -- 172.21.15.113:0/394616498 >> 172.21.15.113:0/394616498 conn(0x7ffa10073010 msgr2=0x7ffa10073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa15055640 1 -- 172.21.15.113:0/394616498 shutdown_connections 2024-04-22T06:35:01.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.606+0000 7ffa15055640 1 -- 172.21.15.113:0/394616498 wait complete. 2024-04-22T06:35:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.608+0000 7ffa15055640 1 Processor -- start 2024-04-22T06:35:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.608+0000 7ffa15055640 1 -- start start 2024-04-22T06:35:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.608+0000 7ffa15055640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa100c8070 0x7ffa1015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.608+0000 7ffa15055640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa101553a0 0x7ffa101f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.608+0000 7ffa15055640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 0x7ffa1014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.608+0000 7ffa15055640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7ffa100cd4d0 con 0x7ffa101553a0 2024-04-22T06:35:01.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.608+0000 7ffa15055640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ffa10155780 con 0x7ffa1015bb80 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.608+0000 7ffa15055640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7ffa100cd650 con 0x7ffa100c8070 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa101553a0 0x7ffa101f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa101553a0 0x7ffa101f05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49658/0 (socket says 172.21.15.113:49658) 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 -- 172.21.15.113:0/1151676534 learned_addr learned my addr 172.21.15.113:0/1151676534 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0f59e640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 0x7ffa1014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0ed9d640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa100c8070 0x7ffa1015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 -- 172.21.15.113:0/1151676534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa100c8070 msgr2=0x7ffa1015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa100c8070 0x7ffa1015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 -- 172.21.15.113:0/1151676534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 msgr2=0x7ffa1014a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 0x7ffa1014a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 -- 172.21.15.113:0/1151676534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa100c6270 con 0x7ffa101553a0 2024-04-22T06:35:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa0e59c640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa101553a0 0x7ffa101f05f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c460 tx=0x7ffa0000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ff9f77fe640 1 -- 172.21.15.113:0/1151676534 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00017070 con 0x7ffa101553a0 2024-04-22T06:35:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ff9f77fe640 1 -- 172.21.15.113:0/1151676534 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa00005ce0 con 0x7ffa101553a0 2024-04-22T06:35:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa10150a10 con 0x7ffa101553a0 2024-04-22T06:35:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ff9f77fe640 1 -- 172.21.15.113:0/1151676534 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00007290 con 0x7ffa101553a0 2024-04-22T06:35:01.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.609+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa100c4710 con 0x7ffa101553a0 2024-04-22T06:35:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.610+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa10068e40 con 0x7ffa101553a0 2024-04-22T06:35:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.611+0000 7ff9f77fe640 1 -- 172.21.15.113:0/1151676534 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa0001a070 con 0x7ffa101553a0 2024-04-22T06:35:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.611+0000 7ff9f77fe640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff9fc06c8f0 0x7ff9fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.611+0000 7ff9f77fe640 1 -- 172.21.15.113:0/1151676534 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ffa0008b2b0 con 0x7ffa101553a0 2024-04-22T06:35:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.611+0000 7ffa0ed9d640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff9fc06c8f0 0x7ff9fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.612+0000 7ffa0ed9d640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff9fc06c8f0 0x7ff9fc06edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009b40 tx=0x7ffa04009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.615+0000 7ff9f77fe640 1 -- 172.21.15.113:0/1151676534 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa00058bf0 con 0x7ffa101553a0 2024-04-22T06:35:01.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.700+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa6ec0c7d60 con 0x7fa6d40039b0 2024-04-22T06:35:01.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.701+0000 7fa6d3fff640 1 -- 172.21.15.113:0/2284411104 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fa6dc07b730 con 0x7fa6d40039b0 2024-04-22T06:35:01.700 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-04-22T06:35:01.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa6d806c920 msgr2=0x7fa6d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa6d806c920 0x7fa6d806ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec1f0a90 tx=0x7fa6e0009190 comp rx=0 tx=0).stop 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 msgr2=0x7fa6ec155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6ec155b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00a960 tx=0x7fa6ec0cd350 comp rx=0 tx=0).stop 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 shutdown_connections 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa6ec157490 0x7fa6ec1468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa6ec151380 0x7fa6ec0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fa6d806c920 0x7fa6d806ede0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 --2- 172.21.15.113:0/2284411104 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40039b0 0x7fa6ec155b90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 >> 172.21.15.113:0/2284411104 conn(0x7fa6ec06d660 msgr2=0x7fa6ec0cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 shutdown_connections 2024-04-22T06:35:01.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.703+0000 7fa6f1811640 1 -- 172.21.15.113:0/2284411104 wait complete. 2024-04-22T06:35:01.714 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T06:35:01.797 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.798+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa101507b0 con 0x7ff9fc06c8f0 2024-04-22T06:35:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.806+0000 7ff9f77fe640 1 -- 172.21.15.113:0/1151676534 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332637 (secure 0 0 0) 0x7ffa04011a60 con 0x7ff9fc06c8f0 2024-04-22T06:35:01.810 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:35:01.812 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:35:01.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff9fc06c8f0 msgr2=0x7ff9fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff9fc06c8f0 0x7ff9fc06edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009b40 tx=0x7ffa04009190 comp rx=0 tx=0).stop 2024-04-22T06:35:01.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa101553a0 msgr2=0x7ffa101f05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa101553a0 0x7ffa101f05f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c460 tx=0x7ffa0000c920 comp rx=0 tx=0).stop 2024-04-22T06:35:01.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 shutdown_connections 2024-04-22T06:35:01.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa1015bb80 0x7ffa1014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7ff9fc06c8f0 0x7ff9fc06edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa101553a0 0x7ffa101f05f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 --2- 172.21.15.113:0/1151676534 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa100c8070 0x7ffa1015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 >> 172.21.15.113:0/1151676534 conn(0x7ffa10073010 msgr2=0x7ffa100733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 shutdown_connections 2024-04-22T06:35:01.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.810+0000 7ffa15055640 1 -- 172.21.15.113:0/1151676534 wait complete. 2024-04-22T06:35:01.825 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-04-22T06:35:01.018980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636179,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":405,"num_write_kb":2536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219800,"kb_used_data":3672,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754920,"statfs":{"total":773094113280,"available":772869038080,"internally_reserved":0,"allocated":3760128,"data_stored":2187246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003369"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979949+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:32:24.979949+0000","last_peered":"2024-04-22T06:32:24.979949+0000","last_clean":"2024-04-22T06:32:24.979949+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:32:24.979949+0000","last_undegraded":"2024-04-22T06:32:24.979949+0000","last_fullsized":"2024-04-22T06:32:24.979949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966594+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:32:18.966594+0000","last_peered":"2024-04-22T06:32:18.966594+0000","last_clean":"2024-04-22T06:32:18.966594+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:32:18.966594+0000","last_undegraded":"2024-04-22T06:32:18.966594+0000","last_fullsized":"2024-04-22T06:32:18.966594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965912+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:32:18.965912+0000","last_peered":"2024-04-22T06:32:18.965912+0000","last_clean":"2024-04-22T06:32:18.965912+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:32:18.965912+0000","last_undegraded":"2024-04-22T06:32:18.965912+0000","last_fullsized":"2024-04-22T06:32:18.965912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966787+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:32:18.966787+0000","last_peered":"2024-04-22T06:32:18.966787+0000","last_clean":"2024-04-22T06:32:18.966787+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:32:18.966787+0000","last_undegraded":"2024-04-22T06:32:18.966787+0000","last_fullsized":"2024-04-22T06:32:18.966787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981724+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:32:18.981724+0000","last_peered":"2024-04-22T06:32:18.981724+0000","last_clean":"2024-04-22T06:32:18.981724+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:32:18.981724+0000","last_undegraded":"2024-04-22T06:32:18.981724+0000","last_fullsized":"2024-04-22T06:32:18.981724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149528+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:32:19.149528+0000","last_peered":"2024-04-22T06:32:19.149528+0000","last_clean":"2024-04-22T06:32:19.149528+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:32:19.149528+0000","last_undegraded":"2024-04-22T06:32:19.149528+0000","last_fullsized":"2024-04-22T06:32:19.149528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'13","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:09.007042+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:34:09.007042+0000","last_peered":"2024-04-22T06:34:09.007042+0000","last_clean":"2024-04-22T06:34:09.007042+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:34:09.007042+0000","last_undegraded":"2024-04-22T06:34:09.007042+0000","last_fullsized":"2024-04-22T06:34:09.007042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191815+0000","last_change":"2024-04-22T06:32:19.150976+0000","last_active":"2024-04-22T06:32:19.191815+0000","last_peered":"2024-04-22T06:32:19.191815+0000","last_clean":"2024-04-22T06:32:19.191815+0000","last_became_active":"2024-04-22T06:32:19.150701+0000","last_became_peered":"2024-04-22T06:32:19.150701+0000","last_unstale":"2024-04-22T06:32:19.191815+0000","last_undegraded":"2024-04-22T06:32:19.191815+0000","last_fullsized":"2024-04-22T06:32:19.191815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:03:07.842684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149975+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:32:19.149975+0000","last_peered":"2024-04-22T06:32:19.149975+0000","last_clean":"2024-04-22T06:32:19.149975+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:32:19.149975+0000","last_undegraded":"2024-04-22T06:32:19.149975+0000","last_fullsized":"2024-04-22T06:32:19.149975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979828+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:32:24.979828+0000","last_peered":"2024-04-22T06:32:24.979828+0000","last_clean":"2024-04-22T06:32:24.979828+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:32:24.979828+0000","last_undegraded":"2024-04-22T06:32:24.979828+0000","last_fullsized":"2024-04-22T06:32:24.979828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967681+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:32:18.967681+0000","last_peered":"2024-04-22T06:32:18.967681+0000","last_clean":"2024-04-22T06:32:18.967681+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:32:18.967681+0000","last_undegraded":"2024-04-22T06:32:18.967681+0000","last_fullsized":"2024-04-22T06:32:18.967681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149840+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:32:19.149840+0000","last_peered":"2024-04-22T06:32:19.149840+0000","last_clean":"2024-04-22T06:32:19.149840+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:32:19.149840+0000","last_undegraded":"2024-04-22T06:32:19.149840+0000","last_fullsized":"2024-04-22T06:32:19.149840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966898+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:32:18.966898+0000","last_peered":"2024-04-22T06:32:18.966898+0000","last_clean":"2024-04-22T06:32:18.966898+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:32:18.966898+0000","last_undegraded":"2024-04-22T06:32:18.966898+0000","last_fullsized":"2024-04-22T06:32:18.966898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:54.005385+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:33:54.005385+0000","last_peered":"2024-04-22T06:33:54.005385+0000","last_clean":"2024-04-22T06:33:54.005385+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:33:54.005385+0000","last_undegraded":"2024-04-22T06:33:54.005385+0000","last_fullsized":"2024-04-22T06:33:54.005385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150258+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:32:19.150258+0000","last_peered":"2024-04-22T06:32:19.150258+0000","last_clean":"2024-04-22T06:32:19.150258+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:32:19.150258+0000","last_undegraded":"2024-04-22T06:32:19.150258+0000","last_fullsized":"2024-04-22T06:32:19.150258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966165+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:32:18.966165+0000","last_peered":"2024-04-22T06:32:18.966165+0000","last_clean":"2024-04-22T06:32:18.966165+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:32:18.966165+0000","last_undegraded":"2024-04-22T06:32:18.966165+0000","last_fullsized":"2024-04-22T06:32:18.966165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.968385+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:32:24.968385+0000","last_peered":"2024-04-22T06:32:24.968385+0000","last_clean":"2024-04-22T06:32:24.968385+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:32:24.968385+0000","last_undegraded":"2024-04-22T06:32:24.968385+0000","last_fullsized":"2024-04-22T06:32:24.968385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150057+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:32:19.150057+0000","last_peered":"2024-04-22T06:32:19.150057+0000","last_clean":"2024-04-22T06:32:19.150057+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:32:19.150057+0000","last_undegraded":"2024-04-22T06:32:19.150057+0000","last_fullsized":"2024-04-22T06:32:19.150057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966154+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:32:18.966154+0000","last_peered":"2024-04-22T06:32:18.966154+0000","last_clean":"2024-04-22T06:32:18.966154+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:32:18.966154+0000","last_undegraded":"2024-04-22T06:32:18.966154+0000","last_fullsized":"2024-04-22T06:32:18.966154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.980015+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:32:24.980015+0000","last_peered":"2024-04-22T06:32:24.980015+0000","last_clean":"2024-04-22T06:32:24.980015+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:32:24.980015+0000","last_undegraded":"2024-04-22T06:32:24.980015+0000","last_fullsized":"2024-04-22T06:32:24.980015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969513+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:32:18.969513+0000","last_peered":"2024-04-22T06:32:18.969513+0000","last_clean":"2024-04-22T06:32:18.969513+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:32:18.969513+0000","last_undegraded":"2024-04-22T06:32:18.969513+0000","last_fullsized":"2024-04-22T06:32:18.969513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149897+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:32:19.149897+0000","last_peered":"2024-04-22T06:32:19.149897+0000","last_clean":"2024-04-22T06:32:19.149897+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:32:19.149897+0000","last_undegraded":"2024-04-22T06:32:19.149897+0000","last_fullsized":"2024-04-22T06:32:19.149897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.293982+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:32:19.293982+0000","last_peered":"2024-04-22T06:32:19.293982+0000","last_clean":"2024-04-22T06:32:19.293982+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:32:19.293982+0000","last_undegraded":"2024-04-22T06:32:19.293982+0000","last_fullsized":"2024-04-22T06:32:19.293982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150114+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:32:19.150114+0000","last_peered":"2024-04-22T06:32:19.150114+0000","last_clean":"2024-04-22T06:32:19.150114+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:32:19.150114+0000","last_undegraded":"2024-04-22T06:32:19.150114+0000","last_fullsized":"2024-04-22T06:32:19.150114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981691+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:32:18.981691+0000","last_peered":"2024-04-22T06:32:18.981691+0000","last_clean":"2024-04-22T06:32:18.981691+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:32:18.981691+0000","last_undegraded":"2024-04-22T06:32:18.981691+0000","last_fullsized":"2024-04-22T06:32:18.981691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:49.204587+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:33:49.204587+0000","last_peered":"2024-04-22T06:33:49.204587+0000","last_clean":"2024-04-22T06:33:49.204587+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:33:49.204587+0000","last_undegraded":"2024-04-22T06:33:49.204587+0000","last_fullsized":"2024-04-22T06:33:49.204587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149704+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:32:19.149704+0000","last_peered":"2024-04-22T06:32:19.149704+0000","last_clean":"2024-04-22T06:32:19.149704+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:32:19.149704+0000","last_undegraded":"2024-04-22T06:32:19.149704+0000","last_fullsized":"2024-04-22T06:32:19.149704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966851+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:32:18.966851+0000","last_peered":"2024-04-22T06:32:18.966851+0000","last_clean":"2024-04-22T06:32:18.966851+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:32:18.966851+0000","last_undegraded":"2024-04-22T06:32:18.966851+0000","last_fullsized":"2024-04-22T06:32:18.966851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'15","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:12.872770+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:34:12.872770+0000","last_peered":"2024-04-22T06:34:12.872770+0000","last_clean":"2024-04-22T06:34:12.872770+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:34:12.872770+0000","last_undegraded":"2024-04-22T06:34:12.872770+0000","last_fullsized":"2024-04-22T06:34:12.872770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965852+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:32:18.965852+0000","last_peered":"2024-04-22T06:32:18.965852+0000","last_clean":"2024-04-22T06:32:18.965852+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:32:18.965852+0000","last_undegraded":"2024-04-22T06:32:18.965852+0000","last_fullsized":"2024-04-22T06:32:18.965852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969613+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:32:18.969613+0000","last_peered":"2024-04-22T06:32:18.969613+0000","last_clean":"2024-04-22T06:32:18.969613+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:32:18.969613+0000","last_undegraded":"2024-04-22T06:32:18.969613+0000","last_fullsized":"2024-04-22T06:32:18.969613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.981124+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:32:24.981124+0000","last_peered":"2024-04-22T06:32:24.981124+0000","last_clean":"2024-04-22T06:32:24.981124+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:32:24.981124+0000","last_undegraded":"2024-04-22T06:32:24.981124+0000","last_fullsized":"2024-04-22T06:32:24.981124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981349+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:32:18.981349+0000","last_peered":"2024-04-22T06:32:18.981349+0000","last_clean":"2024-04-22T06:32:18.981349+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:32:18.981349+0000","last_undegraded":"2024-04-22T06:32:18.981349+0000","last_fullsized":"2024-04-22T06:32:18.981349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967577+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:32:18.967577+0000","last_peered":"2024-04-22T06:32:18.967577+0000","last_clean":"2024-04-22T06:32:18.967577+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:32:18.967577+0000","last_undegraded":"2024-04-22T06:32:18.967577+0000","last_fullsized":"2024-04-22T06:32:18.967577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969706+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:32:18.969706+0000","last_peered":"2024-04-22T06:32:18.969706+0000","last_clean":"2024-04-22T06:32:18.969706+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:32:18.969706+0000","last_undegraded":"2024-04-22T06:32:18.969706+0000","last_fullsized":"2024-04-22T06:32:18.969706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969255+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:32:18.969255+0000","last_peered":"2024-04-22T06:32:18.969255+0000","last_clean":"2024-04-22T06:32:18.969255+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:32:18.969255+0000","last_undegraded":"2024-04-22T06:32:18.969255+0000","last_fullsized":"2024-04-22T06:32:18.969255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150374+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:32:19.150374+0000","last_peered":"2024-04-22T06:32:19.150374+0000","last_clean":"2024-04-22T06:32:19.150374+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:32:19.150374+0000","last_undegraded":"2024-04-22T06:32:19.150374+0000","last_fullsized":"2024-04-22T06:32:19.150374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982527+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:32:24.982527+0000","last_peered":"2024-04-22T06:32:24.982527+0000","last_clean":"2024-04-22T06:32:24.982527+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:32:24.982527+0000","last_undegraded":"2024-04-22T06:32:24.982527+0000","last_fullsized":"2024-04-22T06:32:24.982527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969558+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:32:18.969558+0000","last_peered":"2024-04-22T06:32:18.969558+0000","last_clean":"2024-04-22T06:32:18.969558+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:32:18.969558+0000","last_undegraded":"2024-04-22T06:32:18.969558+0000","last_fullsized":"2024-04-22T06:32:18.969558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969031+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:32:18.969031+0000","last_peered":"2024-04-22T06:32:18.969031+0000","last_clean":"2024-04-22T06:32:18.969031+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:32:18.969031+0000","last_undegraded":"2024-04-22T06:32:18.969031+0000","last_fullsized":"2024-04-22T06:32:18.969031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'8","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:11.925112+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:34:11.925112+0000","last_peered":"2024-04-22T06:34:11.925112+0000","last_clean":"2024-04-22T06:34:11.925112+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:34:11.925112+0000","last_undegraded":"2024-04-22T06:34:11.925112+0000","last_fullsized":"2024-04-22T06:34:11.925112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969534+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:32:18.969534+0000","last_peered":"2024-04-22T06:32:18.969534+0000","last_clean":"2024-04-22T06:32:18.969534+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:32:18.969534+0000","last_undegraded":"2024-04-22T06:32:18.969534+0000","last_fullsized":"2024-04-22T06:32:18.969534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981050+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:32:18.981050+0000","last_peered":"2024-04-22T06:32:18.981050+0000","last_clean":"2024-04-22T06:32:18.981050+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:32:18.981050+0000","last_undegraded":"2024-04-22T06:32:18.981050+0000","last_fullsized":"2024-04-22T06:32:18.981050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979386+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:32:24.979386+0000","last_peered":"2024-04-22T06:32:24.979386+0000","last_clean":"2024-04-22T06:32:24.979386+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:32:24.979386+0000","last_undegraded":"2024-04-22T06:32:24.979386+0000","last_fullsized":"2024-04-22T06:32:24.979386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981568+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:32:18.981568+0000","last_peered":"2024-04-22T06:32:18.981568+0000","last_clean":"2024-04-22T06:32:18.981568+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:32:18.981568+0000","last_undegraded":"2024-04-22T06:32:18.981568+0000","last_fullsized":"2024-04-22T06:32:18.981568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966266+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:32:18.966266+0000","last_peered":"2024-04-22T06:32:18.966266+0000","last_clean":"2024-04-22T06:32:18.966266+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:32:18.966266+0000","last_undegraded":"2024-04-22T06:32:18.966266+0000","last_fullsized":"2024-04-22T06:32:18.966266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978712+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:32:24.978712+0000","last_peered":"2024-04-22T06:32:24.978712+0000","last_clean":"2024-04-22T06:32:24.978712+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:32:24.978712+0000","last_undegraded":"2024-04-22T06:32:24.978712+0000","last_fullsized":"2024-04-22T06:32:24.978712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294104+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:32:19.294104+0000","last_peered":"2024-04-22T06:32:19.294104+0000","last_clean":"2024-04-22T06:32:19.294104+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:32:19.294104+0000","last_undegraded":"2024-04-22T06:32:19.294104+0000","last_fullsized":"2024-04-22T06:32:19.294104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968189+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:32:18.968189+0000","last_peered":"2024-04-22T06:32:18.968189+0000","last_clean":"2024-04-22T06:32:18.968189+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:32:18.968189+0000","last_undegraded":"2024-04-22T06:32:18.968189+0000","last_fullsized":"2024-04-22T06:32:18.968189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294512+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:32:19.294512+0000","last_peered":"2024-04-22T06:32:19.294512+0000","last_clean":"2024-04-22T06:32:19.294512+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:32:19.294512+0000","last_undegraded":"2024-04-22T06:32:19.294512+0000","last_fullsized":"2024-04-22T06:32:19.294512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.254299+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:32:33.254299+0000","last_peered":"2024-04-22T06:32:33.254299+0000","last_clean":"2024-04-22T06:32:33.254299+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:32:33.254299+0000","last_undegraded":"2024-04-22T06:32:33.254299+0000","last_fullsized":"2024-04-22T06:32:33.254299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966790+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:32:18.966790+0000","last_peered":"2024-04-22T06:32:18.966790+0000","last_clean":"2024-04-22T06:32:18.966790+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:32:18.966790+0000","last_undegraded":"2024-04-22T06:32:18.966790+0000","last_fullsized":"2024-04-22T06:32:18.966790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967866+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:32:18.967866+0000","last_peered":"2024-04-22T06:32:18.967866+0000","last_clean":"2024-04-22T06:32:18.967866+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:32:18.967866+0000","last_undegraded":"2024-04-22T06:32:18.967866+0000","last_fullsized":"2024-04-22T06:32:18.967866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977946+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:32:24.977946+0000","last_peered":"2024-04-22T06:32:24.977946+0000","last_clean":"2024-04-22T06:32:24.977946+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:32:24.977946+0000","last_undegraded":"2024-04-22T06:32:24.977946+0000","last_fullsized":"2024-04-22T06:32:24.977946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981480+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:32:18.981480+0000","last_peered":"2024-04-22T06:32:18.981480+0000","last_clean":"2024-04-22T06:32:18.981480+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:32:18.981480+0000","last_undegraded":"2024-04-22T06:32:18.981480+0000","last_fullsized":"2024-04-22T06:32:18.981480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191830+0000","last_change":"2024-04-22T06:32:19.151055+0000","last_active":"2024-04-22T06:32:19.191830+0000","last_peered":"2024-04-22T06:32:19.191830+0000","last_clean":"2024-04-22T06:32:19.191830+0000","last_became_active":"2024-04-22T06:32:19.150732+0000","last_became_peered":"2024-04-22T06:32:19.150732+0000","last_unstale":"2024-04-22T06:32:19.191830+0000","last_undegraded":"2024-04-22T06:32:19.191830+0000","last_fullsized":"2024-04-22T06:32:19.191830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:52:54.156456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978510+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:32:24.978510+0000","last_peered":"2024-04-22T06:32:24.978510+0000","last_clean":"2024-04-22T06:32:24.978510+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:32:24.978510+0000","last_undegraded":"2024-04-22T06:32:24.978510+0000","last_fullsized":"2024-04-22T06:32:24.978510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966555+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:32:18.966555+0000","last_peered":"2024-04-22T06:32:18.966555+0000","last_clean":"2024-04-22T06:32:18.966555+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:32:18.966555+0000","last_undegraded":"2024-04-22T06:32:18.966555+0000","last_fullsized":"2024-04-22T06:32:18.966555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294649+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:32:19.294649+0000","last_peered":"2024-04-22T06:32:19.294649+0000","last_clean":"2024-04-22T06:32:19.294649+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:32:19.294649+0000","last_undegraded":"2024-04-22T06:32:19.294649+0000","last_fullsized":"2024-04-22T06:32:19.294649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150320+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:32:19.150320+0000","last_peered":"2024-04-22T06:32:19.150320+0000","last_clean":"2024-04-22T06:32:19.150320+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:32:19.150320+0000","last_undegraded":"2024-04-22T06:32:19.150320+0000","last_fullsized":"2024-04-22T06:32:19.150320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149498+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:32:19.149498+0000","last_peered":"2024-04-22T06:32:19.149498+0000","last_clean":"2024-04-22T06:32:19.149498+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:32:19.149498+0000","last_undegraded":"2024-04-22T06:32:19.149498+0000","last_fullsized":"2024-04-22T06:32:19.149498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294347+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:32:19.294347+0000","last_peered":"2024-04-22T06:32:19.294347+0000","last_clean":"2024-04-22T06:32:19.294347+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:32:19.294347+0000","last_undegraded":"2024-04-22T06:32:19.294347+0000","last_fullsized":"2024-04-22T06:32:19.294347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.976514+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:32:24.976514+0000","last_peered":"2024-04-22T06:32:24.976514+0000","last_clean":"2024-04-22T06:32:24.976514+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:32:24.976514+0000","last_undegraded":"2024-04-22T06:32:24.976514+0000","last_fullsized":"2024-04-22T06:32:24.976514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981474+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:32:18.981474+0000","last_peered":"2024-04-22T06:32:18.981474+0000","last_clean":"2024-04-22T06:32:18.981474+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:32:18.981474+0000","last_undegraded":"2024-04-22T06:32:18.981474+0000","last_fullsized":"2024-04-22T06:32:18.981474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967600+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:32:18.967600+0000","last_peered":"2024-04-22T06:32:18.967600+0000","last_clean":"2024-04-22T06:32:18.967600+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:32:18.967600+0000","last_undegraded":"2024-04-22T06:32:18.967600+0000","last_fullsized":"2024-04-22T06:32:18.967600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.258892+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:32:33.258892+0000","last_peered":"2024-04-22T06:32:33.258892+0000","last_clean":"2024-04-22T06:32:33.258892+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:32:33.258892+0000","last_undegraded":"2024-04-22T06:32:33.258892+0000","last_fullsized":"2024-04-22T06:32:33.258892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966666+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:32:18.966666+0000","last_peered":"2024-04-22T06:32:18.966666+0000","last_clean":"2024-04-22T06:32:18.966666+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:32:18.966666+0000","last_undegraded":"2024-04-22T06:32:18.966666+0000","last_fullsized":"2024-04-22T06:32:18.966666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294324+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:32:19.294324+0000","last_peered":"2024-04-22T06:32:19.294324+0000","last_clean":"2024-04-22T06:32:19.294324+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:32:19.294324+0000","last_undegraded":"2024-04-22T06:32:19.294324+0000","last_fullsized":"2024-04-22T06:32:19.294324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:59.205857+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:33:59.205857+0000","last_peered":"2024-04-22T06:33:59.205857+0000","last_clean":"2024-04-22T06:33:59.205857+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:33:59.205857+0000","last_undegraded":"2024-04-22T06:33:59.205857+0000","last_fullsized":"2024-04-22T06:33:59.205857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966505+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:32:18.966505+0000","last_peered":"2024-04-22T06:32:18.966505+0000","last_clean":"2024-04-22T06:32:18.966505+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:32:18.966505+0000","last_undegraded":"2024-04-22T06:32:18.966505+0000","last_fullsized":"2024-04-22T06:32:18.966505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981324+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:32:18.981324+0000","last_peered":"2024-04-22T06:32:18.981324+0000","last_clean":"2024-04-22T06:32:18.981324+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:32:18.981324+0000","last_undegraded":"2024-04-22T06:32:18.981324+0000","last_fullsized":"2024-04-22T06:32:18.981324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977596+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:32:24.977596+0000","last_peered":"2024-04-22T06:32:24.977596+0000","last_clean":"2024-04-22T06:32:24.977596+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:32:24.977596+0000","last_undegraded":"2024-04-22T06:32:24.977596+0000","last_fullsized":"2024-04-22T06:32:24.977596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967461+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:32:18.967461+0000","last_peered":"2024-04-22T06:32:18.967461+0000","last_clean":"2024-04-22T06:32:18.967461+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:32:18.967461+0000","last_undegraded":"2024-04-22T06:32:18.967461+0000","last_fullsized":"2024-04-22T06:32:18.967461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294362+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:32:19.294362+0000","last_peered":"2024-04-22T06:32:19.294362+0000","last_clean":"2024-04-22T06:32:19.294362+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:32:19.294362+0000","last_undegraded":"2024-04-22T06:32:19.294362+0000","last_fullsized":"2024-04-22T06:32:19.294362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'26","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:17.859569+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:34:17.859569+0000","last_peered":"2024-04-22T06:34:17.859569+0000","last_clean":"2024-04-22T06:34:17.859569+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:34:17.859569+0000","last_undegraded":"2024-04-22T06:34:17.859569+0000","last_fullsized":"2024-04-22T06:34:17.859569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37755,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:07.285564+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:34:07.285564+0000","last_peered":"2024-04-22T06:34:07.285564+0000","last_clean":"2024-04-22T06:34:07.285564+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:34:07.285564+0000","last_undegraded":"2024-04-22T06:34:07.285564+0000","last_fullsized":"2024-04-22T06:34:07.285564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150204+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:32:19.150204+0000","last_peered":"2024-04-22T06:32:19.150204+0000","last_clean":"2024-04-22T06:32:19.150204+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:32:19.150204+0000","last_undegraded":"2024-04-22T06:32:19.150204+0000","last_fullsized":"2024-04-22T06:32:19.150204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:11.923418+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:34:11.923418+0000","last_peered":"2024-04-22T06:34:11.923418+0000","last_clean":"2024-04-22T06:34:11.923418+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:34:11.923418+0000","last_undegraded":"2024-04-22T06:34:11.923418+0000","last_fullsized":"2024-04-22T06:34:11.923418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150095+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:32:19.150095+0000","last_peered":"2024-04-22T06:32:19.150095+0000","last_clean":"2024-04-22T06:32:19.150095+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:32:19.150095+0000","last_undegraded":"2024-04-22T06:32:19.150095+0000","last_fullsized":"2024-04-22T06:32:19.150095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981808+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:32:18.981808+0000","last_peered":"2024-04-22T06:32:18.981808+0000","last_clean":"2024-04-22T06:32:18.981808+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:32:18.981808+0000","last_undegraded":"2024-04-22T06:32:18.981808+0000","last_fullsized":"2024-04-22T06:32:18.981808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982245+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:32:24.982245+0000","last_peered":"2024-04-22T06:32:24.982245+0000","last_clean":"2024-04-22T06:32:24.982245+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:32:24.982245+0000","last_undegraded":"2024-04-22T06:32:24.982245+0000","last_fullsized":"2024-04-22T06:32:24.982245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966033+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:32:18.966033+0000","last_peered":"2024-04-22T06:32:18.966033+0000","last_clean":"2024-04-22T06:32:18.966033+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:32:18.966033+0000","last_undegraded":"2024-04-22T06:32:18.966033+0000","last_fullsized":"2024-04-22T06:32:18.966033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967651+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:32:18.967651+0000","last_peered":"2024-04-22T06:32:18.967651+0000","last_clean":"2024-04-22T06:32:18.967651+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:32:18.967651+0000","last_undegraded":"2024-04-22T06:32:18.967651+0000","last_fullsized":"2024-04-22T06:32:18.967651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:04.206636+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:34:04.206636+0000","last_peered":"2024-04-22T06:34:04.206636+0000","last_clean":"2024-04-22T06:34:04.206636+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:34:04.206636+0000","last_undegraded":"2024-04-22T06:34:04.206636+0000","last_fullsized":"2024-04-22T06:34:04.206636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966093+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:32:18.966093+0000","last_peered":"2024-04-22T06:32:18.966093+0000","last_clean":"2024-04-22T06:32:18.966093+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:32:18.966093+0000","last_undegraded":"2024-04-22T06:32:18.966093+0000","last_fullsized":"2024-04-22T06:32:18.966093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981109+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:32:18.981109+0000","last_peered":"2024-04-22T06:32:18.981109+0000","last_clean":"2024-04-22T06:32:18.981109+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:32:18.981109+0000","last_undegraded":"2024-04-22T06:32:18.981109+0000","last_fullsized":"2024-04-22T06:32:18.981109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969532+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:32:18.969532+0000","last_peered":"2024-04-22T06:32:18.969532+0000","last_clean":"2024-04-22T06:32:18.969532+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:32:18.969532+0000","last_undegraded":"2024-04-22T06:32:18.969532+0000","last_fullsized":"2024-04-22T06:32:18.969532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977221+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:32:24.977221+0000","last_peered":"2024-04-22T06:32:24.977221+0000","last_clean":"2024-04-22T06:32:24.977221+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:32:24.977221+0000","last_undegraded":"2024-04-22T06:32:24.977221+0000","last_fullsized":"2024-04-22T06:32:24.977221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.983767+0000","last_change":"2024-04-22T06:32:18.982812+0000","last_active":"2024-04-22T06:32:18.983767+0000","last_peered":"2024-04-22T06:32:18.983767+0000","last_clean":"2024-04-22T06:32:18.983767+0000","last_became_active":"2024-04-22T06:32:18.982355+0000","last_became_peered":"2024-04-22T06:32:18.982355+0000","last_unstale":"2024-04-22T06:32:18.983767+0000","last_undegraded":"2024-04-22T06:32:18.983767+0000","last_fullsized":"2024-04-22T06:32:18.983767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:01:41.368881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966059+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:32:18.966059+0000","last_peered":"2024-04-22T06:32:18.966059+0000","last_clean":"2024-04-22T06:32:18.966059+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:32:18.966059+0000","last_undegraded":"2024-04-22T06:32:18.966059+0000","last_fullsized":"2024-04-22T06:32:18.966059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982017+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:32:24.982017+0000","last_peered":"2024-04-22T06:32:24.982017+0000","last_clean":"2024-04-22T06:32:24.982017+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:32:24.982017+0000","last_undegraded":"2024-04-22T06:32:24.982017+0000","last_fullsized":"2024-04-22T06:32:24.982017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967106+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:32:18.967106+0000","last_peered":"2024-04-22T06:32:18.967106+0000","last_clean":"2024-04-22T06:32:18.967106+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:32:18.967106+0000","last_undegraded":"2024-04-22T06:32:18.967106+0000","last_fullsized":"2024-04-22T06:32:18.967106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981566+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:32:18.981566+0000","last_peered":"2024-04-22T06:32:18.981566+0000","last_clean":"2024-04-22T06:32:18.981566+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:32:18.981566+0000","last_undegraded":"2024-04-22T06:32:18.981566+0000","last_fullsized":"2024-04-22T06:32:18.981566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.984626+0000","last_change":"2024-04-22T06:32:18.982586+0000","last_active":"2024-04-22T06:32:18.984626+0000","last_peered":"2024-04-22T06:32:18.984626+0000","last_clean":"2024-04-22T06:32:18.984626+0000","last_became_active":"2024-04-22T06:32:18.982159+0000","last_became_peered":"2024-04-22T06:32:18.982159+0000","last_unstale":"2024-04-22T06:32:18.984626+0000","last_undegraded":"2024-04-22T06:32:18.984626+0000","last_fullsized":"2024-04-22T06:32:18.984626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:37.104899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.256691+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:32:33.256691+0000","last_peered":"2024-04-22T06:32:33.256691+0000","last_clean":"2024-04-22T06:32:33.256691+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:32:33.256691+0000","last_undegraded":"2024-04-22T06:32:33.256691+0000","last_fullsized":"2024-04-22T06:32:33.256691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149982+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:32:19.149982+0000","last_peered":"2024-04-22T06:32:19.149982+0000","last_clean":"2024-04-22T06:32:19.149982+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:32:19.149982+0000","last_undegraded":"2024-04-22T06:32:19.149982+0000","last_fullsized":"2024-04-22T06:32:19.149982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.154071+0000","last_change":"2024-04-22T06:32:19.151801+0000","last_active":"2024-04-22T06:32:19.154071+0000","last_peered":"2024-04-22T06:32:19.154071+0000","last_clean":"2024-04-22T06:32:19.154071+0000","last_became_active":"2024-04-22T06:32:19.151353+0000","last_became_peered":"2024-04-22T06:32:19.151353+0000","last_unstale":"2024-04-22T06:32:19.154071+0000","last_undegraded":"2024-04-22T06:32:19.154071+0000","last_fullsized":"2024-04-22T06:32:19.154071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:11.699970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967441+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:32:18.967441+0000","last_peered":"2024-04-22T06:32:18.967441+0000","last_clean":"2024-04-22T06:32:18.967441+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:32:18.967441+0000","last_undegraded":"2024-04-22T06:32:18.967441+0000","last_fullsized":"2024-04-22T06:32:18.967441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968335+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:32:18.968335+0000","last_peered":"2024-04-22T06:32:18.968335+0000","last_clean":"2024-04-22T06:32:18.968335+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:32:18.968335+0000","last_undegraded":"2024-04-22T06:32:18.968335+0000","last_fullsized":"2024-04-22T06:32:18.968335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967509+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:32:18.967509+0000","last_peered":"2024-04-22T06:32:18.967509+0000","last_clean":"2024-04-22T06:32:18.967509+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:32:18.967509+0000","last_undegraded":"2024-04-22T06:32:18.967509+0000","last_fullsized":"2024-04-22T06:32:18.967509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981517+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:32:18.981517+0000","last_peered":"2024-04-22T06:32:18.981517+0000","last_clean":"2024-04-22T06:32:18.981517+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:32:18.981517+0000","last_undegraded":"2024-04-22T06:32:18.981517+0000","last_fullsized":"2024-04-22T06:32:18.981517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966671+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:32:18.966671+0000","last_peered":"2024-04-22T06:32:18.966671+0000","last_clean":"2024-04-22T06:32:18.966671+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:32:18.966671+0000","last_undegraded":"2024-04-22T06:32:18.966671+0000","last_fullsized":"2024-04-22T06:32:18.966671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969307+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:32:18.969307+0000","last_peered":"2024-04-22T06:32:18.969307+0000","last_clean":"2024-04-22T06:32:18.969307+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:32:18.969307+0000","last_undegraded":"2024-04-22T06:32:18.969307+0000","last_fullsized":"2024-04-22T06:32:18.969307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968602+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:32:18.968602+0000","last_peered":"2024-04-22T06:32:18.968602+0000","last_clean":"2024-04-22T06:32:18.968602+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:32:18.968602+0000","last_undegraded":"2024-04-22T06:32:18.968602+0000","last_fullsized":"2024-04-22T06:32:18.968602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.993285+0000","last_change":"2024-04-22T06:32:19.151471+0000","last_active":"2024-04-22T06:32:19.993285+0000","last_peered":"2024-04-22T06:32:19.993285+0000","last_clean":"2024-04-22T06:32:19.993285+0000","last_became_active":"2024-04-22T06:32:19.151207+0000","last_became_peered":"2024-04-22T06:32:19.151207+0000","last_unstale":"2024-04-22T06:32:19.993285+0000","last_undegraded":"2024-04-22T06:32:19.993285+0000","last_fullsized":"2024-04-22T06:32:19.993285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:37:11.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966641+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:32:18.966641+0000","last_peered":"2024-04-22T06:32:18.966641+0000","last_clean":"2024-04-22T06:32:18.966641+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:32:18.966641+0000","last_undegraded":"2024-04-22T06:32:18.966641+0000","last_fullsized":"2024-04-22T06:32:18.966641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966443+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:32:18.966443+0000","last_peered":"2024-04-22T06:32:18.966443+0000","last_clean":"2024-04-22T06:32:18.966443+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:32:18.966443+0000","last_undegraded":"2024-04-22T06:32:18.966443+0000","last_fullsized":"2024-04-22T06:32:18.966443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967417+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:32:18.967417+0000","last_peered":"2024-04-22T06:32:18.967417+0000","last_clean":"2024-04-22T06:32:18.967417+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:32:18.967417+0000","last_undegraded":"2024-04-22T06:32:18.967417+0000","last_fullsized":"2024-04-22T06:32:18.967417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981427+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:32:18.981427+0000","last_peered":"2024-04-22T06:32:18.981427+0000","last_clean":"2024-04-22T06:32:18.981427+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:32:18.981427+0000","last_undegraded":"2024-04-22T06:32:18.981427+0000","last_fullsized":"2024-04-22T06:32:18.981427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968042+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:32:18.968042+0000","last_peered":"2024-04-22T06:32:18.968042+0000","last_clean":"2024-04-22T06:32:18.968042+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:32:18.968042+0000","last_undegraded":"2024-04-22T06:32:18.968042+0000","last_fullsized":"2024-04-22T06:32:18.968042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294620+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:32:19.294620+0000","last_peered":"2024-04-22T06:32:19.294620+0000","last_clean":"2024-04-22T06:32:19.294620+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:32:19.294620+0000","last_undegraded":"2024-04-22T06:32:19.294620+0000","last_fullsized":"2024-04-22T06:32:19.294620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968136+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:32:18.968136+0000","last_peered":"2024-04-22T06:32:18.968136+0000","last_clean":"2024-04-22T06:32:18.968136+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:32:18.968136+0000","last_undegraded":"2024-04-22T06:32:18.968136+0000","last_fullsized":"2024-04-22T06:32:18.968136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968002+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:32:18.968002+0000","last_peered":"2024-04-22T06:32:18.968002+0000","last_clean":"2024-04-22T06:32:18.968002+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:32:18.968002+0000","last_undegraded":"2024-04-22T06:32:18.968002+0000","last_fullsized":"2024-04-22T06:32:18.968002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191784+0000","last_change":"2024-04-22T06:32:18.981673+0000","last_active":"2024-04-22T06:32:19.191784+0000","last_peered":"2024-04-22T06:32:19.191784+0000","last_clean":"2024-04-22T06:32:19.191784+0000","last_became_active":"2024-04-22T06:32:18.981385+0000","last_became_peered":"2024-04-22T06:32:18.981385+0000","last_unstale":"2024-04-22T06:32:19.191784+0000","last_undegraded":"2024-04-22T06:32:19.191784+0000","last_fullsized":"2024-04-22T06:32:19.191784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:12:05.631449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969043+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:32:18.969043+0000","last_peered":"2024-04-22T06:32:18.969043+0000","last_clean":"2024-04-22T06:32:18.969043+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:32:18.969043+0000","last_undegraded":"2024-04-22T06:32:18.969043+0000","last_fullsized":"2024-04-22T06:32:18.969043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:58.999631+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:33:58.999631+0000","last_peered":"2024-04-22T06:33:58.999631+0000","last_clean":"2024-04-22T06:33:58.999631+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:33:58.999631+0000","last_undegraded":"2024-04-22T06:33:58.999631+0000","last_fullsized":"2024-04-22T06:33:58.999631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966202+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:32:18.966202+0000","last_peered":"2024-04-22T06:32:18.966202+0000","last_clean":"2024-04-22T06:32:18.966202+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:32:18.966202+0000","last_undegraded":"2024-04-22T06:32:18.966202+0000","last_fullsized":"2024-04-22T06:32:18.966202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150299+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:32:19.150299+0000","last_peered":"2024-04-22T06:32:19.150299+0000","last_clean":"2024-04-22T06:32:19.150299+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:32:19.150299+0000","last_undegraded":"2024-04-22T06:32:19.150299+0000","last_fullsized":"2024-04-22T06:32:19.150299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968345+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:32:18.968345+0000","last_peered":"2024-04-22T06:32:18.968345+0000","last_clean":"2024-04-22T06:32:18.968345+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:32:18.968345+0000","last_undegraded":"2024-04-22T06:32:18.968345+0000","last_fullsized":"2024-04-22T06:32:18.968345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968555+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:32:18.968555+0000","last_peered":"2024-04-22T06:32:18.968555+0000","last_clean":"2024-04-22T06:32:18.968555+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:32:18.968555+0000","last_undegraded":"2024-04-22T06:32:18.968555+0000","last_fullsized":"2024-04-22T06:32:18.968555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294891+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:32:19.294891+0000","last_peered":"2024-04-22T06:32:19.294891+0000","last_clean":"2024-04-22T06:32:19.294891+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:32:19.294891+0000","last_undegraded":"2024-04-22T06:32:19.294891+0000","last_fullsized":"2024-04-22T06:32:19.294891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965958+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:32:18.965958+0000","last_peered":"2024-04-22T06:32:18.965958+0000","last_clean":"2024-04-22T06:32:18.965958+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:32:18.965958+0000","last_undegraded":"2024-04-22T06:32:18.965958+0000","last_fullsized":"2024-04-22T06:32:18.965958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294233+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:32:19.294233+0000","last_peered":"2024-04-22T06:32:19.294233+0000","last_clean":"2024-04-22T06:32:19.294233+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:32:19.294233+0000","last_undegraded":"2024-04-22T06:32:19.294233+0000","last_fullsized":"2024-04-22T06:32:19.294233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967320+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:32:18.967320+0000","last_peered":"2024-04-22T06:32:18.967320+0000","last_clean":"2024-04-22T06:32:18.967320+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:32:18.967320+0000","last_undegraded":"2024-04-22T06:32:18.967320+0000","last_fullsized":"2024-04-22T06:32:18.967320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294281+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:32:19.294281+0000","last_peered":"2024-04-22T06:32:19.294281+0000","last_clean":"2024-04-22T06:32:19.294281+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:32:19.294281+0000","last_undegraded":"2024-04-22T06:32:19.294281+0000","last_fullsized":"2024-04-22T06:32:19.294281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967670+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:32:18.967670+0000","last_peered":"2024-04-22T06:32:18.967670+0000","last_clean":"2024-04-22T06:32:18.967670+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:32:18.967670+0000","last_undegraded":"2024-04-22T06:32:18.967670+0000","last_fullsized":"2024-04-22T06:32:18.967670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981210+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:32:18.981210+0000","last_peered":"2024-04-22T06:32:18.981210+0000","last_clean":"2024-04-22T06:32:18.981210+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:32:18.981210+0000","last_undegraded":"2024-04-22T06:32:18.981210+0000","last_fullsized":"2024-04-22T06:32:18.981210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969561+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:32:18.969561+0000","last_peered":"2024-04-22T06:32:18.969561+0000","last_clean":"2024-04-22T06:32:18.969561+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:32:18.969561+0000","last_undegraded":"2024-04-22T06:32:18.969561+0000","last_fullsized":"2024-04-22T06:32:18.969561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294826+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:32:19.294826+0000","last_peered":"2024-04-22T06:32:19.294826+0000","last_clean":"2024-04-22T06:32:19.294826+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:32:19.294826+0000","last_undegraded":"2024-04-22T06:32:19.294826+0000","last_fullsized":"2024-04-22T06:32:19.294826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45811,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":244,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":91622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":153347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":153692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":116575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":39331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":38986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:35:01.830 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:35:01.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.862+0000 7f2bde631640 1 Processor -- start 2024-04-22T06:35:01.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.863+0000 7f2bde631640 1 -- start start 2024-04-22T06:35:01.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.863+0000 7f2bde631640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2bd815cd70 0x7f2bd815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.863+0000 7f2bde631640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd8072380 con 0x7f2bd80c7ea0 2024-04-22T06:35:01.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.863+0000 7f2bde631640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd8072660 con 0x7f2bd8144150 2024-04-22T06:35:01.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.863+0000 7f2bde631640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd815c030 con 0x7f2bd815cd70 2024-04-22T06:35:01.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.863+0000 7f2bd77fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2bd80c7ea0 0x7f2bd815c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39828/0 (socket says 172.21.15.113:39828) 2024-04-22T06:35:01.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.863+0000 7f2bd77fe640 1 -- 172.21.15.113:0/900165028 learned_addr learned my addr 172.21.15.113:0/900165028 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:01.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.864+0000 7f2bdcbce640 1 --2- 172.21.15.113:0/900165028 >> v2:172.21.15.145:3300/0 conn(0x7f2bd815cd70 0x7f2bd815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.864+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/900165028 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610213512 0 0) 0x7f2bd8072380 con 0x7f2bd80c7ea0 2024-04-22T06:35:01.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.864+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/900165028 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bc0003520 con 0x7f2bd80c7ea0 2024-04-22T06:35:01.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.864+0000 7f2bdcbce640 1 -- 172.21.15.113:0/900165028 >> v1:172.21.15.145:6789/0 conn(0x7f2bd8144150 legacy=0x7f2bd8074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.864+0000 7f2bdcbce640 1 -- 172.21.15.113:0/900165028 >> v1:172.21.15.113:6789/0 conn(0x7f2bd80c7ea0 legacy=0x7f2bd815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.864+0000 7f2bdcbce640 1 -- 172.21.15.113:0/900165028 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd8072940 con 0x7f2bd815cd70 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.865+0000 7f2bdcbce640 1 --2- 172.21.15.113:0/900165028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd815cd70 0x7f2bd815baf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009d90 tx=0x7f2bd002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c9a07cd1686d615 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.865+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/900165028 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0039070 con 0x7f2bd815cd70 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.865+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/900165028 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd002cd80 con 0x7f2bd815cd70 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.865+0000 7f2bd6ffd640 1 -- 172.21.15.113:0/900165028 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0034660 con 0x7f2bd815cd70 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.866+0000 7f2bde631640 1 -- 172.21.15.113:0/900165028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd815cd70 msgr2=0x7f2bd815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.866+0000 7f2bde631640 1 --2- 172.21.15.113:0/900165028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd815cd70 0x7f2bd815baf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009d90 tx=0x7f2bd002bfd0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.866+0000 7f2bde631640 1 -- 172.21.15.113:0/900165028 shutdown_connections 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.866+0000 7f2bde631640 1 --2- 172.21.15.113:0/900165028 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd815cd70 0x7f2bd815baf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.866+0000 7f2bde631640 1 -- 172.21.15.113:0/900165028 >> 172.21.15.113:0/900165028 conn(0x7f2bd806b920 msgr2=0x7f2bd806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.866+0000 7f2bde631640 1 -- 172.21.15.113:0/900165028 shutdown_connections 2024-04-22T06:35:01.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.866+0000 7f2bde631640 1 -- 172.21.15.113:0/900165028 wait complete. 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.867+0000 7f2bde631640 1 Processor -- start 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.867+0000 7f2bde631640 1 -- start start 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bde631640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd80c7ea0 0x7f2bd80ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bde631640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8144150 0x7f2bd81f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bde631640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2bd815cd70 0x7f2bd8159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bde631640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd8072f00 con 0x7f2bd8144150 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bde631640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80c82f0 con 0x7f2bd80c7ea0 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bde631640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd8144530 con 0x7f2bd815cd70 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8144150 0x7f2bd81f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8144150 0x7f2bd81f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49674/0 (socket says 172.21.15.113:49674) 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 -- 172.21.15.113:0/1024369401 learned_addr learned my addr 172.21.15.113:0/1024369401 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:01.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bdcbce640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2bd815cd70 0x7f2bd8159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd7fff640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd80c7ea0 0x7f2bd80ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 -- 172.21.15.113:0/1024369401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2bd815cd70 msgr2=0x7f2bd8159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2bd815cd70 0x7f2bd8159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 -- 172.21.15.113:0/1024369401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd80c7ea0 msgr2=0x7f2bd80ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd80c7ea0 0x7f2bd80ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 -- 172.21.15.113:0/1024369401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd80cac10 con 0x7f2bd8144150 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd77fe640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8144150 0x7f2bd81f4e30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c530 tx=0x7f2bcc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.868+0000 7f2bd4ff9640 1 -- 172.21.15.113:0/1024369401 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc017070 con 0x7f2bd8144150 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.869+0000 7f2bd4ff9640 1 -- 172.21.15.113:0/1024369401 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bcc005ce0 con 0x7f2bd8144150 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.869+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd81f5370 con 0x7f2bd8144150 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.869+0000 7f2bd4ff9640 1 -- 172.21.15.113:0/1024369401 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0072b0 con 0x7f2bd8144150 2024-04-22T06:35:01.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.869+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd81f1100 con 0x7f2bd8144150 2024-04-22T06:35:01.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.870+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd8068f50 con 0x7f2bd8144150 2024-04-22T06:35:01.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.870+0000 7f2bd4ff9640 1 -- 172.21.15.113:0/1024369401 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bcc01a070 con 0x7f2bd8144150 2024-04-22T06:35:01.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.870+0000 7f2bd4ff9640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2bc406c920 0x7f2bc406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.870+0000 7f2bd4ff9640 1 -- 172.21.15.113:0/1024369401 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2bcc08b2e0 con 0x7f2bd8144150 2024-04-22T06:35:01.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.870+0000 7f2bd7fff640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2bc406c920 0x7f2bc406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.871+0000 7f2bd7fff640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2bc406c920 0x7f2bc406ede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8001780 tx=0x7f2bc8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.875+0000 7f2bd4ff9640 1 -- 172.21.15.113:0/1024369401 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2bd81f5370 con 0x7f2bd8144150 2024-04-22T06:35:01.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.963+0000 7f6ba1c3a640 1 Processor -- start 2024-04-22T06:35:01.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.963+0000 7f6ba1c3a640 1 -- start start 2024-04-22T06:35:01.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6ba1c3a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6b9c0ca6e0 0x7f6b9c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6ba1c3a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6b9c0caac0 0x7f6b9c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6ba1c3a640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0c6bf0 con 0x7f6b9c0708b0 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6ba1c3a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f6b9c0c5600 con 0x7f6b9c0caac0 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6ba1c3a640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f6b9c0c6e60 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6b9c0caac0 0x7f6b9c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6b9c0708b0 0x7f6b9c1595d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39844/0 (socket says 172.21.15.113:39844) 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6b9c0caac0 0x7f6b9c1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49690/0 (socket says 172.21.15.113:49690) 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9bfff640 1 -- 172.21.15.113:0/2357093300 learned_addr learned my addr 172.21.15.113:0/2357093300 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:01.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9b7fe640 1 --2- 172.21.15.113:0/2357093300 >> v2:172.21.15.145:3300/0 conn(0x7f6b9c0ca6e0 0x7f6b9c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9affd640 1 -- 172.21.15.113:0/2357093300 >> v2:172.21.15.145:3300/0 conn(0x7f6b9c0ca6e0 msgr2=0x7f6b9c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9affd640 1 --2- 172.21.15.113:0/2357093300 >> v2:172.21.15.145:3300/0 conn(0x7f6b9c0ca6e0 0x7f6b9c152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9affd640 1 -- 172.21.15.113:0/2357093300 >> v1:172.21.15.113:6789/0 conn(0x7f6b9c0708b0 legacy=0x7f6b9c1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9affd640 1 -- 172.21.15.113:0/2357093300 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c0c7140 con 0x7f6b9c0caac0 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.964+0000 7f6b9a7fc640 1 -- 172.21.15.113:0/2357093300 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 857989533 0 0) 0x7f6b9c0c6bf0 con 0x7f6b9c0708b0 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.965+0000 7f6b9affd640 1 --2- 172.21.15.113:0/2357093300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0caac0 0x7f6b9c1530f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c075db0 tx=0x7f6b8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08038eb42340ae0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.965+0000 7f6b9a7fc640 1 -- 172.21.15.113:0/2357093300 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c035020 con 0x7f6b9c0caac0 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.965+0000 7f6b9a7fc640 1 -- 172.21.15.113:0/2357093300 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c031830 con 0x7f6b9c0caac0 2024-04-22T06:35:01.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.965+0000 7f6b9a7fc640 1 -- 172.21.15.113:0/2357093300 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c031c00 con 0x7f6b9c0caac0 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.966+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/2357093300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0caac0 msgr2=0x7f6b9c1530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.966+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/2357093300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0caac0 0x7f6b9c1530f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c075db0 tx=0x7f6b8c02b8d0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.966+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/2357093300 shutdown_connections 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.966+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/2357093300 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0caac0 0x7f6b9c1530f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.966+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/2357093300 >> v2:172.21.15.145:3300/0 conn(0x7f6b9c0ca6e0 0x7f6b9c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.966+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/2357093300 >> 172.21.15.113:0/2357093300 conn(0x7f6b9c06bd10 msgr2=0x7f6b9c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.966+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/2357093300 shutdown_connections 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.966+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/2357093300 wait complete. 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.967+0000 7f6ba1c3a640 1 Processor -- start 2024-04-22T06:35:01.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.967+0000 7f6ba1c3a640 1 -- start start 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6ba1c3a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0708b0 0x7f6b9c072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6ba1c3a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0ca6e0 0x7f6b9c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6ba1c3a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0caac0 0x7f6b9c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6ba1c3a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0c79e0 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6ba1c3a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0c7700 con 0x7f6b9c0caac0 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6ba1c3a640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c1590b0 con 0x7f6b9c0708b0 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0ca6e0 0x7f6b9c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0ca6e0 0x7f6b9c1505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49704/0 (socket says 172.21.15.113:49704) 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9affd640 1 -- 172.21.15.113:0/1887731488 learned_addr learned my addr 172.21.15.113:0/1887731488 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9bfff640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0caac0 0x7f6b9c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9b7fe640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0708b0 0x7f6b9c072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9affd640 1 -- 172.21.15.113:0/1887731488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0708b0 msgr2=0x7f6b9c072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9affd640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0708b0 0x7f6b9c072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9affd640 1 -- 172.21.15.113:0/1887731488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0caac0 msgr2=0x7f6b9c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9affd640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0caac0 0x7f6b9c0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.968+0000 7f6b9affd640 1 -- 172.21.15.113:0/1887731488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c150d50 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.969+0000 7f6b9affd640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0ca6e0 0x7f6b9c1505f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000c00 tx=0x7f6b8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.969+0000 7f6b83fff640 1 -- 172.21.15.113:0/1887731488 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c040070 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.969+0000 7f6b83fff640 1 -- 172.21.15.113:0/1887731488 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c039940 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.969+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c151030 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.969+0000 7f6b83fff640 1 -- 172.21.15.113:0/1887731488 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c035040 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.969+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c1f46e0 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.970+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c068e40 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.970+0000 7f6b83fff640 1 -- 172.21.15.113:0/1887731488 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b8c04b060 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.971+0000 7f6b83fff640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6b8806c920 0x7f6b8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:01.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.971+0000 7f6b83fff640 1 -- 172.21.15.113:0/1887731488 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6b8c0ad820 con 0x7f6b9c0ca6e0 2024-04-22T06:35:01.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.971+0000 7f6b9b7fe640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6b8806c920 0x7f6b8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:01.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.971+0000 7f6b9b7fe640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6b8806c920 0x7f6b8806ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000aac0 tx=0x7f6b90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:01.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:01.975+0000 7f6b83fff640 1 -- 172.21.15.113:0/1887731488 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b8c07b200 con 0x7f6b9c0ca6e0 2024-04-22T06:35:02.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.060+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2bd815e380 con 0x7f2bd8144150 2024-04-22T06:35:02.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.061+0000 7f2bd4ff9640 1 -- 172.21.15.113:0/1024369401 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2bcc058cf0 con 0x7f2bd8144150 2024-04-22T06:35:02.060 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:35:02.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2bc406c920 msgr2=0x7f2bc406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2bc406c920 0x7f2bc406ede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8001780 tx=0x7f2bc8009040 comp rx=0 tx=0).stop 2024-04-22T06:35:02.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8144150 msgr2=0x7f2bd81f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8144150 0x7f2bd81f4e30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c530 tx=0x7f2bcc00c9f0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 shutdown_connections 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2bd815cd70 0x7f2bd8159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f2bc406c920 0x7f2bc406ede0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2bd8144150 0x7f2bd81f4e30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 --2- 172.21.15.113:0/1024369401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2bd80c7ea0 0x7f2bd80ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 >> 172.21.15.113:0/1024369401 conn(0x7f2bd806b920 msgr2=0x7f2bd80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 shutdown_connections 2024-04-22T06:35:02.063 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.063+0000 7f2bde631640 1 -- 172.21.15.113:0/1024369401 wait complete. 2024-04-22T06:35:02.073 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T06:35:02.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.155+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b9c0703e0 con 0x7f6b8806c920 2024-04-22T06:35:02.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.163+0000 7f6b83fff640 1 -- 172.21.15.113:0/1887731488 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332637 (secure 0 0 0) 0x7f6b9c0703e0 con 0x7f6b8806c920 2024-04-22T06:35:02.165 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:35:02.167 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:35:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6b8806c920 msgr2=0x7f6b8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6b8806c920 0x7f6b8806ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000aac0 tx=0x7f6b90008040 comp rx=0 tx=0).stop 2024-04-22T06:35:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0ca6e0 msgr2=0x7f6b9c1505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0ca6e0 0x7f6b9c1505f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000c00 tx=0x7f6b8c0046c0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 shutdown_connections 2024-04-22T06:35:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b9c0caac0 0x7f6b9c0cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f6b8806c920 0x7f6b8806ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6b9c0ca6e0 0x7f6b9c1505f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 --2- 172.21.15.113:0/1887731488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b9c0708b0 0x7f6b9c072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 >> 172.21.15.113:0/1887731488 conn(0x7f6b9c06bd10 msgr2=0x7f6b9c0c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 shutdown_connections 2024-04-22T06:35:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.166+0000 7f6ba1c3a640 1 -- 172.21.15.113:0/1887731488 wait complete. 2024-04-22T06:35:02.176 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-04-22T06:35:01.018980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636179,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":405,"num_write_kb":2536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219800,"kb_used_data":3672,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754920,"statfs":{"total":773094113280,"available":772869038080,"internally_reserved":0,"allocated":3760128,"data_stored":2187246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003369"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979949+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:32:24.979949+0000","last_peered":"2024-04-22T06:32:24.979949+0000","last_clean":"2024-04-22T06:32:24.979949+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:32:24.979949+0000","last_undegraded":"2024-04-22T06:32:24.979949+0000","last_fullsized":"2024-04-22T06:32:24.979949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966594+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:32:18.966594+0000","last_peered":"2024-04-22T06:32:18.966594+0000","last_clean":"2024-04-22T06:32:18.966594+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:32:18.966594+0000","last_undegraded":"2024-04-22T06:32:18.966594+0000","last_fullsized":"2024-04-22T06:32:18.966594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965912+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:32:18.965912+0000","last_peered":"2024-04-22T06:32:18.965912+0000","last_clean":"2024-04-22T06:32:18.965912+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:32:18.965912+0000","last_undegraded":"2024-04-22T06:32:18.965912+0000","last_fullsized":"2024-04-22T06:32:18.965912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966787+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:32:18.966787+0000","last_peered":"2024-04-22T06:32:18.966787+0000","last_clean":"2024-04-22T06:32:18.966787+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:32:18.966787+0000","last_undegraded":"2024-04-22T06:32:18.966787+0000","last_fullsized":"2024-04-22T06:32:18.966787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981724+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:32:18.981724+0000","last_peered":"2024-04-22T06:32:18.981724+0000","last_clean":"2024-04-22T06:32:18.981724+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:32:18.981724+0000","last_undegraded":"2024-04-22T06:32:18.981724+0000","last_fullsized":"2024-04-22T06:32:18.981724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149528+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:32:19.149528+0000","last_peered":"2024-04-22T06:32:19.149528+0000","last_clean":"2024-04-22T06:32:19.149528+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:32:19.149528+0000","last_undegraded":"2024-04-22T06:32:19.149528+0000","last_fullsized":"2024-04-22T06:32:19.149528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'13","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:09.007042+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:34:09.007042+0000","last_peered":"2024-04-22T06:34:09.007042+0000","last_clean":"2024-04-22T06:34:09.007042+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:34:09.007042+0000","last_undegraded":"2024-04-22T06:34:09.007042+0000","last_fullsized":"2024-04-22T06:34:09.007042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191815+0000","last_change":"2024-04-22T06:32:19.150976+0000","last_active":"2024-04-22T06:32:19.191815+0000","last_peered":"2024-04-22T06:32:19.191815+0000","last_clean":"2024-04-22T06:32:19.191815+0000","last_became_active":"2024-04-22T06:32:19.150701+0000","last_became_peered":"2024-04-22T06:32:19.150701+0000","last_unstale":"2024-04-22T06:32:19.191815+0000","last_undegraded":"2024-04-22T06:32:19.191815+0000","last_fullsized":"2024-04-22T06:32:19.191815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:03:07.842684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149975+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:32:19.149975+0000","last_peered":"2024-04-22T06:32:19.149975+0000","last_clean":"2024-04-22T06:32:19.149975+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:32:19.149975+0000","last_undegraded":"2024-04-22T06:32:19.149975+0000","last_fullsized":"2024-04-22T06:32:19.149975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979828+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:32:24.979828+0000","last_peered":"2024-04-22T06:32:24.979828+0000","last_clean":"2024-04-22T06:32:24.979828+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:32:24.979828+0000","last_undegraded":"2024-04-22T06:32:24.979828+0000","last_fullsized":"2024-04-22T06:32:24.979828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967681+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:32:18.967681+0000","last_peered":"2024-04-22T06:32:18.967681+0000","last_clean":"2024-04-22T06:32:18.967681+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:32:18.967681+0000","last_undegraded":"2024-04-22T06:32:18.967681+0000","last_fullsized":"2024-04-22T06:32:18.967681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149840+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:32:19.149840+0000","last_peered":"2024-04-22T06:32:19.149840+0000","last_clean":"2024-04-22T06:32:19.149840+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:32:19.149840+0000","last_undegraded":"2024-04-22T06:32:19.149840+0000","last_fullsized":"2024-04-22T06:32:19.149840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966898+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:32:18.966898+0000","last_peered":"2024-04-22T06:32:18.966898+0000","last_clean":"2024-04-22T06:32:18.966898+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:32:18.966898+0000","last_undegraded":"2024-04-22T06:32:18.966898+0000","last_fullsized":"2024-04-22T06:32:18.966898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:54.005385+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:33:54.005385+0000","last_peered":"2024-04-22T06:33:54.005385+0000","last_clean":"2024-04-22T06:33:54.005385+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:33:54.005385+0000","last_undegraded":"2024-04-22T06:33:54.005385+0000","last_fullsized":"2024-04-22T06:33:54.005385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150258+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:32:19.150258+0000","last_peered":"2024-04-22T06:32:19.150258+0000","last_clean":"2024-04-22T06:32:19.150258+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:32:19.150258+0000","last_undegraded":"2024-04-22T06:32:19.150258+0000","last_fullsized":"2024-04-22T06:32:19.150258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966165+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:32:18.966165+0000","last_peered":"2024-04-22T06:32:18.966165+0000","last_clean":"2024-04-22T06:32:18.966165+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:32:18.966165+0000","last_undegraded":"2024-04-22T06:32:18.966165+0000","last_fullsized":"2024-04-22T06:32:18.966165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.968385+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:32:24.968385+0000","last_peered":"2024-04-22T06:32:24.968385+0000","last_clean":"2024-04-22T06:32:24.968385+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:32:24.968385+0000","last_undegraded":"2024-04-22T06:32:24.968385+0000","last_fullsized":"2024-04-22T06:32:24.968385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150057+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:32:19.150057+0000","last_peered":"2024-04-22T06:32:19.150057+0000","last_clean":"2024-04-22T06:32:19.150057+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:32:19.150057+0000","last_undegraded":"2024-04-22T06:32:19.150057+0000","last_fullsized":"2024-04-22T06:32:19.150057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966154+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:32:18.966154+0000","last_peered":"2024-04-22T06:32:18.966154+0000","last_clean":"2024-04-22T06:32:18.966154+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:32:18.966154+0000","last_undegraded":"2024-04-22T06:32:18.966154+0000","last_fullsized":"2024-04-22T06:32:18.966154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.980015+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:32:24.980015+0000","last_peered":"2024-04-22T06:32:24.980015+0000","last_clean":"2024-04-22T06:32:24.980015+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:32:24.980015+0000","last_undegraded":"2024-04-22T06:32:24.980015+0000","last_fullsized":"2024-04-22T06:32:24.980015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969513+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:32:18.969513+0000","last_peered":"2024-04-22T06:32:18.969513+0000","last_clean":"2024-04-22T06:32:18.969513+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:32:18.969513+0000","last_undegraded":"2024-04-22T06:32:18.969513+0000","last_fullsized":"2024-04-22T06:32:18.969513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149897+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:32:19.149897+0000","last_peered":"2024-04-22T06:32:19.149897+0000","last_clean":"2024-04-22T06:32:19.149897+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:32:19.149897+0000","last_undegraded":"2024-04-22T06:32:19.149897+0000","last_fullsized":"2024-04-22T06:32:19.149897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.293982+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:32:19.293982+0000","last_peered":"2024-04-22T06:32:19.293982+0000","last_clean":"2024-04-22T06:32:19.293982+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:32:19.293982+0000","last_undegraded":"2024-04-22T06:32:19.293982+0000","last_fullsized":"2024-04-22T06:32:19.293982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150114+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:32:19.150114+0000","last_peered":"2024-04-22T06:32:19.150114+0000","last_clean":"2024-04-22T06:32:19.150114+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:32:19.150114+0000","last_undegraded":"2024-04-22T06:32:19.150114+0000","last_fullsized":"2024-04-22T06:32:19.150114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981691+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:32:18.981691+0000","last_peered":"2024-04-22T06:32:18.981691+0000","last_clean":"2024-04-22T06:32:18.981691+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:32:18.981691+0000","last_undegraded":"2024-04-22T06:32:18.981691+0000","last_fullsized":"2024-04-22T06:32:18.981691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:49.204587+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:33:49.204587+0000","last_peered":"2024-04-22T06:33:49.204587+0000","last_clean":"2024-04-22T06:33:49.204587+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:33:49.204587+0000","last_undegraded":"2024-04-22T06:33:49.204587+0000","last_fullsized":"2024-04-22T06:33:49.204587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149704+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:32:19.149704+0000","last_peered":"2024-04-22T06:32:19.149704+0000","last_clean":"2024-04-22T06:32:19.149704+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:32:19.149704+0000","last_undegraded":"2024-04-22T06:32:19.149704+0000","last_fullsized":"2024-04-22T06:32:19.149704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966851+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:32:18.966851+0000","last_peered":"2024-04-22T06:32:18.966851+0000","last_clean":"2024-04-22T06:32:18.966851+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:32:18.966851+0000","last_undegraded":"2024-04-22T06:32:18.966851+0000","last_fullsized":"2024-04-22T06:32:18.966851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'15","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:12.872770+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:34:12.872770+0000","last_peered":"2024-04-22T06:34:12.872770+0000","last_clean":"2024-04-22T06:34:12.872770+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:34:12.872770+0000","last_undegraded":"2024-04-22T06:34:12.872770+0000","last_fullsized":"2024-04-22T06:34:12.872770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965852+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:32:18.965852+0000","last_peered":"2024-04-22T06:32:18.965852+0000","last_clean":"2024-04-22T06:32:18.965852+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:32:18.965852+0000","last_undegraded":"2024-04-22T06:32:18.965852+0000","last_fullsized":"2024-04-22T06:32:18.965852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969613+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:32:18.969613+0000","last_peered":"2024-04-22T06:32:18.969613+0000","last_clean":"2024-04-22T06:32:18.969613+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:32:18.969613+0000","last_undegraded":"2024-04-22T06:32:18.969613+0000","last_fullsized":"2024-04-22T06:32:18.969613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.981124+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:32:24.981124+0000","last_peered":"2024-04-22T06:32:24.981124+0000","last_clean":"2024-04-22T06:32:24.981124+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:32:24.981124+0000","last_undegraded":"2024-04-22T06:32:24.981124+0000","last_fullsized":"2024-04-22T06:32:24.981124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981349+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:32:18.981349+0000","last_peered":"2024-04-22T06:32:18.981349+0000","last_clean":"2024-04-22T06:32:18.981349+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:32:18.981349+0000","last_undegraded":"2024-04-22T06:32:18.981349+0000","last_fullsized":"2024-04-22T06:32:18.981349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967577+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:32:18.967577+0000","last_peered":"2024-04-22T06:32:18.967577+0000","last_clean":"2024-04-22T06:32:18.967577+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:32:18.967577+0000","last_undegraded":"2024-04-22T06:32:18.967577+0000","last_fullsized":"2024-04-22T06:32:18.967577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969706+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:32:18.969706+0000","last_peered":"2024-04-22T06:32:18.969706+0000","last_clean":"2024-04-22T06:32:18.969706+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:32:18.969706+0000","last_undegraded":"2024-04-22T06:32:18.969706+0000","last_fullsized":"2024-04-22T06:32:18.969706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969255+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:32:18.969255+0000","last_peered":"2024-04-22T06:32:18.969255+0000","last_clean":"2024-04-22T06:32:18.969255+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:32:18.969255+0000","last_undegraded":"2024-04-22T06:32:18.969255+0000","last_fullsized":"2024-04-22T06:32:18.969255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150374+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:32:19.150374+0000","last_peered":"2024-04-22T06:32:19.150374+0000","last_clean":"2024-04-22T06:32:19.150374+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:32:19.150374+0000","last_undegraded":"2024-04-22T06:32:19.150374+0000","last_fullsized":"2024-04-22T06:32:19.150374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982527+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:32:24.982527+0000","last_peered":"2024-04-22T06:32:24.982527+0000","last_clean":"2024-04-22T06:32:24.982527+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:32:24.982527+0000","last_undegraded":"2024-04-22T06:32:24.982527+0000","last_fullsized":"2024-04-22T06:32:24.982527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969558+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:32:18.969558+0000","last_peered":"2024-04-22T06:32:18.969558+0000","last_clean":"2024-04-22T06:32:18.969558+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:32:18.969558+0000","last_undegraded":"2024-04-22T06:32:18.969558+0000","last_fullsized":"2024-04-22T06:32:18.969558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969031+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:32:18.969031+0000","last_peered":"2024-04-22T06:32:18.969031+0000","last_clean":"2024-04-22T06:32:18.969031+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:32:18.969031+0000","last_undegraded":"2024-04-22T06:32:18.969031+0000","last_fullsized":"2024-04-22T06:32:18.969031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'8","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:11.925112+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:34:11.925112+0000","last_peered":"2024-04-22T06:34:11.925112+0000","last_clean":"2024-04-22T06:34:11.925112+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:34:11.925112+0000","last_undegraded":"2024-04-22T06:34:11.925112+0000","last_fullsized":"2024-04-22T06:34:11.925112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969534+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:32:18.969534+0000","last_peered":"2024-04-22T06:32:18.969534+0000","last_clean":"2024-04-22T06:32:18.969534+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:32:18.969534+0000","last_undegraded":"2024-04-22T06:32:18.969534+0000","last_fullsized":"2024-04-22T06:32:18.969534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981050+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:32:18.981050+0000","last_peered":"2024-04-22T06:32:18.981050+0000","last_clean":"2024-04-22T06:32:18.981050+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:32:18.981050+0000","last_undegraded":"2024-04-22T06:32:18.981050+0000","last_fullsized":"2024-04-22T06:32:18.981050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979386+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:32:24.979386+0000","last_peered":"2024-04-22T06:32:24.979386+0000","last_clean":"2024-04-22T06:32:24.979386+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:32:24.979386+0000","last_undegraded":"2024-04-22T06:32:24.979386+0000","last_fullsized":"2024-04-22T06:32:24.979386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981568+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:32:18.981568+0000","last_peered":"2024-04-22T06:32:18.981568+0000","last_clean":"2024-04-22T06:32:18.981568+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:32:18.981568+0000","last_undegraded":"2024-04-22T06:32:18.981568+0000","last_fullsized":"2024-04-22T06:32:18.981568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966266+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:32:18.966266+0000","last_peered":"2024-04-22T06:32:18.966266+0000","last_clean":"2024-04-22T06:32:18.966266+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:32:18.966266+0000","last_undegraded":"2024-04-22T06:32:18.966266+0000","last_fullsized":"2024-04-22T06:32:18.966266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978712+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:32:24.978712+0000","last_peered":"2024-04-22T06:32:24.978712+0000","last_clean":"2024-04-22T06:32:24.978712+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:32:24.978712+0000","last_undegraded":"2024-04-22T06:32:24.978712+0000","last_fullsized":"2024-04-22T06:32:24.978712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294104+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:32:19.294104+0000","last_peered":"2024-04-22T06:32:19.294104+0000","last_clean":"2024-04-22T06:32:19.294104+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:32:19.294104+0000","last_undegraded":"2024-04-22T06:32:19.294104+0000","last_fullsized":"2024-04-22T06:32:19.294104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968189+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:32:18.968189+0000","last_peered":"2024-04-22T06:32:18.968189+0000","last_clean":"2024-04-22T06:32:18.968189+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:32:18.968189+0000","last_undegraded":"2024-04-22T06:32:18.968189+0000","last_fullsized":"2024-04-22T06:32:18.968189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294512+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:32:19.294512+0000","last_peered":"2024-04-22T06:32:19.294512+0000","last_clean":"2024-04-22T06:32:19.294512+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:32:19.294512+0000","last_undegraded":"2024-04-22T06:32:19.294512+0000","last_fullsized":"2024-04-22T06:32:19.294512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.254299+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:32:33.254299+0000","last_peered":"2024-04-22T06:32:33.254299+0000","last_clean":"2024-04-22T06:32:33.254299+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:32:33.254299+0000","last_undegraded":"2024-04-22T06:32:33.254299+0000","last_fullsized":"2024-04-22T06:32:33.254299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966790+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:32:18.966790+0000","last_peered":"2024-04-22T06:32:18.966790+0000","last_clean":"2024-04-22T06:32:18.966790+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:32:18.966790+0000","last_undegraded":"2024-04-22T06:32:18.966790+0000","last_fullsized":"2024-04-22T06:32:18.966790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967866+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:32:18.967866+0000","last_peered":"2024-04-22T06:32:18.967866+0000","last_clean":"2024-04-22T06:32:18.967866+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:32:18.967866+0000","last_undegraded":"2024-04-22T06:32:18.967866+0000","last_fullsized":"2024-04-22T06:32:18.967866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977946+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:32:24.977946+0000","last_peered":"2024-04-22T06:32:24.977946+0000","last_clean":"2024-04-22T06:32:24.977946+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:32:24.977946+0000","last_undegraded":"2024-04-22T06:32:24.977946+0000","last_fullsized":"2024-04-22T06:32:24.977946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981480+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:32:18.981480+0000","last_peered":"2024-04-22T06:32:18.981480+0000","last_clean":"2024-04-22T06:32:18.981480+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:32:18.981480+0000","last_undegraded":"2024-04-22T06:32:18.981480+0000","last_fullsized":"2024-04-22T06:32:18.981480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191830+0000","last_change":"2024-04-22T06:32:19.151055+0000","last_active":"2024-04-22T06:32:19.191830+0000","last_peered":"2024-04-22T06:32:19.191830+0000","last_clean":"2024-04-22T06:32:19.191830+0000","last_became_active":"2024-04-22T06:32:19.150732+0000","last_became_peered":"2024-04-22T06:32:19.150732+0000","last_unstale":"2024-04-22T06:32:19.191830+0000","last_undegraded":"2024-04-22T06:32:19.191830+0000","last_fullsized":"2024-04-22T06:32:19.191830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:52:54.156456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978510+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:32:24.978510+0000","last_peered":"2024-04-22T06:32:24.978510+0000","last_clean":"2024-04-22T06:32:24.978510+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:32:24.978510+0000","last_undegraded":"2024-04-22T06:32:24.978510+0000","last_fullsized":"2024-04-22T06:32:24.978510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966555+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:32:18.966555+0000","last_peered":"2024-04-22T06:32:18.966555+0000","last_clean":"2024-04-22T06:32:18.966555+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:32:18.966555+0000","last_undegraded":"2024-04-22T06:32:18.966555+0000","last_fullsized":"2024-04-22T06:32:18.966555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294649+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:32:19.294649+0000","last_peered":"2024-04-22T06:32:19.294649+0000","last_clean":"2024-04-22T06:32:19.294649+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:32:19.294649+0000","last_undegraded":"2024-04-22T06:32:19.294649+0000","last_fullsized":"2024-04-22T06:32:19.294649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150320+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:32:19.150320+0000","last_peered":"2024-04-22T06:32:19.150320+0000","last_clean":"2024-04-22T06:32:19.150320+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:32:19.150320+0000","last_undegraded":"2024-04-22T06:32:19.150320+0000","last_fullsized":"2024-04-22T06:32:19.150320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149498+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:32:19.149498+0000","last_peered":"2024-04-22T06:32:19.149498+0000","last_clean":"2024-04-22T06:32:19.149498+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:32:19.149498+0000","last_undegraded":"2024-04-22T06:32:19.149498+0000","last_fullsized":"2024-04-22T06:32:19.149498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294347+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:32:19.294347+0000","last_peered":"2024-04-22T06:32:19.294347+0000","last_clean":"2024-04-22T06:32:19.294347+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:32:19.294347+0000","last_undegraded":"2024-04-22T06:32:19.294347+0000","last_fullsized":"2024-04-22T06:32:19.294347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.976514+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:32:24.976514+0000","last_peered":"2024-04-22T06:32:24.976514+0000","last_clean":"2024-04-22T06:32:24.976514+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:32:24.976514+0000","last_undegraded":"2024-04-22T06:32:24.976514+0000","last_fullsized":"2024-04-22T06:32:24.976514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981474+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:32:18.981474+0000","last_peered":"2024-04-22T06:32:18.981474+0000","last_clean":"2024-04-22T06:32:18.981474+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:32:18.981474+0000","last_undegraded":"2024-04-22T06:32:18.981474+0000","last_fullsized":"2024-04-22T06:32:18.981474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967600+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:32:18.967600+0000","last_peered":"2024-04-22T06:32:18.967600+0000","last_clean":"2024-04-22T06:32:18.967600+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:32:18.967600+0000","last_undegraded":"2024-04-22T06:32:18.967600+0000","last_fullsized":"2024-04-22T06:32:18.967600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.258892+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:32:33.258892+0000","last_peered":"2024-04-22T06:32:33.258892+0000","last_clean":"2024-04-22T06:32:33.258892+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:32:33.258892+0000","last_undegraded":"2024-04-22T06:32:33.258892+0000","last_fullsized":"2024-04-22T06:32:33.258892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966666+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:32:18.966666+0000","last_peered":"2024-04-22T06:32:18.966666+0000","last_clean":"2024-04-22T06:32:18.966666+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:32:18.966666+0000","last_undegraded":"2024-04-22T06:32:18.966666+0000","last_fullsized":"2024-04-22T06:32:18.966666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294324+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:32:19.294324+0000","last_peered":"2024-04-22T06:32:19.294324+0000","last_clean":"2024-04-22T06:32:19.294324+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:32:19.294324+0000","last_undegraded":"2024-04-22T06:32:19.294324+0000","last_fullsized":"2024-04-22T06:32:19.294324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:59.205857+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:33:59.205857+0000","last_peered":"2024-04-22T06:33:59.205857+0000","last_clean":"2024-04-22T06:33:59.205857+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:33:59.205857+0000","last_undegraded":"2024-04-22T06:33:59.205857+0000","last_fullsized":"2024-04-22T06:33:59.205857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966505+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:32:18.966505+0000","last_peered":"2024-04-22T06:32:18.966505+0000","last_clean":"2024-04-22T06:32:18.966505+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:32:18.966505+0000","last_undegraded":"2024-04-22T06:32:18.966505+0000","last_fullsized":"2024-04-22T06:32:18.966505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981324+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:32:18.981324+0000","last_peered":"2024-04-22T06:32:18.981324+0000","last_clean":"2024-04-22T06:32:18.981324+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:32:18.981324+0000","last_undegraded":"2024-04-22T06:32:18.981324+0000","last_fullsized":"2024-04-22T06:32:18.981324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977596+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:32:24.977596+0000","last_peered":"2024-04-22T06:32:24.977596+0000","last_clean":"2024-04-22T06:32:24.977596+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:32:24.977596+0000","last_undegraded":"2024-04-22T06:32:24.977596+0000","last_fullsized":"2024-04-22T06:32:24.977596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967461+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:32:18.967461+0000","last_peered":"2024-04-22T06:32:18.967461+0000","last_clean":"2024-04-22T06:32:18.967461+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:32:18.967461+0000","last_undegraded":"2024-04-22T06:32:18.967461+0000","last_fullsized":"2024-04-22T06:32:18.967461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294362+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:32:19.294362+0000","last_peered":"2024-04-22T06:32:19.294362+0000","last_clean":"2024-04-22T06:32:19.294362+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:32:19.294362+0000","last_undegraded":"2024-04-22T06:32:19.294362+0000","last_fullsized":"2024-04-22T06:32:19.294362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'26","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:17.859569+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:34:17.859569+0000","last_peered":"2024-04-22T06:34:17.859569+0000","last_clean":"2024-04-22T06:34:17.859569+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:34:17.859569+0000","last_undegraded":"2024-04-22T06:34:17.859569+0000","last_fullsized":"2024-04-22T06:34:17.859569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37755,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:07.285564+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:34:07.285564+0000","last_peered":"2024-04-22T06:34:07.285564+0000","last_clean":"2024-04-22T06:34:07.285564+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:34:07.285564+0000","last_undegraded":"2024-04-22T06:34:07.285564+0000","last_fullsized":"2024-04-22T06:34:07.285564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150204+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:32:19.150204+0000","last_peered":"2024-04-22T06:32:19.150204+0000","last_clean":"2024-04-22T06:32:19.150204+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:32:19.150204+0000","last_undegraded":"2024-04-22T06:32:19.150204+0000","last_fullsized":"2024-04-22T06:32:19.150204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:11.923418+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:34:11.923418+0000","last_peered":"2024-04-22T06:34:11.923418+0000","last_clean":"2024-04-22T06:34:11.923418+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:34:11.923418+0000","last_undegraded":"2024-04-22T06:34:11.923418+0000","last_fullsized":"2024-04-22T06:34:11.923418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150095+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:32:19.150095+0000","last_peered":"2024-04-22T06:32:19.150095+0000","last_clean":"2024-04-22T06:32:19.150095+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:32:19.150095+0000","last_undegraded":"2024-04-22T06:32:19.150095+0000","last_fullsized":"2024-04-22T06:32:19.150095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981808+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:32:18.981808+0000","last_peered":"2024-04-22T06:32:18.981808+0000","last_clean":"2024-04-22T06:32:18.981808+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:32:18.981808+0000","last_undegraded":"2024-04-22T06:32:18.981808+0000","last_fullsized":"2024-04-22T06:32:18.981808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982245+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:32:24.982245+0000","last_peered":"2024-04-22T06:32:24.982245+0000","last_clean":"2024-04-22T06:32:24.982245+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:32:24.982245+0000","last_undegraded":"2024-04-22T06:32:24.982245+0000","last_fullsized":"2024-04-22T06:32:24.982245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966033+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:32:18.966033+0000","last_peered":"2024-04-22T06:32:18.966033+0000","last_clean":"2024-04-22T06:32:18.966033+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:32:18.966033+0000","last_undegraded":"2024-04-22T06:32:18.966033+0000","last_fullsized":"2024-04-22T06:32:18.966033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967651+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:32:18.967651+0000","last_peered":"2024-04-22T06:32:18.967651+0000","last_clean":"2024-04-22T06:32:18.967651+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:32:18.967651+0000","last_undegraded":"2024-04-22T06:32:18.967651+0000","last_fullsized":"2024-04-22T06:32:18.967651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:04.206636+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:34:04.206636+0000","last_peered":"2024-04-22T06:34:04.206636+0000","last_clean":"2024-04-22T06:34:04.206636+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:34:04.206636+0000","last_undegraded":"2024-04-22T06:34:04.206636+0000","last_fullsized":"2024-04-22T06:34:04.206636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966093+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:32:18.966093+0000","last_peered":"2024-04-22T06:32:18.966093+0000","last_clean":"2024-04-22T06:32:18.966093+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:32:18.966093+0000","last_undegraded":"2024-04-22T06:32:18.966093+0000","last_fullsized":"2024-04-22T06:32:18.966093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981109+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:32:18.981109+0000","last_peered":"2024-04-22T06:32:18.981109+0000","last_clean":"2024-04-22T06:32:18.981109+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:32:18.981109+0000","last_undegraded":"2024-04-22T06:32:18.981109+0000","last_fullsized":"2024-04-22T06:32:18.981109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969532+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:32:18.969532+0000","last_peered":"2024-04-22T06:32:18.969532+0000","last_clean":"2024-04-22T06:32:18.969532+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:32:18.969532+0000","last_undegraded":"2024-04-22T06:32:18.969532+0000","last_fullsized":"2024-04-22T06:32:18.969532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977221+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:32:24.977221+0000","last_peered":"2024-04-22T06:32:24.977221+0000","last_clean":"2024-04-22T06:32:24.977221+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:32:24.977221+0000","last_undegraded":"2024-04-22T06:32:24.977221+0000","last_fullsized":"2024-04-22T06:32:24.977221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.983767+0000","last_change":"2024-04-22T06:32:18.982812+0000","last_active":"2024-04-22T06:32:18.983767+0000","last_peered":"2024-04-22T06:32:18.983767+0000","last_clean":"2024-04-22T06:32:18.983767+0000","last_became_active":"2024-04-22T06:32:18.982355+0000","last_became_peered":"2024-04-22T06:32:18.982355+0000","last_unstale":"2024-04-22T06:32:18.983767+0000","last_undegraded":"2024-04-22T06:32:18.983767+0000","last_fullsized":"2024-04-22T06:32:18.983767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:01:41.368881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966059+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:32:18.966059+0000","last_peered":"2024-04-22T06:32:18.966059+0000","last_clean":"2024-04-22T06:32:18.966059+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:32:18.966059+0000","last_undegraded":"2024-04-22T06:32:18.966059+0000","last_fullsized":"2024-04-22T06:32:18.966059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982017+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:32:24.982017+0000","last_peered":"2024-04-22T06:32:24.982017+0000","last_clean":"2024-04-22T06:32:24.982017+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:32:24.982017+0000","last_undegraded":"2024-04-22T06:32:24.982017+0000","last_fullsized":"2024-04-22T06:32:24.982017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967106+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:32:18.967106+0000","last_peered":"2024-04-22T06:32:18.967106+0000","last_clean":"2024-04-22T06:32:18.967106+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:32:18.967106+0000","last_undegraded":"2024-04-22T06:32:18.967106+0000","last_fullsized":"2024-04-22T06:32:18.967106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981566+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:32:18.981566+0000","last_peered":"2024-04-22T06:32:18.981566+0000","last_clean":"2024-04-22T06:32:18.981566+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:32:18.981566+0000","last_undegraded":"2024-04-22T06:32:18.981566+0000","last_fullsized":"2024-04-22T06:32:18.981566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.984626+0000","last_change":"2024-04-22T06:32:18.982586+0000","last_active":"2024-04-22T06:32:18.984626+0000","last_peered":"2024-04-22T06:32:18.984626+0000","last_clean":"2024-04-22T06:32:18.984626+0000","last_became_active":"2024-04-22T06:32:18.982159+0000","last_became_peered":"2024-04-22T06:32:18.982159+0000","last_unstale":"2024-04-22T06:32:18.984626+0000","last_undegraded":"2024-04-22T06:32:18.984626+0000","last_fullsized":"2024-04-22T06:32:18.984626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:37.104899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.256691+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:32:33.256691+0000","last_peered":"2024-04-22T06:32:33.256691+0000","last_clean":"2024-04-22T06:32:33.256691+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:32:33.256691+0000","last_undegraded":"2024-04-22T06:32:33.256691+0000","last_fullsized":"2024-04-22T06:32:33.256691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149982+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:32:19.149982+0000","last_peered":"2024-04-22T06:32:19.149982+0000","last_clean":"2024-04-22T06:32:19.149982+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:32:19.149982+0000","last_undegraded":"2024-04-22T06:32:19.149982+0000","last_fullsized":"2024-04-22T06:32:19.149982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.154071+0000","last_change":"2024-04-22T06:32:19.151801+0000","last_active":"2024-04-22T06:32:19.154071+0000","last_peered":"2024-04-22T06:32:19.154071+0000","last_clean":"2024-04-22T06:32:19.154071+0000","last_became_active":"2024-04-22T06:32:19.151353+0000","last_became_peered":"2024-04-22T06:32:19.151353+0000","last_unstale":"2024-04-22T06:32:19.154071+0000","last_undegraded":"2024-04-22T06:32:19.154071+0000","last_fullsized":"2024-04-22T06:32:19.154071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:11.699970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967441+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:32:18.967441+0000","last_peered":"2024-04-22T06:32:18.967441+0000","last_clean":"2024-04-22T06:32:18.967441+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:32:18.967441+0000","last_undegraded":"2024-04-22T06:32:18.967441+0000","last_fullsized":"2024-04-22T06:32:18.967441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968335+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:32:18.968335+0000","last_peered":"2024-04-22T06:32:18.968335+0000","last_clean":"2024-04-22T06:32:18.968335+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:32:18.968335+0000","last_undegraded":"2024-04-22T06:32:18.968335+0000","last_fullsized":"2024-04-22T06:32:18.968335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967509+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:32:18.967509+0000","last_peered":"2024-04-22T06:32:18.967509+0000","last_clean":"2024-04-22T06:32:18.967509+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:32:18.967509+0000","last_undegraded":"2024-04-22T06:32:18.967509+0000","last_fullsized":"2024-04-22T06:32:18.967509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981517+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:32:18.981517+0000","last_peered":"2024-04-22T06:32:18.981517+0000","last_clean":"2024-04-22T06:32:18.981517+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:32:18.981517+0000","last_undegraded":"2024-04-22T06:32:18.981517+0000","last_fullsized":"2024-04-22T06:32:18.981517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966671+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:32:18.966671+0000","last_peered":"2024-04-22T06:32:18.966671+0000","last_clean":"2024-04-22T06:32:18.966671+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:32:18.966671+0000","last_undegraded":"2024-04-22T06:32:18.966671+0000","last_fullsized":"2024-04-22T06:32:18.966671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969307+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:32:18.969307+0000","last_peered":"2024-04-22T06:32:18.969307+0000","last_clean":"2024-04-22T06:32:18.969307+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:32:18.969307+0000","last_undegraded":"2024-04-22T06:32:18.969307+0000","last_fullsized":"2024-04-22T06:32:18.969307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968602+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:32:18.968602+0000","last_peered":"2024-04-22T06:32:18.968602+0000","last_clean":"2024-04-22T06:32:18.968602+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:32:18.968602+0000","last_undegraded":"2024-04-22T06:32:18.968602+0000","last_fullsized":"2024-04-22T06:32:18.968602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.993285+0000","last_change":"2024-04-22T06:32:19.151471+0000","last_active":"2024-04-22T06:32:19.993285+0000","last_peered":"2024-04-22T06:32:19.993285+0000","last_clean":"2024-04-22T06:32:19.993285+0000","last_became_active":"2024-04-22T06:32:19.151207+0000","last_became_peered":"2024-04-22T06:32:19.151207+0000","last_unstale":"2024-04-22T06:32:19.993285+0000","last_undegraded":"2024-04-22T06:32:19.993285+0000","last_fullsized":"2024-04-22T06:32:19.993285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:37:11.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966641+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:32:18.966641+0000","last_peered":"2024-04-22T06:32:18.966641+0000","last_clean":"2024-04-22T06:32:18.966641+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:32:18.966641+0000","last_undegraded":"2024-04-22T06:32:18.966641+0000","last_fullsized":"2024-04-22T06:32:18.966641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966443+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:32:18.966443+0000","last_peered":"2024-04-22T06:32:18.966443+0000","last_clean":"2024-04-22T06:32:18.966443+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:32:18.966443+0000","last_undegraded":"2024-04-22T06:32:18.966443+0000","last_fullsized":"2024-04-22T06:32:18.966443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967417+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:32:18.967417+0000","last_peered":"2024-04-22T06:32:18.967417+0000","last_clean":"2024-04-22T06:32:18.967417+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:32:18.967417+0000","last_undegraded":"2024-04-22T06:32:18.967417+0000","last_fullsized":"2024-04-22T06:32:18.967417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981427+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:32:18.981427+0000","last_peered":"2024-04-22T06:32:18.981427+0000","last_clean":"2024-04-22T06:32:18.981427+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:32:18.981427+0000","last_undegraded":"2024-04-22T06:32:18.981427+0000","last_fullsized":"2024-04-22T06:32:18.981427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968042+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:32:18.968042+0000","last_peered":"2024-04-22T06:32:18.968042+0000","last_clean":"2024-04-22T06:32:18.968042+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:32:18.968042+0000","last_undegraded":"2024-04-22T06:32:18.968042+0000","last_fullsized":"2024-04-22T06:32:18.968042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294620+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:32:19.294620+0000","last_peered":"2024-04-22T06:32:19.294620+0000","last_clean":"2024-04-22T06:32:19.294620+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:32:19.294620+0000","last_undegraded":"2024-04-22T06:32:19.294620+0000","last_fullsized":"2024-04-22T06:32:19.294620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968136+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:32:18.968136+0000","last_peered":"2024-04-22T06:32:18.968136+0000","last_clean":"2024-04-22T06:32:18.968136+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:32:18.968136+0000","last_undegraded":"2024-04-22T06:32:18.968136+0000","last_fullsized":"2024-04-22T06:32:18.968136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968002+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:32:18.968002+0000","last_peered":"2024-04-22T06:32:18.968002+0000","last_clean":"2024-04-22T06:32:18.968002+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:32:18.968002+0000","last_undegraded":"2024-04-22T06:32:18.968002+0000","last_fullsized":"2024-04-22T06:32:18.968002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191784+0000","last_change":"2024-04-22T06:32:18.981673+0000","last_active":"2024-04-22T06:32:19.191784+0000","last_peered":"2024-04-22T06:32:19.191784+0000","last_clean":"2024-04-22T06:32:19.191784+0000","last_became_active":"2024-04-22T06:32:18.981385+0000","last_became_peered":"2024-04-22T06:32:18.981385+0000","last_unstale":"2024-04-22T06:32:19.191784+0000","last_undegraded":"2024-04-22T06:32:19.191784+0000","last_fullsized":"2024-04-22T06:32:19.191784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:12:05.631449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969043+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:32:18.969043+0000","last_peered":"2024-04-22T06:32:18.969043+0000","last_clean":"2024-04-22T06:32:18.969043+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:32:18.969043+0000","last_undegraded":"2024-04-22T06:32:18.969043+0000","last_fullsized":"2024-04-22T06:32:18.969043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:58.999631+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:33:58.999631+0000","last_peered":"2024-04-22T06:33:58.999631+0000","last_clean":"2024-04-22T06:33:58.999631+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:33:58.999631+0000","last_undegraded":"2024-04-22T06:33:58.999631+0000","last_fullsized":"2024-04-22T06:33:58.999631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966202+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:32:18.966202+0000","last_peered":"2024-04-22T06:32:18.966202+0000","last_clean":"2024-04-22T06:32:18.966202+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:32:18.966202+0000","last_undegraded":"2024-04-22T06:32:18.966202+0000","last_fullsized":"2024-04-22T06:32:18.966202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150299+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:32:19.150299+0000","last_peered":"2024-04-22T06:32:19.150299+0000","last_clean":"2024-04-22T06:32:19.150299+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:32:19.150299+0000","last_undegraded":"2024-04-22T06:32:19.150299+0000","last_fullsized":"2024-04-22T06:32:19.150299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968345+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:32:18.968345+0000","last_peered":"2024-04-22T06:32:18.968345+0000","last_clean":"2024-04-22T06:32:18.968345+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:32:18.968345+0000","last_undegraded":"2024-04-22T06:32:18.968345+0000","last_fullsized":"2024-04-22T06:32:18.968345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968555+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:32:18.968555+0000","last_peered":"2024-04-22T06:32:18.968555+0000","last_clean":"2024-04-22T06:32:18.968555+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:32:18.968555+0000","last_undegraded":"2024-04-22T06:32:18.968555+0000","last_fullsized":"2024-04-22T06:32:18.968555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294891+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:32:19.294891+0000","last_peered":"2024-04-22T06:32:19.294891+0000","last_clean":"2024-04-22T06:32:19.294891+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:32:19.294891+0000","last_undegraded":"2024-04-22T06:32:19.294891+0000","last_fullsized":"2024-04-22T06:32:19.294891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965958+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:32:18.965958+0000","last_peered":"2024-04-22T06:32:18.965958+0000","last_clean":"2024-04-22T06:32:18.965958+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:32:18.965958+0000","last_undegraded":"2024-04-22T06:32:18.965958+0000","last_fullsized":"2024-04-22T06:32:18.965958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294233+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:32:19.294233+0000","last_peered":"2024-04-22T06:32:19.294233+0000","last_clean":"2024-04-22T06:32:19.294233+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:32:19.294233+0000","last_undegraded":"2024-04-22T06:32:19.294233+0000","last_fullsized":"2024-04-22T06:32:19.294233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967320+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:32:18.967320+0000","last_peered":"2024-04-22T06:32:18.967320+0000","last_clean":"2024-04-22T06:32:18.967320+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:32:18.967320+0000","last_undegraded":"2024-04-22T06:32:18.967320+0000","last_fullsized":"2024-04-22T06:32:18.967320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294281+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:32:19.294281+0000","last_peered":"2024-04-22T06:32:19.294281+0000","last_clean":"2024-04-22T06:32:19.294281+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:32:19.294281+0000","last_undegraded":"2024-04-22T06:32:19.294281+0000","last_fullsized":"2024-04-22T06:32:19.294281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967670+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:32:18.967670+0000","last_peered":"2024-04-22T06:32:18.967670+0000","last_clean":"2024-04-22T06:32:18.967670+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:32:18.967670+0000","last_undegraded":"2024-04-22T06:32:18.967670+0000","last_fullsized":"2024-04-22T06:32:18.967670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981210+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:32:18.981210+0000","last_peered":"2024-04-22T06:32:18.981210+0000","last_clean":"2024-04-22T06:32:18.981210+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:32:18.981210+0000","last_undegraded":"2024-04-22T06:32:18.981210+0000","last_fullsized":"2024-04-22T06:32:18.981210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969561+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:32:18.969561+0000","last_peered":"2024-04-22T06:32:18.969561+0000","last_clean":"2024-04-22T06:32:18.969561+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:32:18.969561+0000","last_undegraded":"2024-04-22T06:32:18.969561+0000","last_fullsized":"2024-04-22T06:32:18.969561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294826+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:32:19.294826+0000","last_peered":"2024-04-22T06:32:19.294826+0000","last_clean":"2024-04-22T06:32:19.294826+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:32:19.294826+0000","last_undegraded":"2024-04-22T06:32:19.294826+0000","last_fullsized":"2024-04-22T06:32:19.294826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45811,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":244,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":91622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":153347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":153692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":116575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":39331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":38986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:35:02.182 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T06:35:02.182 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:35:02.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.217+0000 7fd58ebd5640 1 Processor -- start 2024-04-22T06:35:02.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.217+0000 7fd58ebd5640 1 -- start start 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58ebd5640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd5880c8ea0 0x7fd5880c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58ebd5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880ca3a0 0x7fd58815b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58ebd5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd5880c8950 0x7fd5880c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58ebd5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fd58815b850 con 0x7fd5880c8950 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58ebd5640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fd5880c2ac0 con 0x7fd5880c8ea0 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58ebd5640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd5880c79e0 con 0x7fd5880ca3a0 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58d172640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd5880c8950 0x7fd5880c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58d172640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd5880c8950 0x7fd5880c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49720/0 (socket says 172.21.15.113:49720) 2024-04-22T06:35:02.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58d172640 1 -- 172.21.15.113:0/2488804901 learned_addr learned my addr 172.21.15.113:0/2488804901 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd58c971640 1 --2- 172.21.15.113:0/2488804901 >> v2:172.21.15.145:3300/0 conn(0x7fd5880c8ea0 0x7fd5880c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.218+0000 7fd587fff640 1 --2- 172.21.15.113:0/2488804901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880ca3a0 0x7fd58815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.219+0000 7fd58d172640 1 -- 172.21.15.113:0/2488804901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880ca3a0 msgr2=0x7fd58815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.219+0000 7fd58d172640 1 --2- 172.21.15.113:0/2488804901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880ca3a0 0x7fd58815b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.219+0000 7fd58d172640 1 -- 172.21.15.113:0/2488804901 >> v2:172.21.15.145:3300/0 conn(0x7fd5880c8ea0 msgr2=0x7fd5880c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.219+0000 7fd58d172640 1 --2- 172.21.15.113:0/2488804901 >> v2:172.21.15.145:3300/0 conn(0x7fd5880c8ea0 0x7fd5880c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.219+0000 7fd58d172640 1 -- 172.21.15.113:0/2488804901 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5880c41b0 con 0x7fd5880c8950 2024-04-22T06:35:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.219+0000 7fd587fff640 1 --2- 172.21.15.113:0/2488804901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880ca3a0 0x7fd58815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:35:02.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.219+0000 7fd58d172640 1 --2- 172.21.15.113:0/2488804901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880c8950 0x7fd5880c81f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd5880683b0 tx=0x7fd58002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c76d7862ab09d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.219+0000 7fd5877fe640 1 -- 172.21.15.113:0/2488804901 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58002ca70 con 0x7fd5880c8950 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd5877fe640 1 -- 172.21.15.113:0/2488804901 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58002cc10 con 0x7fd5880c8950 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd5877fe640 1 -- 172.21.15.113:0/2488804901 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5800343f0 con 0x7fd5880c8950 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 -- 172.21.15.113:0/2488804901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880c8950 msgr2=0x7fd5880c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/2488804901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880c8950 0x7fd5880c81f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd5880683b0 tx=0x7fd58002bed0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 -- 172.21.15.113:0/2488804901 shutdown_connections 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/2488804901 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880c8950 0x7fd5880c81f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/2488804901 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880ca3a0 0x7fd58815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/2488804901 >> v2:172.21.15.145:3300/0 conn(0x7fd5880c8ea0 0x7fd5880c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 -- 172.21.15.113:0/2488804901 >> 172.21.15.113:0/2488804901 conn(0x7fd58806f5f0 msgr2=0x7fd58806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 -- 172.21.15.113:0/2488804901 shutdown_connections 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.220+0000 7fd58ebd5640 1 -- 172.21.15.113:0/2488804901 wait complete. 2024-04-22T06:35:02.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.221+0000 7fd58ebd5640 1 Processor -- start 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.221+0000 7fd58ebd5640 1 -- start start 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58ebd5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5880c8950 0x7fd5880c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58ebd5640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880c8ea0 0x7fd5881f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58ebd5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880ca3a0 0x7fd5880c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58ebd5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fd5880c9f10 con 0x7fd5880ca3a0 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58ebd5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd5880c7f10 con 0x7fd5880c8950 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58ebd5640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fd5880c8730 con 0x7fd5880c8ea0 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58d172640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880ca3a0 0x7fd5880c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58d172640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880ca3a0 0x7fd5880c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49728/0 (socket says 172.21.15.113:49728) 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58d172640 1 -- 172.21.15.113:0/3890049632 learned_addr learned my addr 172.21.15.113:0/3890049632 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd58c971640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5880c8950 0x7fd5880c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.222+0000 7fd587fff640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880c8ea0 0x7fd5881f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd58d172640 1 -- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880c8ea0 msgr2=0x7fd5881f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd58d172640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880c8ea0 0x7fd5881f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd58d172640 1 -- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5880c8950 msgr2=0x7fd5880c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd58d172640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5880c8950 0x7fd5880c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd58d172640 1 -- 172.21.15.113:0/3890049632 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd588072ee0 con 0x7fd5880ca3a0 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd587fff640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880c8ea0 0x7fd5881f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd58d172640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880ca3a0 0x7fd5880c5da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd580009f40 tx=0x7fd580004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd5857fa640 1 -- 172.21.15.113:0/3890049632 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580043020 con 0x7fd5880ca3a0 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd5857fa640 1 -- 172.21.15.113:0/3890049632 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58003e450 con 0x7fd5880ca3a0 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5881f0e50 con 0x7fd5880ca3a0 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd5857fa640 1 -- 172.21.15.113:0/3890049632 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580009510 con 0x7fd5880ca3a0 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.223+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd588073480 con 0x7fd5880ca3a0 2024-04-22T06:35:02.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.224+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd588068f50 con 0x7fd5880ca3a0 2024-04-22T06:35:02.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.224+0000 7fd5857fa640 1 -- 172.21.15.113:0/3890049632 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd580005d10 con 0x7fd5880ca3a0 2024-04-22T06:35:02.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.225+0000 7fd5857fa640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd57406c920 0x7fd57406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.225+0000 7fd5857fa640 1 -- 172.21.15.113:0/3890049632 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd5800ae990 con 0x7fd5880ca3a0 2024-04-22T06:35:02.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.225+0000 7fd58c971640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd57406c920 0x7fd57406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.225+0000 7fd58c971640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd57406c920 0x7fd57406ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd578006fd0 tx=0x7fd578008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.230+0000 7fd5857fa640 1 -- 172.21.15.113:0/3890049632 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd58007ca50 con 0x7fd5880ca3a0 2024-04-22T06:35:02.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.316+0000 7f159688c640 1 Processor -- start 2024-04-22T06:35:02.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.316+0000 7f159688c640 1 -- start start 2024-04-22T06:35:02.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.316+0000 7f159688c640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f15900c8070 0x7f159015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.316+0000 7f159688c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159006c850 con 0x7f15901553a0 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.316+0000 7f159688c640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159006cb30 con 0x7f15900c8e10 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.316+0000 7f159688c640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f159006ce10 con 0x7f15900c8070 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f15901553a0 0x7f15900c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39852/0 (socket says 172.21.15.113:39852) 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158ffff640 1 -- 172.21.15.113:0/719391481 learned_addr learned my addr 172.21.15.113:0/719391481 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f1594e29640 1 --2- 172.21.15.113:0/719391481 >> v2:172.21.15.145:3300/0 conn(0x7f15900c8070 0x7f159015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608095814 0 0) 0x7f159006c850 con 0x7f15901553a0 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1578003520 con 0x7f15901553a0 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2835203773 0 0) 0x7f1578003520 con 0x7f15901553a0 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 >> v2:172.21.15.145:3300/0 conn(0x7f15900c8070 msgr2=0x7f159015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 --2- 172.21.15.113:0/719391481 >> v2:172.21.15.145:3300/0 conn(0x7f15900c8070 0x7f159015ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 >> v1:172.21.15.145:6789/0 conn(0x7f15900c8e10 legacy=0x7f159015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159006d0f0 con 0x7f15901553a0 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f1580001670 con 0x7f15901553a0 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 >> v1:172.21.15.113:6789/0 conn(0x7f15901553a0 legacy=0x7f15900c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15780039b0 0x7f1578003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780043b0 0x7f1578004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1578005080 0x7f157800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f159006ce10 con 0x7f15780039b0 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f157800bf30 con 0x7f1578005080 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f157800c130 con 0x7f15780043b0 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158ffff640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15780039b0 0x7f1578003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158f7fe640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780043b0 0x7f1578004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f1594e29640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1578005080 0x7f157800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158ffff640 1 -- 172.21.15.113:0/719391481 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780043b0 msgr2=0x7f1578004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158ffff640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780043b0 0x7f1578004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158ffff640 1 -- 172.21.15.113:0/719391481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1578005080 msgr2=0x7f157800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.317+0000 7f158ffff640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1578005080 0x7f157800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.318+0000 7f158ffff640 1 -- 172.21.15.113:0/719391481 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1578003520 con 0x7f15780039b0 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.318+0000 7f1594e29640 1 -- 172.21.15.113:0/719391481 reap_dead start 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.318+0000 7f158ffff640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15780039b0 0x7f1578003d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f158000c240 tx=0x7f1578005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c8d154d72c74ad server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.318+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580007d10 con 0x7f15780039b0 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.318+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1580030070 con 0x7f15780039b0 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.318+0000 7f158effd640 1 -- 172.21.15.113:0/719391481 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580005d90 con 0x7f15780039b0 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.319+0000 7f159688c640 1 -- 172.21.15.113:0/719391481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15780039b0 msgr2=0x7f1578003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.319+0000 7f159688c640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15780039b0 0x7f1578003d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f158000c240 tx=0x7f1578005830 comp rx=0 tx=0).stop 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.319+0000 7f159688c640 1 -- 172.21.15.113:0/719391481 shutdown_connections 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.319+0000 7f159688c640 1 --2- 172.21.15.113:0/719391481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15780039b0 0x7f1578003d90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.319+0000 7f159688c640 1 -- 172.21.15.113:0/719391481 >> 172.21.15.113:0/719391481 conn(0x7f1590073010 msgr2=0x7f1590073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.319+0000 7f159688c640 1 -- 172.21.15.113:0/719391481 shutdown_connections 2024-04-22T06:35:02.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.319+0000 7f159688c640 1 -- 172.21.15.113:0/719391481 wait complete. 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.321+0000 7f159688c640 1 Processor -- start 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.321+0000 7f159688c640 1 -- start start 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f159688c640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780039b0 0x7f15901599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f159688c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15900d03f0 0x7f15901f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f159688c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15901f49d0 0x7f15901f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f159688c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f159015bb80 con 0x7f15900d03f0 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f159688c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1590155780 con 0x7f15901f49d0 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f159688c640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f159015bd00 con 0x7f15780039b0 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f158f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15900d03f0 0x7f15901f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f158f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15900d03f0 0x7f15901f0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49756/0 (socket says 172.21.15.113:49756) 2024-04-22T06:35:02.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.322+0000 7f158f7fe640 1 -- 172.21.15.113:0/1618377175 learned_addr learned my addr 172.21.15.113:0/1618377175 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158ffff640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780039b0 0x7f15901599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f1594e29640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15901f49d0 0x7f15901f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158f7fe640 1 -- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780039b0 msgr2=0x7f15901599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158f7fe640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780039b0 0x7f15901599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158f7fe640 1 -- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15901f49d0 msgr2=0x7f15901f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158f7fe640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15901f49d0 0x7f15901f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158f7fe640 1 -- 172.21.15.113:0/1618377175 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1590151c50 con 0x7f15900d03f0 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158ffff640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780039b0 0x7f15901599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f1594e29640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15901f49d0 0x7f15901f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158f7fe640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15900d03f0 0x7f15901f0c30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f158400f780 tx=0x7f158400fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158cff9640 1 -- 172.21.15.113:0/1618377175 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158400fe90 con 0x7f15900d03f0 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158cff9640 1 -- 172.21.15.113:0/1618377175 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1584018070 con 0x7f15900d03f0 2024-04-22T06:35:02.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1590151f30 con 0x7f15900d03f0 2024-04-22T06:35:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f158cff9640 1 -- 172.21.15.113:0/1618377175 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158400d6d0 con 0x7f15900d03f0 2024-04-22T06:35:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.323+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1590152e20 con 0x7f15900d03f0 2024-04-22T06:35:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.324+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159006cb30 con 0x7f15900d03f0 2024-04-22T06:35:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.324+0000 7f158cff9640 1 -- 172.21.15.113:0/1618377175 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f158400d870 con 0x7f15900d03f0 2024-04-22T06:35:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.325+0000 7f158cff9640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f157c06ca90 0x7f157c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.325+0000 7f158cff9640 1 -- 172.21.15.113:0/1618377175 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f158408bee0 con 0x7f15900d03f0 2024-04-22T06:35:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.325+0000 7f158ffff640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f157c06ca90 0x7f157c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.325+0000 7f158ffff640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f157c06ca90 0x7f157c06ef50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1580034000 tx=0x7f1580039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.329+0000 7f158cff9640 1 -- 172.21.15.113:0/1618377175 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f159006cb30 con 0x7f15900d03f0 2024-04-22T06:35:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.417+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd58806e280 con 0x7fd5880ca3a0 2024-04-22T06:35:02.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.418+0000 7fd5857fa640 1 -- 172.21.15.113:0/3890049632 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fd58007c350 con 0x7fd5880ca3a0 2024-04-22T06:35:02.419 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd57406c920 msgr2=0x7fd57406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd57406c920 0x7fd57406ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd578006fd0 tx=0x7fd578008040 comp rx=0 tx=0).stop 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880ca3a0 msgr2=0x7fd5880c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880ca3a0 0x7fd5880c5da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd580009f40 tx=0x7fd580004a40 comp rx=0 tx=0).stop 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 shutdown_connections 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fd57406c920 0x7fd57406ede0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5880ca3a0 0x7fd5880c5da0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5880c8ea0 0x7fd5881f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 --2- 172.21.15.113:0/3890049632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5880c8950 0x7fd5880c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 >> 172.21.15.113:0/3890049632 conn(0x7fd58806f5f0 msgr2=0x7fd5880af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 shutdown_connections 2024-04-22T06:35:02.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.420+0000 7fd58ebd5640 1 -- 172.21.15.113:0/3890049632 wait complete. 2024-04-22T06:35:02.431 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-22T06:35:02.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.508+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f159006c850 con 0x7f157c06ca90 2024-04-22T06:35:02.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.524+0000 7f158cff9640 1 -- 172.21.15.113:0/1618377175 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332637 (secure 0 0 0) 0x7f1580096370 con 0x7f157c06ca90 2024-04-22T06:35:02.526 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:35:02.528 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-04-22T06:35:02.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f157c06ca90 msgr2=0x7f157c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f157c06ca90 0x7f157c06ef50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1580034000 tx=0x7f1580039040 comp rx=0 tx=0).stop 2024-04-22T06:35:02.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15900d03f0 msgr2=0x7f15901f0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15900d03f0 0x7f15901f0c30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f158400f780 tx=0x7f158400fc40 comp rx=0 tx=0).stop 2024-04-22T06:35:02.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 shutdown_connections 2024-04-22T06:35:02.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15901f49d0 0x7f15901f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f157c06ca90 0x7f157c06ef50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f15900d03f0 0x7f15901f0c30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 --2- 172.21.15.113:0/1618377175 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15780039b0 0x7f15901599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 >> 172.21.15.113:0/1618377175 conn(0x7f1590073010 msgr2=0x7f15900cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 shutdown_connections 2024-04-22T06:35:02.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.527+0000 7f159688c640 1 -- 172.21.15.113:0/1618377175 wait complete. 2024-04-22T06:35:02.538 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-04-22T06:35:01.018980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636179,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":405,"num_write_kb":2536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219800,"kb_used_data":3672,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754920,"statfs":{"total":773094113280,"available":772869038080,"internally_reserved":0,"allocated":3760128,"data_stored":2187246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003369"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979949+0000","last_change":"2024-04-22T06:31:36.841392+0000","last_active":"2024-04-22T06:32:24.979949+0000","last_peered":"2024-04-22T06:32:24.979949+0000","last_clean":"2024-04-22T06:32:24.979949+0000","last_became_active":"2024-04-22T06:31:36.841114+0000","last_became_peered":"2024-04-22T06:31:36.841114+0000","last_unstale":"2024-04-22T06:32:24.979949+0000","last_undegraded":"2024-04-22T06:32:24.979949+0000","last_fullsized":"2024-04-22T06:32:24.979949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:23.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966594+0000","last_change":"2024-04-22T06:31:37.846039+0000","last_active":"2024-04-22T06:32:18.966594+0000","last_peered":"2024-04-22T06:32:18.966594+0000","last_clean":"2024-04-22T06:32:18.966594+0000","last_became_active":"2024-04-22T06:31:37.845778+0000","last_became_peered":"2024-04-22T06:31:37.845778+0000","last_unstale":"2024-04-22T06:32:18.966594+0000","last_undegraded":"2024-04-22T06:32:18.966594+0000","last_fullsized":"2024-04-22T06:32:18.966594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:40.486760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965912+0000","last_change":"2024-04-22T06:31:41.920964+0000","last_active":"2024-04-22T06:32:18.965912+0000","last_peered":"2024-04-22T06:32:18.965912+0000","last_clean":"2024-04-22T06:32:18.965912+0000","last_became_active":"2024-04-22T06:31:41.920554+0000","last_became_peered":"2024-04-22T06:31:41.920554+0000","last_unstale":"2024-04-22T06:32:18.965912+0000","last_undegraded":"2024-04-22T06:32:18.965912+0000","last_fullsized":"2024-04-22T06:32:18.965912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:40:05.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966787+0000","last_change":"2024-04-22T06:31:36.832915+0000","last_active":"2024-04-22T06:32:18.966787+0000","last_peered":"2024-04-22T06:32:18.966787+0000","last_clean":"2024-04-22T06:32:18.966787+0000","last_became_active":"2024-04-22T06:31:36.832296+0000","last_became_peered":"2024-04-22T06:31:36.832296+0000","last_unstale":"2024-04-22T06:32:18.966787+0000","last_undegraded":"2024-04-22T06:32:18.966787+0000","last_fullsized":"2024-04-22T06:32:18.966787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:59:02.011990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981724+0000","last_change":"2024-04-22T06:31:37.850942+0000","last_active":"2024-04-22T06:32:18.981724+0000","last_peered":"2024-04-22T06:32:18.981724+0000","last_clean":"2024-04-22T06:32:18.981724+0000","last_became_active":"2024-04-22T06:31:37.850692+0000","last_became_peered":"2024-04-22T06:31:37.850692+0000","last_unstale":"2024-04-22T06:32:18.981724+0000","last_undegraded":"2024-04-22T06:32:18.981724+0000","last_fullsized":"2024-04-22T06:32:18.981724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:11.227685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149528+0000","last_change":"2024-04-22T06:31:41.877483+0000","last_active":"2024-04-22T06:32:19.149528+0000","last_peered":"2024-04-22T06:32:19.149528+0000","last_clean":"2024-04-22T06:32:19.149528+0000","last_became_active":"2024-04-22T06:31:41.877072+0000","last_became_peered":"2024-04-22T06:31:41.877072+0000","last_unstale":"2024-04-22T06:32:19.149528+0000","last_undegraded":"2024-04-22T06:32:19.149528+0000","last_fullsized":"2024-04-22T06:32:19.149528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:40.639065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'13","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:09.007042+0000","last_change":"2024-04-22T06:31:36.839102+0000","last_active":"2024-04-22T06:34:09.007042+0000","last_peered":"2024-04-22T06:34:09.007042+0000","last_clean":"2024-04-22T06:34:09.007042+0000","last_became_active":"2024-04-22T06:31:36.838800+0000","last_became_peered":"2024-04-22T06:31:36.838800+0000","last_unstale":"2024-04-22T06:34:09.007042+0000","last_undegraded":"2024-04-22T06:34:09.007042+0000","last_fullsized":"2024-04-22T06:34:09.007042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:50.847073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191815+0000","last_change":"2024-04-22T06:32:19.150976+0000","last_active":"2024-04-22T06:32:19.191815+0000","last_peered":"2024-04-22T06:32:19.191815+0000","last_clean":"2024-04-22T06:32:19.191815+0000","last_became_active":"2024-04-22T06:32:19.150701+0000","last_became_peered":"2024-04-22T06:32:19.150701+0000","last_unstale":"2024-04-22T06:32:19.191815+0000","last_undegraded":"2024-04-22T06:32:19.191815+0000","last_fullsized":"2024-04-22T06:32:19.191815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:03:07.842684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149975+0000","last_change":"2024-04-22T06:31:41.881444+0000","last_active":"2024-04-22T06:32:19.149975+0000","last_peered":"2024-04-22T06:32:19.149975+0000","last_clean":"2024-04-22T06:32:19.149975+0000","last_became_active":"2024-04-22T06:31:41.880765+0000","last_became_peered":"2024-04-22T06:31:41.880765+0000","last_unstale":"2024-04-22T06:32:19.149975+0000","last_undegraded":"2024-04-22T06:32:19.149975+0000","last_fullsized":"2024-04-22T06:32:19.149975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:05.508996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979828+0000","last_change":"2024-04-22T06:31:36.839206+0000","last_active":"2024-04-22T06:32:24.979828+0000","last_peered":"2024-04-22T06:32:24.979828+0000","last_clean":"2024-04-22T06:32:24.979828+0000","last_became_active":"2024-04-22T06:31:36.838434+0000","last_became_peered":"2024-04-22T06:31:36.838434+0000","last_unstale":"2024-04-22T06:32:24.979828+0000","last_undegraded":"2024-04-22T06:32:24.979828+0000","last_fullsized":"2024-04-22T06:32:24.979828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:21.920756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967681+0000","last_change":"2024-04-22T06:31:37.850473+0000","last_active":"2024-04-22T06:32:18.967681+0000","last_peered":"2024-04-22T06:32:18.967681+0000","last_clean":"2024-04-22T06:32:18.967681+0000","last_became_active":"2024-04-22T06:31:37.850170+0000","last_became_peered":"2024-04-22T06:31:37.850170+0000","last_unstale":"2024-04-22T06:32:18.967681+0000","last_undegraded":"2024-04-22T06:32:18.967681+0000","last_fullsized":"2024-04-22T06:32:18.967681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:07:37.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149840+0000","last_change":"2024-04-22T06:31:41.873320+0000","last_active":"2024-04-22T06:32:19.149840+0000","last_peered":"2024-04-22T06:32:19.149840+0000","last_clean":"2024-04-22T06:32:19.149840+0000","last_became_active":"2024-04-22T06:31:41.872839+0000","last_became_peered":"2024-04-22T06:31:41.872839+0000","last_unstale":"2024-04-22T06:32:19.149840+0000","last_undegraded":"2024-04-22T06:32:19.149840+0000","last_fullsized":"2024-04-22T06:32:19.149840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:31:15.259640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966898+0000","last_change":"2024-04-22T06:31:37.849395+0000","last_active":"2024-04-22T06:32:18.966898+0000","last_peered":"2024-04-22T06:32:18.966898+0000","last_clean":"2024-04-22T06:32:18.966898+0000","last_became_active":"2024-04-22T06:31:37.849104+0000","last_became_peered":"2024-04-22T06:31:37.849104+0000","last_unstale":"2024-04-22T06:32:18.966898+0000","last_undegraded":"2024-04-22T06:32:18.966898+0000","last_fullsized":"2024-04-22T06:32:18.966898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:09:09.936418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:54.005385+0000","last_change":"2024-04-22T06:31:36.844813+0000","last_active":"2024-04-22T06:33:54.005385+0000","last_peered":"2024-04-22T06:33:54.005385+0000","last_clean":"2024-04-22T06:33:54.005385+0000","last_became_active":"2024-04-22T06:31:36.844545+0000","last_became_peered":"2024-04-22T06:31:36.844545+0000","last_unstale":"2024-04-22T06:33:54.005385+0000","last_undegraded":"2024-04-22T06:33:54.005385+0000","last_fullsized":"2024-04-22T06:33:54.005385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:47.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150258+0000","last_change":"2024-04-22T06:31:41.881006+0000","last_active":"2024-04-22T06:32:19.150258+0000","last_peered":"2024-04-22T06:32:19.150258+0000","last_clean":"2024-04-22T06:32:19.150258+0000","last_became_active":"2024-04-22T06:31:41.880530+0000","last_became_peered":"2024-04-22T06:31:41.880530+0000","last_unstale":"2024-04-22T06:32:19.150258+0000","last_undegraded":"2024-04-22T06:32:19.150258+0000","last_fullsized":"2024-04-22T06:32:19.150258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:17:14.803912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966165+0000","last_change":"2024-04-22T06:31:37.847412+0000","last_active":"2024-04-22T06:32:18.966165+0000","last_peered":"2024-04-22T06:32:18.966165+0000","last_clean":"2024-04-22T06:32:18.966165+0000","last_became_active":"2024-04-22T06:31:37.845640+0000","last_became_peered":"2024-04-22T06:31:37.845640+0000","last_unstale":"2024-04-22T06:32:18.966165+0000","last_undegraded":"2024-04-22T06:32:18.966165+0000","last_fullsized":"2024-04-22T06:32:18.966165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:17.049923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.968385+0000","last_change":"2024-04-22T06:31:36.840666+0000","last_active":"2024-04-22T06:32:24.968385+0000","last_peered":"2024-04-22T06:32:24.968385+0000","last_clean":"2024-04-22T06:32:24.968385+0000","last_became_active":"2024-04-22T06:31:36.840408+0000","last_became_peered":"2024-04-22T06:31:36.840408+0000","last_unstale":"2024-04-22T06:32:24.968385+0000","last_undegraded":"2024-04-22T06:32:24.968385+0000","last_fullsized":"2024-04-22T06:32:24.968385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:11.157445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150057+0000","last_change":"2024-04-22T06:31:41.880595+0000","last_active":"2024-04-22T06:32:19.150057+0000","last_peered":"2024-04-22T06:32:19.150057+0000","last_clean":"2024-04-22T06:32:19.150057+0000","last_became_active":"2024-04-22T06:31:41.880203+0000","last_became_peered":"2024-04-22T06:31:41.880203+0000","last_unstale":"2024-04-22T06:32:19.150057+0000","last_undegraded":"2024-04-22T06:32:19.150057+0000","last_fullsized":"2024-04-22T06:32:19.150057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.940177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966154+0000","last_change":"2024-04-22T06:31:37.845426+0000","last_active":"2024-04-22T06:32:18.966154+0000","last_peered":"2024-04-22T06:32:18.966154+0000","last_clean":"2024-04-22T06:32:18.966154+0000","last_became_active":"2024-04-22T06:31:37.845082+0000","last_became_peered":"2024-04-22T06:31:37.845082+0000","last_unstale":"2024-04-22T06:32:18.966154+0000","last_undegraded":"2024-04-22T06:32:18.966154+0000","last_fullsized":"2024-04-22T06:32:18.966154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:22:50.263556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.980015+0000","last_change":"2024-04-22T06:31:36.841605+0000","last_active":"2024-04-22T06:32:24.980015+0000","last_peered":"2024-04-22T06:32:24.980015+0000","last_clean":"2024-04-22T06:32:24.980015+0000","last_became_active":"2024-04-22T06:31:36.841342+0000","last_became_peered":"2024-04-22T06:31:36.841342+0000","last_unstale":"2024-04-22T06:32:24.980015+0000","last_undegraded":"2024-04-22T06:32:24.980015+0000","last_fullsized":"2024-04-22T06:32:24.980015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:56.744037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969513+0000","last_change":"2024-04-22T06:31:41.919075+0000","last_active":"2024-04-22T06:32:18.969513+0000","last_peered":"2024-04-22T06:32:18.969513+0000","last_clean":"2024-04-22T06:32:18.969513+0000","last_became_active":"2024-04-22T06:31:41.918494+0000","last_became_peered":"2024-04-22T06:31:41.918494+0000","last_unstale":"2024-04-22T06:32:18.969513+0000","last_undegraded":"2024-04-22T06:32:18.969513+0000","last_fullsized":"2024-04-22T06:32:18.969513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:38.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149897+0000","last_change":"2024-04-22T06:31:37.841060+0000","last_active":"2024-04-22T06:32:19.149897+0000","last_peered":"2024-04-22T06:32:19.149897+0000","last_clean":"2024-04-22T06:32:19.149897+0000","last_became_active":"2024-04-22T06:31:37.840186+0000","last_became_peered":"2024-04-22T06:31:37.840186+0000","last_unstale":"2024-04-22T06:32:19.149897+0000","last_undegraded":"2024-04-22T06:32:19.149897+0000","last_fullsized":"2024-04-22T06:32:19.149897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:27:55.909625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.293982+0000","last_change":"2024-04-22T06:31:36.841271+0000","last_active":"2024-04-22T06:32:19.293982+0000","last_peered":"2024-04-22T06:32:19.293982+0000","last_clean":"2024-04-22T06:32:19.293982+0000","last_became_active":"2024-04-22T06:31:36.840904+0000","last_became_peered":"2024-04-22T06:31:36.840904+0000","last_unstale":"2024-04-22T06:32:19.293982+0000","last_undegraded":"2024-04-22T06:32:19.293982+0000","last_fullsized":"2024-04-22T06:32:19.293982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:06:04.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150114+0000","last_change":"2024-04-22T06:31:41.877544+0000","last_active":"2024-04-22T06:32:19.150114+0000","last_peered":"2024-04-22T06:32:19.150114+0000","last_clean":"2024-04-22T06:32:19.150114+0000","last_became_active":"2024-04-22T06:31:41.877144+0000","last_became_peered":"2024-04-22T06:31:41.877144+0000","last_unstale":"2024-04-22T06:32:19.150114+0000","last_undegraded":"2024-04-22T06:32:19.150114+0000","last_fullsized":"2024-04-22T06:32:19.150114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:32:11.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981691+0000","last_change":"2024-04-22T06:31:37.843452+0000","last_active":"2024-04-22T06:32:18.981691+0000","last_peered":"2024-04-22T06:32:18.981691+0000","last_clean":"2024-04-22T06:32:18.981691+0000","last_became_active":"2024-04-22T06:31:37.843211+0000","last_became_peered":"2024-04-22T06:31:37.843211+0000","last_unstale":"2024-04-22T06:32:18.981691+0000","last_undegraded":"2024-04-22T06:32:18.981691+0000","last_fullsized":"2024-04-22T06:32:18.981691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:53.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:49.204587+0000","last_change":"2024-04-22T06:31:36.841472+0000","last_active":"2024-04-22T06:33:49.204587+0000","last_peered":"2024-04-22T06:33:49.204587+0000","last_clean":"2024-04-22T06:33:49.204587+0000","last_became_active":"2024-04-22T06:31:36.841127+0000","last_became_peered":"2024-04-22T06:31:36.841127+0000","last_unstale":"2024-04-22T06:33:49.204587+0000","last_undegraded":"2024-04-22T06:33:49.204587+0000","last_fullsized":"2024-04-22T06:33:49.204587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:47:11.795264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149704+0000","last_change":"2024-04-22T06:31:41.916667+0000","last_active":"2024-04-22T06:32:19.149704+0000","last_peered":"2024-04-22T06:32:19.149704+0000","last_clean":"2024-04-22T06:32:19.149704+0000","last_became_active":"2024-04-22T06:31:41.916042+0000","last_became_peered":"2024-04-22T06:31:41.916042+0000","last_unstale":"2024-04-22T06:32:19.149704+0000","last_undegraded":"2024-04-22T06:32:19.149704+0000","last_fullsized":"2024-04-22T06:32:19.149704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:53:50.121934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966851+0000","last_change":"2024-04-22T06:31:37.853017+0000","last_active":"2024-04-22T06:32:18.966851+0000","last_peered":"2024-04-22T06:32:18.966851+0000","last_clean":"2024-04-22T06:32:18.966851+0000","last_became_active":"2024-04-22T06:31:37.852758+0000","last_became_peered":"2024-04-22T06:31:37.852758+0000","last_unstale":"2024-04-22T06:32:18.966851+0000","last_undegraded":"2024-04-22T06:32:18.966851+0000","last_fullsized":"2024-04-22T06:32:18.966851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:59.717571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'15","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:12.872770+0000","last_change":"2024-04-22T06:31:36.837086+0000","last_active":"2024-04-22T06:34:12.872770+0000","last_peered":"2024-04-22T06:34:12.872770+0000","last_clean":"2024-04-22T06:34:12.872770+0000","last_became_active":"2024-04-22T06:31:36.836815+0000","last_became_peered":"2024-04-22T06:31:36.836815+0000","last_unstale":"2024-04-22T06:34:12.872770+0000","last_undegraded":"2024-04-22T06:34:12.872770+0000","last_fullsized":"2024-04-22T06:34:12.872770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:10:55.307221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965852+0000","last_change":"2024-04-22T06:31:41.918145+0000","last_active":"2024-04-22T06:32:18.965852+0000","last_peered":"2024-04-22T06:32:18.965852+0000","last_clean":"2024-04-22T06:32:18.965852+0000","last_became_active":"2024-04-22T06:31:41.917723+0000","last_became_peered":"2024-04-22T06:31:41.917723+0000","last_unstale":"2024-04-22T06:32:18.965852+0000","last_undegraded":"2024-04-22T06:32:18.965852+0000","last_fullsized":"2024-04-22T06:32:18.965852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:22.315515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969613+0000","last_change":"2024-04-22T06:31:37.850110+0000","last_active":"2024-04-22T06:32:18.969613+0000","last_peered":"2024-04-22T06:32:18.969613+0000","last_clean":"2024-04-22T06:32:18.969613+0000","last_became_active":"2024-04-22T06:31:37.849862+0000","last_became_peered":"2024-04-22T06:31:37.849862+0000","last_unstale":"2024-04-22T06:32:18.969613+0000","last_undegraded":"2024-04-22T06:32:18.969613+0000","last_fullsized":"2024-04-22T06:32:18.969613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:29:01.858064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.981124+0000","last_change":"2024-04-22T06:31:36.842668+0000","last_active":"2024-04-22T06:32:24.981124+0000","last_peered":"2024-04-22T06:32:24.981124+0000","last_clean":"2024-04-22T06:32:24.981124+0000","last_became_active":"2024-04-22T06:31:36.842278+0000","last_became_peered":"2024-04-22T06:31:36.842278+0000","last_unstale":"2024-04-22T06:32:24.981124+0000","last_undegraded":"2024-04-22T06:32:24.981124+0000","last_fullsized":"2024-04-22T06:32:24.981124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:25.710505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981349+0000","last_change":"2024-04-22T06:31:41.914663+0000","last_active":"2024-04-22T06:32:18.981349+0000","last_peered":"2024-04-22T06:32:18.981349+0000","last_clean":"2024-04-22T06:32:18.981349+0000","last_became_active":"2024-04-22T06:31:41.914237+0000","last_became_peered":"2024-04-22T06:31:41.914237+0000","last_unstale":"2024-04-22T06:32:18.981349+0000","last_undegraded":"2024-04-22T06:32:18.981349+0000","last_fullsized":"2024-04-22T06:32:18.981349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:49.449019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967577+0000","last_change":"2024-04-22T06:31:37.847035+0000","last_active":"2024-04-22T06:32:18.967577+0000","last_peered":"2024-04-22T06:32:18.967577+0000","last_clean":"2024-04-22T06:32:18.967577+0000","last_became_active":"2024-04-22T06:31:37.846760+0000","last_became_peered":"2024-04-22T06:31:37.846760+0000","last_unstale":"2024-04-22T06:32:18.967577+0000","last_undegraded":"2024-04-22T06:32:18.967577+0000","last_fullsized":"2024-04-22T06:32:18.967577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:35.700047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"25'1","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969706+0000","last_change":"2024-04-22T06:31:36.836293+0000","last_active":"2024-04-22T06:32:18.969706+0000","last_peered":"2024-04-22T06:32:18.969706+0000","last_clean":"2024-04-22T06:32:18.969706+0000","last_became_active":"2024-04-22T06:31:36.835904+0000","last_became_peered":"2024-04-22T06:31:36.835904+0000","last_unstale":"2024-04-22T06:32:18.969706+0000","last_undegraded":"2024-04-22T06:32:18.969706+0000","last_fullsized":"2024-04-22T06:32:18.969706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:42.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969255+0000","last_change":"2024-04-22T06:31:41.880692+0000","last_active":"2024-04-22T06:32:18.969255+0000","last_peered":"2024-04-22T06:32:18.969255+0000","last_clean":"2024-04-22T06:32:18.969255+0000","last_became_active":"2024-04-22T06:31:41.879767+0000","last_became_peered":"2024-04-22T06:31:41.879767+0000","last_unstale":"2024-04-22T06:32:18.969255+0000","last_undegraded":"2024-04-22T06:32:18.969255+0000","last_fullsized":"2024-04-22T06:32:18.969255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:02:51.396029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150374+0000","last_change":"2024-04-22T06:31:37.842597+0000","last_active":"2024-04-22T06:32:19.150374+0000","last_peered":"2024-04-22T06:32:19.150374+0000","last_clean":"2024-04-22T06:32:19.150374+0000","last_became_active":"2024-04-22T06:31:37.841074+0000","last_became_peered":"2024-04-22T06:31:37.841074+0000","last_unstale":"2024-04-22T06:32:19.150374+0000","last_undegraded":"2024-04-22T06:32:19.150374+0000","last_fullsized":"2024-04-22T06:32:19.150374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:02:02.292183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982527+0000","last_change":"2024-04-22T06:31:36.834421+0000","last_active":"2024-04-22T06:32:24.982527+0000","last_peered":"2024-04-22T06:32:24.982527+0000","last_clean":"2024-04-22T06:32:24.982527+0000","last_became_active":"2024-04-22T06:31:36.833689+0000","last_became_peered":"2024-04-22T06:31:36.833689+0000","last_unstale":"2024-04-22T06:32:24.982527+0000","last_undegraded":"2024-04-22T06:32:24.982527+0000","last_fullsized":"2024-04-22T06:32:24.982527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:07:23.303548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969558+0000","last_change":"2024-04-22T06:31:41.877751+0000","last_active":"2024-04-22T06:32:18.969558+0000","last_peered":"2024-04-22T06:32:18.969558+0000","last_clean":"2024-04-22T06:32:18.969558+0000","last_became_active":"2024-04-22T06:31:41.877330+0000","last_became_peered":"2024-04-22T06:31:41.877330+0000","last_unstale":"2024-04-22T06:32:18.969558+0000","last_undegraded":"2024-04-22T06:32:18.969558+0000","last_fullsized":"2024-04-22T06:32:18.969558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:06:00.528207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969031+0000","last_change":"2024-04-22T06:31:37.851802+0000","last_active":"2024-04-22T06:32:18.969031+0000","last_peered":"2024-04-22T06:32:18.969031+0000","last_clean":"2024-04-22T06:32:18.969031+0000","last_became_active":"2024-04-22T06:31:37.851548+0000","last_became_peered":"2024-04-22T06:31:37.851548+0000","last_unstale":"2024-04-22T06:32:18.969031+0000","last_undegraded":"2024-04-22T06:32:18.969031+0000","last_fullsized":"2024-04-22T06:32:18.969031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:46:03.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'8","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:11.925112+0000","last_change":"2024-04-22T06:31:36.833248+0000","last_active":"2024-04-22T06:34:11.925112+0000","last_peered":"2024-04-22T06:34:11.925112+0000","last_clean":"2024-04-22T06:34:11.925112+0000","last_became_active":"2024-04-22T06:31:36.832983+0000","last_became_peered":"2024-04-22T06:31:36.832983+0000","last_unstale":"2024-04-22T06:34:11.925112+0000","last_undegraded":"2024-04-22T06:34:11.925112+0000","last_fullsized":"2024-04-22T06:34:11.925112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:44:34.439442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969534+0000","last_change":"2024-04-22T06:31:41.878243+0000","last_active":"2024-04-22T06:32:18.969534+0000","last_peered":"2024-04-22T06:32:18.969534+0000","last_clean":"2024-04-22T06:32:18.969534+0000","last_became_active":"2024-04-22T06:31:41.877124+0000","last_became_peered":"2024-04-22T06:31:41.877124+0000","last_unstale":"2024-04-22T06:32:18.969534+0000","last_undegraded":"2024-04-22T06:32:18.969534+0000","last_fullsized":"2024-04-22T06:32:18.969534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:04:36.092259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981050+0000","last_change":"2024-04-22T06:31:37.840836+0000","last_active":"2024-04-22T06:32:18.981050+0000","last_peered":"2024-04-22T06:32:18.981050+0000","last_clean":"2024-04-22T06:32:18.981050+0000","last_became_active":"2024-04-22T06:31:37.840475+0000","last_became_peered":"2024-04-22T06:31:37.840475+0000","last_unstale":"2024-04-22T06:32:18.981050+0000","last_undegraded":"2024-04-22T06:32:18.981050+0000","last_fullsized":"2024-04-22T06:32:18.981050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:07.722327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.979386+0000","last_change":"2024-04-22T06:31:36.842040+0000","last_active":"2024-04-22T06:32:24.979386+0000","last_peered":"2024-04-22T06:32:24.979386+0000","last_clean":"2024-04-22T06:32:24.979386+0000","last_became_active":"2024-04-22T06:31:36.841355+0000","last_became_peered":"2024-04-22T06:31:36.841355+0000","last_unstale":"2024-04-22T06:32:24.979386+0000","last_undegraded":"2024-04-22T06:32:24.979386+0000","last_fullsized":"2024-04-22T06:32:24.979386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:22.112841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981568+0000","last_change":"2024-04-22T06:31:41.916363+0000","last_active":"2024-04-22T06:32:18.981568+0000","last_peered":"2024-04-22T06:32:18.981568+0000","last_clean":"2024-04-22T06:32:18.981568+0000","last_became_active":"2024-04-22T06:31:41.915887+0000","last_became_peered":"2024-04-22T06:31:41.915887+0000","last_unstale":"2024-04-22T06:32:18.981568+0000","last_undegraded":"2024-04-22T06:32:18.981568+0000","last_fullsized":"2024-04-22T06:32:18.981568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:58.163967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966266+0000","last_change":"2024-04-22T06:31:37.852334+0000","last_active":"2024-04-22T06:32:18.966266+0000","last_peered":"2024-04-22T06:32:18.966266+0000","last_clean":"2024-04-22T06:32:18.966266+0000","last_became_active":"2024-04-22T06:31:37.851771+0000","last_became_peered":"2024-04-22T06:31:37.851771+0000","last_unstale":"2024-04-22T06:32:18.966266+0000","last_undegraded":"2024-04-22T06:32:18.966266+0000","last_fullsized":"2024-04-22T06:32:18.966266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:21:34.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978712+0000","last_change":"2024-04-22T06:31:36.834519+0000","last_active":"2024-04-22T06:32:24.978712+0000","last_peered":"2024-04-22T06:32:24.978712+0000","last_clean":"2024-04-22T06:32:24.978712+0000","last_became_active":"2024-04-22T06:31:36.834226+0000","last_became_peered":"2024-04-22T06:31:36.834226+0000","last_unstale":"2024-04-22T06:32:24.978712+0000","last_undegraded":"2024-04-22T06:32:24.978712+0000","last_fullsized":"2024-04-22T06:32:24.978712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:14:40.110910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294104+0000","last_change":"2024-04-22T06:31:26.393522+0000","last_active":"2024-04-22T06:32:19.294104+0000","last_peered":"2024-04-22T06:32:19.294104+0000","last_clean":"2024-04-22T06:32:19.294104+0000","last_became_active":"2024-04-22T06:31:26.392534+0000","last_became_peered":"2024-04-22T06:31:26.392534+0000","last_unstale":"2024-04-22T06:32:19.294104+0000","last_undegraded":"2024-04-22T06:32:19.294104+0000","last_fullsized":"2024-04-22T06:32:19.294104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:25.073571+0000","last_clean_scrub_stamp":"2024-04-22T06:31:25.073571+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:04:26.052643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968189+0000","last_change":"2024-04-22T06:31:41.917029+0000","last_active":"2024-04-22T06:32:18.968189+0000","last_peered":"2024-04-22T06:32:18.968189+0000","last_clean":"2024-04-22T06:32:18.968189+0000","last_became_active":"2024-04-22T06:31:41.916584+0000","last_became_peered":"2024-04-22T06:31:41.916584+0000","last_unstale":"2024-04-22T06:32:18.968189+0000","last_undegraded":"2024-04-22T06:32:18.968189+0000","last_fullsized":"2024-04-22T06:32:18.968189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:17:18.127442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294512+0000","last_change":"2024-04-22T06:31:37.854350+0000","last_active":"2024-04-22T06:32:19.294512+0000","last_peered":"2024-04-22T06:32:19.294512+0000","last_clean":"2024-04-22T06:32:19.294512+0000","last_became_active":"2024-04-22T06:31:37.853360+0000","last_became_peered":"2024-04-22T06:31:37.853360+0000","last_unstale":"2024-04-22T06:32:19.294512+0000","last_undegraded":"2024-04-22T06:32:19.294512+0000","last_fullsized":"2024-04-22T06:32:19.294512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:43.558300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.254299+0000","last_change":"2024-04-22T06:31:36.838905+0000","last_active":"2024-04-22T06:32:33.254299+0000","last_peered":"2024-04-22T06:32:33.254299+0000","last_clean":"2024-04-22T06:32:33.254299+0000","last_became_active":"2024-04-22T06:31:36.838550+0000","last_became_peered":"2024-04-22T06:31:36.838550+0000","last_unstale":"2024-04-22T06:32:33.254299+0000","last_undegraded":"2024-04-22T06:32:33.254299+0000","last_fullsized":"2024-04-22T06:32:33.254299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:54:32.482935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966790+0000","last_change":"2024-04-22T06:31:41.914746+0000","last_active":"2024-04-22T06:32:18.966790+0000","last_peered":"2024-04-22T06:32:18.966790+0000","last_clean":"2024-04-22T06:32:18.966790+0000","last_became_active":"2024-04-22T06:31:41.914308+0000","last_became_peered":"2024-04-22T06:31:41.914308+0000","last_unstale":"2024-04-22T06:32:18.966790+0000","last_undegraded":"2024-04-22T06:32:18.966790+0000","last_fullsized":"2024-04-22T06:32:18.966790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:39:08.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967866+0000","last_change":"2024-04-22T06:31:37.848780+0000","last_active":"2024-04-22T06:32:18.967866+0000","last_peered":"2024-04-22T06:32:18.967866+0000","last_clean":"2024-04-22T06:32:18.967866+0000","last_became_active":"2024-04-22T06:31:37.848373+0000","last_became_peered":"2024-04-22T06:31:37.848373+0000","last_unstale":"2024-04-22T06:32:18.967866+0000","last_undegraded":"2024-04-22T06:32:18.967866+0000","last_fullsized":"2024-04-22T06:32:18.967866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:07:29.514201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977946+0000","last_change":"2024-04-22T06:31:36.836267+0000","last_active":"2024-04-22T06:32:24.977946+0000","last_peered":"2024-04-22T06:32:24.977946+0000","last_clean":"2024-04-22T06:32:24.977946+0000","last_became_active":"2024-04-22T06:31:36.835939+0000","last_became_peered":"2024-04-22T06:31:36.835939+0000","last_unstale":"2024-04-22T06:32:24.977946+0000","last_undegraded":"2024-04-22T06:32:24.977946+0000","last_fullsized":"2024-04-22T06:32:24.977946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:26.109405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981480+0000","last_change":"2024-04-22T06:31:41.882161+0000","last_active":"2024-04-22T06:32:18.981480+0000","last_peered":"2024-04-22T06:32:18.981480+0000","last_clean":"2024-04-22T06:32:18.981480+0000","last_became_active":"2024-04-22T06:31:41.881464+0000","last_became_peered":"2024-04-22T06:31:41.881464+0000","last_unstale":"2024-04-22T06:32:18.981480+0000","last_undegraded":"2024-04-22T06:32:18.981480+0000","last_fullsized":"2024-04-22T06:32:18.981480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:53.487760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191830+0000","last_change":"2024-04-22T06:32:19.151055+0000","last_active":"2024-04-22T06:32:19.191830+0000","last_peered":"2024-04-22T06:32:19.191830+0000","last_clean":"2024-04-22T06:32:19.191830+0000","last_became_active":"2024-04-22T06:32:19.150732+0000","last_became_peered":"2024-04-22T06:32:19.150732+0000","last_unstale":"2024-04-22T06:32:19.191830+0000","last_undegraded":"2024-04-22T06:32:19.191830+0000","last_fullsized":"2024-04-22T06:32:19.191830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:52:54.156456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.978510+0000","last_change":"2024-04-22T06:31:36.834320+0000","last_active":"2024-04-22T06:32:24.978510+0000","last_peered":"2024-04-22T06:32:24.978510+0000","last_clean":"2024-04-22T06:32:24.978510+0000","last_became_active":"2024-04-22T06:31:36.834027+0000","last_became_peered":"2024-04-22T06:31:36.834027+0000","last_unstale":"2024-04-22T06:32:24.978510+0000","last_undegraded":"2024-04-22T06:32:24.978510+0000","last_fullsized":"2024-04-22T06:32:24.978510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:40:17.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966555+0000","last_change":"2024-04-22T06:31:41.914727+0000","last_active":"2024-04-22T06:32:18.966555+0000","last_peered":"2024-04-22T06:32:18.966555+0000","last_clean":"2024-04-22T06:32:18.966555+0000","last_became_active":"2024-04-22T06:31:41.914291+0000","last_became_peered":"2024-04-22T06:31:41.914291+0000","last_unstale":"2024-04-22T06:32:18.966555+0000","last_undegraded":"2024-04-22T06:32:18.966555+0000","last_fullsized":"2024-04-22T06:32:18.966555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:40.281691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294649+0000","last_change":"2024-04-22T06:31:37.847023+0000","last_active":"2024-04-22T06:32:19.294649+0000","last_peered":"2024-04-22T06:32:19.294649+0000","last_clean":"2024-04-22T06:32:19.294649+0000","last_became_active":"2024-04-22T06:31:37.846726+0000","last_became_peered":"2024-04-22T06:31:37.846726+0000","last_unstale":"2024-04-22T06:32:19.294649+0000","last_undegraded":"2024-04-22T06:32:19.294649+0000","last_fullsized":"2024-04-22T06:32:19.294649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:59:15.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150320+0000","last_change":"2024-04-22T06:31:36.840488+0000","last_active":"2024-04-22T06:32:19.150320+0000","last_peered":"2024-04-22T06:32:19.150320+0000","last_clean":"2024-04-22T06:32:19.150320+0000","last_became_active":"2024-04-22T06:31:36.840190+0000","last_became_peered":"2024-04-22T06:31:36.840190+0000","last_unstale":"2024-04-22T06:32:19.150320+0000","last_undegraded":"2024-04-22T06:32:19.150320+0000","last_fullsized":"2024-04-22T06:32:19.150320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:26:21.370647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149498+0000","last_change":"2024-04-22T06:31:41.881679+0000","last_active":"2024-04-22T06:32:19.149498+0000","last_peered":"2024-04-22T06:32:19.149498+0000","last_clean":"2024-04-22T06:32:19.149498+0000","last_became_active":"2024-04-22T06:31:41.881245+0000","last_became_peered":"2024-04-22T06:31:41.881245+0000","last_unstale":"2024-04-22T06:32:19.149498+0000","last_undegraded":"2024-04-22T06:32:19.149498+0000","last_fullsized":"2024-04-22T06:32:19.149498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:06.803662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294347+0000","last_change":"2024-04-22T06:31:37.853774+0000","last_active":"2024-04-22T06:32:19.294347+0000","last_peered":"2024-04-22T06:32:19.294347+0000","last_clean":"2024-04-22T06:32:19.294347+0000","last_became_active":"2024-04-22T06:31:37.853530+0000","last_became_peered":"2024-04-22T06:31:37.853530+0000","last_unstale":"2024-04-22T06:32:19.294347+0000","last_undegraded":"2024-04-22T06:32:19.294347+0000","last_fullsized":"2024-04-22T06:32:19.294347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:54.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.976514+0000","last_change":"2024-04-22T06:31:36.832168+0000","last_active":"2024-04-22T06:32:24.976514+0000","last_peered":"2024-04-22T06:32:24.976514+0000","last_clean":"2024-04-22T06:32:24.976514+0000","last_became_active":"2024-04-22T06:31:36.831745+0000","last_became_peered":"2024-04-22T06:31:36.831745+0000","last_unstale":"2024-04-22T06:32:24.976514+0000","last_undegraded":"2024-04-22T06:32:24.976514+0000","last_fullsized":"2024-04-22T06:32:24.976514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:34:17.712525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981474+0000","last_change":"2024-04-22T06:31:41.871562+0000","last_active":"2024-04-22T06:32:18.981474+0000","last_peered":"2024-04-22T06:32:18.981474+0000","last_clean":"2024-04-22T06:32:18.981474+0000","last_became_active":"2024-04-22T06:31:41.871094+0000","last_became_peered":"2024-04-22T06:31:41.871094+0000","last_unstale":"2024-04-22T06:32:18.981474+0000","last_undegraded":"2024-04-22T06:32:18.981474+0000","last_fullsized":"2024-04-22T06:32:18.981474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:47.892471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967600+0000","last_change":"2024-04-22T06:31:37.851801+0000","last_active":"2024-04-22T06:32:18.967600+0000","last_peered":"2024-04-22T06:32:18.967600+0000","last_clean":"2024-04-22T06:32:18.967600+0000","last_became_active":"2024-04-22T06:31:37.851537+0000","last_became_peered":"2024-04-22T06:31:37.851537+0000","last_unstale":"2024-04-22T06:32:18.967600+0000","last_undegraded":"2024-04-22T06:32:18.967600+0000","last_fullsized":"2024-04-22T06:32:18.967600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:52.316283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.258892+0000","last_change":"2024-04-22T06:31:36.842983+0000","last_active":"2024-04-22T06:32:33.258892+0000","last_peered":"2024-04-22T06:32:33.258892+0000","last_clean":"2024-04-22T06:32:33.258892+0000","last_became_active":"2024-04-22T06:31:36.842721+0000","last_became_peered":"2024-04-22T06:31:36.842721+0000","last_unstale":"2024-04-22T06:32:33.258892+0000","last_undegraded":"2024-04-22T06:32:33.258892+0000","last_fullsized":"2024-04-22T06:32:33.258892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:04:50.661232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966666+0000","last_change":"2024-04-22T06:31:41.918628+0000","last_active":"2024-04-22T06:32:18.966666+0000","last_peered":"2024-04-22T06:32:18.966666+0000","last_clean":"2024-04-22T06:32:18.966666+0000","last_became_active":"2024-04-22T06:31:41.918216+0000","last_became_peered":"2024-04-22T06:31:41.918216+0000","last_unstale":"2024-04-22T06:32:18.966666+0000","last_undegraded":"2024-04-22T06:32:18.966666+0000","last_fullsized":"2024-04-22T06:32:18.966666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:47:06.796158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294324+0000","last_change":"2024-04-22T06:31:37.847723+0000","last_active":"2024-04-22T06:32:19.294324+0000","last_peered":"2024-04-22T06:32:19.294324+0000","last_clean":"2024-04-22T06:32:19.294324+0000","last_became_active":"2024-04-22T06:31:37.847189+0000","last_became_peered":"2024-04-22T06:31:37.847189+0000","last_unstale":"2024-04-22T06:32:19.294324+0000","last_undegraded":"2024-04-22T06:32:19.294324+0000","last_fullsized":"2024-04-22T06:32:19.294324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:59:33.555800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:59.205857+0000","last_change":"2024-04-22T06:31:36.839663+0000","last_active":"2024-04-22T06:33:59.205857+0000","last_peered":"2024-04-22T06:33:59.205857+0000","last_clean":"2024-04-22T06:33:59.205857+0000","last_became_active":"2024-04-22T06:31:36.838219+0000","last_became_peered":"2024-04-22T06:31:36.838219+0000","last_unstale":"2024-04-22T06:33:59.205857+0000","last_undegraded":"2024-04-22T06:33:59.205857+0000","last_fullsized":"2024-04-22T06:33:59.205857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:02.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966505+0000","last_change":"2024-04-22T06:31:41.914947+0000","last_active":"2024-04-22T06:32:18.966505+0000","last_peered":"2024-04-22T06:32:18.966505+0000","last_clean":"2024-04-22T06:32:18.966505+0000","last_became_active":"2024-04-22T06:31:41.914381+0000","last_became_peered":"2024-04-22T06:31:41.914381+0000","last_unstale":"2024-04-22T06:32:18.966505+0000","last_undegraded":"2024-04-22T06:32:18.966505+0000","last_fullsized":"2024-04-22T06:32:18.966505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:12:58.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981324+0000","last_change":"2024-04-22T06:31:37.846663+0000","last_active":"2024-04-22T06:32:18.981324+0000","last_peered":"2024-04-22T06:32:18.981324+0000","last_clean":"2024-04-22T06:32:18.981324+0000","last_became_active":"2024-04-22T06:31:37.846416+0000","last_became_peered":"2024-04-22T06:31:37.846416+0000","last_unstale":"2024-04-22T06:32:18.981324+0000","last_undegraded":"2024-04-22T06:32:18.981324+0000","last_fullsized":"2024-04-22T06:32:18.981324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:58:26.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977596+0000","last_change":"2024-04-22T06:31:36.835657+0000","last_active":"2024-04-22T06:32:24.977596+0000","last_peered":"2024-04-22T06:32:24.977596+0000","last_clean":"2024-04-22T06:32:24.977596+0000","last_became_active":"2024-04-22T06:31:36.835381+0000","last_became_peered":"2024-04-22T06:31:36.835381+0000","last_unstale":"2024-04-22T06:32:24.977596+0000","last_undegraded":"2024-04-22T06:32:24.977596+0000","last_fullsized":"2024-04-22T06:32:24.977596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:33.486052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967461+0000","last_change":"2024-04-22T06:31:41.916696+0000","last_active":"2024-04-22T06:32:18.967461+0000","last_peered":"2024-04-22T06:32:18.967461+0000","last_clean":"2024-04-22T06:32:18.967461+0000","last_became_active":"2024-04-22T06:31:41.916307+0000","last_became_peered":"2024-04-22T06:31:41.916307+0000","last_unstale":"2024-04-22T06:32:18.967461+0000","last_undegraded":"2024-04-22T06:32:18.967461+0000","last_fullsized":"2024-04-22T06:32:18.967461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:38:03.451241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294362+0000","last_change":"2024-04-22T06:31:37.848693+0000","last_active":"2024-04-22T06:32:19.294362+0000","last_peered":"2024-04-22T06:32:19.294362+0000","last_clean":"2024-04-22T06:32:19.294362+0000","last_became_active":"2024-04-22T06:31:37.847510+0000","last_became_peered":"2024-04-22T06:31:37.847510+0000","last_unstale":"2024-04-22T06:32:19.294362+0000","last_undegraded":"2024-04-22T06:32:19.294362+0000","last_fullsized":"2024-04-22T06:32:19.294362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:30:22.964834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'26","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:17.859569+0000","last_change":"2024-04-22T06:31:36.841551+0000","last_active":"2024-04-22T06:34:17.859569+0000","last_peered":"2024-04-22T06:34:17.859569+0000","last_clean":"2024-04-22T06:34:17.859569+0000","last_became_active":"2024-04-22T06:31:36.841296+0000","last_became_peered":"2024-04-22T06:31:36.841296+0000","last_unstale":"2024-04-22T06:34:17.859569+0000","last_undegraded":"2024-04-22T06:34:17.859569+0000","last_fullsized":"2024-04-22T06:34:17.859569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:20:40.662173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37755,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:07.285564+0000","last_change":"2024-04-22T06:31:41.880973+0000","last_active":"2024-04-22T06:34:07.285564+0000","last_peered":"2024-04-22T06:34:07.285564+0000","last_clean":"2024-04-22T06:34:07.285564+0000","last_became_active":"2024-04-22T06:31:41.880339+0000","last_became_peered":"2024-04-22T06:31:41.880339+0000","last_unstale":"2024-04-22T06:34:07.285564+0000","last_undegraded":"2024-04-22T06:34:07.285564+0000","last_fullsized":"2024-04-22T06:34:07.285564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:59:53.712196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150204+0000","last_change":"2024-04-22T06:31:37.848030+0000","last_active":"2024-04-22T06:32:19.150204+0000","last_peered":"2024-04-22T06:32:19.150204+0000","last_clean":"2024-04-22T06:32:19.150204+0000","last_became_active":"2024-04-22T06:31:37.847199+0000","last_became_peered":"2024-04-22T06:31:37.847199+0000","last_unstale":"2024-04-22T06:32:19.150204+0000","last_undegraded":"2024-04-22T06:32:19.150204+0000","last_fullsized":"2024-04-22T06:32:19.150204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:11.923418+0000","last_change":"2024-04-22T06:31:36.837746+0000","last_active":"2024-04-22T06:34:11.923418+0000","last_peered":"2024-04-22T06:34:11.923418+0000","last_clean":"2024-04-22T06:34:11.923418+0000","last_became_active":"2024-04-22T06:31:36.837471+0000","last_became_peered":"2024-04-22T06:31:36.837471+0000","last_unstale":"2024-04-22T06:34:11.923418+0000","last_undegraded":"2024-04-22T06:34:11.923418+0000","last_fullsized":"2024-04-22T06:34:11.923418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:57:47.182603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150095+0000","last_change":"2024-04-22T06:31:41.880935+0000","last_active":"2024-04-22T06:32:19.150095+0000","last_peered":"2024-04-22T06:32:19.150095+0000","last_clean":"2024-04-22T06:32:19.150095+0000","last_became_active":"2024-04-22T06:31:41.880110+0000","last_became_peered":"2024-04-22T06:31:41.880110+0000","last_unstale":"2024-04-22T06:32:19.150095+0000","last_undegraded":"2024-04-22T06:32:19.150095+0000","last_fullsized":"2024-04-22T06:32:19.150095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:16:27.852433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981808+0000","last_change":"2024-04-22T06:31:37.847238+0000","last_active":"2024-04-22T06:32:18.981808+0000","last_peered":"2024-04-22T06:32:18.981808+0000","last_clean":"2024-04-22T06:32:18.981808+0000","last_became_active":"2024-04-22T06:31:37.847007+0000","last_became_peered":"2024-04-22T06:31:37.847007+0000","last_unstale":"2024-04-22T06:32:18.981808+0000","last_undegraded":"2024-04-22T06:32:18.981808+0000","last_fullsized":"2024-04-22T06:32:18.981808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:01.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982245+0000","last_change":"2024-04-22T06:31:36.835086+0000","last_active":"2024-04-22T06:32:24.982245+0000","last_peered":"2024-04-22T06:32:24.982245+0000","last_clean":"2024-04-22T06:32:24.982245+0000","last_became_active":"2024-04-22T06:31:36.834655+0000","last_became_peered":"2024-04-22T06:31:36.834655+0000","last_unstale":"2024-04-22T06:32:24.982245+0000","last_undegraded":"2024-04-22T06:32:24.982245+0000","last_fullsized":"2024-04-22T06:32:24.982245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:04.620501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966033+0000","last_change":"2024-04-22T06:31:41.878281+0000","last_active":"2024-04-22T06:32:18.966033+0000","last_peered":"2024-04-22T06:32:18.966033+0000","last_clean":"2024-04-22T06:32:18.966033+0000","last_became_active":"2024-04-22T06:31:41.877614+0000","last_became_peered":"2024-04-22T06:31:41.877614+0000","last_unstale":"2024-04-22T06:32:18.966033+0000","last_undegraded":"2024-04-22T06:32:18.966033+0000","last_fullsized":"2024-04-22T06:32:18.966033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:52.158129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967651+0000","last_change":"2024-04-22T06:31:37.854384+0000","last_active":"2024-04-22T06:32:18.967651+0000","last_peered":"2024-04-22T06:32:18.967651+0000","last_clean":"2024-04-22T06:32:18.967651+0000","last_became_active":"2024-04-22T06:31:37.854125+0000","last_became_peered":"2024-04-22T06:31:37.854125+0000","last_unstale":"2024-04-22T06:32:18.967651+0000","last_undegraded":"2024-04-22T06:32:18.967651+0000","last_fullsized":"2024-04-22T06:32:18.967651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:17:27.391690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:34:04.206636+0000","last_change":"2024-04-22T06:31:36.839840+0000","last_active":"2024-04-22T06:34:04.206636+0000","last_peered":"2024-04-22T06:34:04.206636+0000","last_clean":"2024-04-22T06:34:04.206636+0000","last_became_active":"2024-04-22T06:31:36.839581+0000","last_became_peered":"2024-04-22T06:31:36.839581+0000","last_unstale":"2024-04-22T06:34:04.206636+0000","last_undegraded":"2024-04-22T06:34:04.206636+0000","last_fullsized":"2024-04-22T06:34:04.206636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:44:20.715130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966093+0000","last_change":"2024-04-22T06:31:41.918052+0000","last_active":"2024-04-22T06:32:18.966093+0000","last_peered":"2024-04-22T06:32:18.966093+0000","last_clean":"2024-04-22T06:32:18.966093+0000","last_became_active":"2024-04-22T06:31:41.917678+0000","last_became_peered":"2024-04-22T06:31:41.917678+0000","last_unstale":"2024-04-22T06:32:18.966093+0000","last_undegraded":"2024-04-22T06:32:18.966093+0000","last_fullsized":"2024-04-22T06:32:18.966093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:37:48.020135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981109+0000","last_change":"2024-04-22T06:31:41.916541+0000","last_active":"2024-04-22T06:32:18.981109+0000","last_peered":"2024-04-22T06:32:18.981109+0000","last_clean":"2024-04-22T06:32:18.981109+0000","last_became_active":"2024-04-22T06:31:41.915928+0000","last_became_peered":"2024-04-22T06:31:41.915928+0000","last_unstale":"2024-04-22T06:32:18.981109+0000","last_undegraded":"2024-04-22T06:32:18.981109+0000","last_fullsized":"2024-04-22T06:32:18.981109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:02.755369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969532+0000","last_change":"2024-04-22T06:31:37.847622+0000","last_active":"2024-04-22T06:32:18.969532+0000","last_peered":"2024-04-22T06:32:18.969532+0000","last_clean":"2024-04-22T06:32:18.969532+0000","last_became_active":"2024-04-22T06:31:37.847296+0000","last_became_peered":"2024-04-22T06:31:37.847296+0000","last_unstale":"2024-04-22T06:32:18.969532+0000","last_undegraded":"2024-04-22T06:32:18.969532+0000","last_fullsized":"2024-04-22T06:32:18.969532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:01.272629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.977221+0000","last_change":"2024-04-22T06:31:36.835428+0000","last_active":"2024-04-22T06:32:24.977221+0000","last_peered":"2024-04-22T06:32:24.977221+0000","last_clean":"2024-04-22T06:32:24.977221+0000","last_became_active":"2024-04-22T06:31:36.835000+0000","last_became_peered":"2024-04-22T06:31:36.835000+0000","last_unstale":"2024-04-22T06:32:24.977221+0000","last_undegraded":"2024-04-22T06:32:24.977221+0000","last_fullsized":"2024-04-22T06:32:24.977221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:05:12.426849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.983767+0000","last_change":"2024-04-22T06:32:18.982812+0000","last_active":"2024-04-22T06:32:18.983767+0000","last_peered":"2024-04-22T06:32:18.983767+0000","last_clean":"2024-04-22T06:32:18.983767+0000","last_became_active":"2024-04-22T06:32:18.982355+0000","last_became_peered":"2024-04-22T06:32:18.982355+0000","last_unstale":"2024-04-22T06:32:18.983767+0000","last_undegraded":"2024-04-22T06:32:18.983767+0000","last_fullsized":"2024-04-22T06:32:18.983767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:01:41.368881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966059+0000","last_change":"2024-04-22T06:31:37.848773+0000","last_active":"2024-04-22T06:32:18.966059+0000","last_peered":"2024-04-22T06:32:18.966059+0000","last_clean":"2024-04-22T06:32:18.966059+0000","last_became_active":"2024-04-22T06:31:37.848253+0000","last_became_peered":"2024-04-22T06:31:37.848253+0000","last_unstale":"2024-04-22T06:32:18.966059+0000","last_undegraded":"2024-04-22T06:32:18.966059+0000","last_fullsized":"2024-04-22T06:32:18.966059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:23.665814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:24.982017+0000","last_change":"2024-04-22T06:31:36.837092+0000","last_active":"2024-04-22T06:32:24.982017+0000","last_peered":"2024-04-22T06:32:24.982017+0000","last_clean":"2024-04-22T06:32:24.982017+0000","last_became_active":"2024-04-22T06:31:36.836530+0000","last_became_peered":"2024-04-22T06:31:36.836530+0000","last_unstale":"2024-04-22T06:32:24.982017+0000","last_undegraded":"2024-04-22T06:32:24.982017+0000","last_fullsized":"2024-04-22T06:32:24.982017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:41:24.552954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967106+0000","last_change":"2024-04-22T06:31:36.842733+0000","last_active":"2024-04-22T06:32:18.967106+0000","last_peered":"2024-04-22T06:32:18.967106+0000","last_clean":"2024-04-22T06:32:18.967106+0000","last_became_active":"2024-04-22T06:31:36.842486+0000","last_became_peered":"2024-04-22T06:31:36.842486+0000","last_unstale":"2024-04-22T06:32:18.967106+0000","last_undegraded":"2024-04-22T06:32:18.967106+0000","last_fullsized":"2024-04-22T06:32:18.967106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:15:51.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981566+0000","last_change":"2024-04-22T06:31:37.843465+0000","last_active":"2024-04-22T06:32:18.981566+0000","last_peered":"2024-04-22T06:32:18.981566+0000","last_clean":"2024-04-22T06:32:18.981566+0000","last_became_active":"2024-04-22T06:31:37.842864+0000","last_became_peered":"2024-04-22T06:31:37.842864+0000","last_unstale":"2024-04-22T06:32:18.981566+0000","last_undegraded":"2024-04-22T06:32:18.981566+0000","last_fullsized":"2024-04-22T06:32:18.981566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:36.607109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.984626+0000","last_change":"2024-04-22T06:32:18.982586+0000","last_active":"2024-04-22T06:32:18.984626+0000","last_peered":"2024-04-22T06:32:18.984626+0000","last_clean":"2024-04-22T06:32:18.984626+0000","last_became_active":"2024-04-22T06:32:18.982159+0000","last_became_peered":"2024-04-22T06:32:18.982159+0000","last_unstale":"2024-04-22T06:32:18.984626+0000","last_undegraded":"2024-04-22T06:32:18.984626+0000","last_fullsized":"2024-04-22T06:32:18.984626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:52:37.104899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:33.256691+0000","last_change":"2024-04-22T06:31:36.841584+0000","last_active":"2024-04-22T06:32:33.256691+0000","last_peered":"2024-04-22T06:32:33.256691+0000","last_clean":"2024-04-22T06:32:33.256691+0000","last_became_active":"2024-04-22T06:31:36.841294+0000","last_became_peered":"2024-04-22T06:31:36.841294+0000","last_unstale":"2024-04-22T06:32:33.256691+0000","last_undegraded":"2024-04-22T06:32:33.256691+0000","last_fullsized":"2024-04-22T06:32:33.256691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:35.809812+0000","last_clean_scrub_stamp":"2024-04-22T06:31:35.809812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:24:05.746554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.149982+0000","last_change":"2024-04-22T06:31:37.845478+0000","last_active":"2024-04-22T06:32:19.149982+0000","last_peered":"2024-04-22T06:32:19.149982+0000","last_clean":"2024-04-22T06:32:19.149982+0000","last_became_active":"2024-04-22T06:31:37.845186+0000","last_became_peered":"2024-04-22T06:31:37.845186+0000","last_unstale":"2024-04-22T06:32:19.149982+0000","last_undegraded":"2024-04-22T06:32:19.149982+0000","last_fullsized":"2024-04-22T06:32:19.149982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:49:40.132909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.154071+0000","last_change":"2024-04-22T06:32:19.151801+0000","last_active":"2024-04-22T06:32:19.154071+0000","last_peered":"2024-04-22T06:32:19.154071+0000","last_clean":"2024-04-22T06:32:19.154071+0000","last_became_active":"2024-04-22T06:32:19.151353+0000","last_became_peered":"2024-04-22T06:32:19.151353+0000","last_unstale":"2024-04-22T06:32:19.154071+0000","last_undegraded":"2024-04-22T06:32:19.154071+0000","last_fullsized":"2024-04-22T06:32:19.154071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:40.846746+0000","last_clean_scrub_stamp":"2024-04-22T06:31:40.846746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:56:11.699970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967441+0000","last_change":"2024-04-22T06:31:37.852476+0000","last_active":"2024-04-22T06:32:18.967441+0000","last_peered":"2024-04-22T06:32:18.967441+0000","last_clean":"2024-04-22T06:32:18.967441+0000","last_became_active":"2024-04-22T06:31:37.852222+0000","last_became_peered":"2024-04-22T06:31:37.852222+0000","last_unstale":"2024-04-22T06:32:18.967441+0000","last_undegraded":"2024-04-22T06:32:18.967441+0000","last_fullsized":"2024-04-22T06:32:18.967441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:08:08.955947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968335+0000","last_change":"2024-04-22T06:31:37.848572+0000","last_active":"2024-04-22T06:32:18.968335+0000","last_peered":"2024-04-22T06:32:18.968335+0000","last_clean":"2024-04-22T06:32:18.968335+0000","last_became_active":"2024-04-22T06:31:37.848311+0000","last_became_peered":"2024-04-22T06:31:37.848311+0000","last_unstale":"2024-04-22T06:32:18.968335+0000","last_undegraded":"2024-04-22T06:32:18.968335+0000","last_fullsized":"2024-04-22T06:32:18.968335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:21:36.676669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967509+0000","last_change":"2024-04-22T06:31:37.853699+0000","last_active":"2024-04-22T06:32:18.967509+0000","last_peered":"2024-04-22T06:32:18.967509+0000","last_clean":"2024-04-22T06:32:18.967509+0000","last_became_active":"2024-04-22T06:31:37.853283+0000","last_became_peered":"2024-04-22T06:31:37.853283+0000","last_unstale":"2024-04-22T06:32:18.967509+0000","last_undegraded":"2024-04-22T06:32:18.967509+0000","last_fullsized":"2024-04-22T06:32:18.967509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:43:06.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981517+0000","last_change":"2024-04-22T06:31:37.843676+0000","last_active":"2024-04-22T06:32:18.981517+0000","last_peered":"2024-04-22T06:32:18.981517+0000","last_clean":"2024-04-22T06:32:18.981517+0000","last_became_active":"2024-04-22T06:31:37.843230+0000","last_became_peered":"2024-04-22T06:31:37.843230+0000","last_unstale":"2024-04-22T06:32:18.981517+0000","last_undegraded":"2024-04-22T06:32:18.981517+0000","last_fullsized":"2024-04-22T06:32:18.981517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:45.753068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966671+0000","last_change":"2024-04-22T06:31:37.850791+0000","last_active":"2024-04-22T06:32:18.966671+0000","last_peered":"2024-04-22T06:32:18.966671+0000","last_clean":"2024-04-22T06:32:18.966671+0000","last_became_active":"2024-04-22T06:31:37.850353+0000","last_became_peered":"2024-04-22T06:31:37.850353+0000","last_unstale":"2024-04-22T06:32:18.966671+0000","last_undegraded":"2024-04-22T06:32:18.966671+0000","last_fullsized":"2024-04-22T06:32:18.966671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:38.300215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969307+0000","last_change":"2024-04-22T06:31:37.846887+0000","last_active":"2024-04-22T06:32:18.969307+0000","last_peered":"2024-04-22T06:32:18.969307+0000","last_clean":"2024-04-22T06:32:18.969307+0000","last_became_active":"2024-04-22T06:31:37.846653+0000","last_became_peered":"2024-04-22T06:31:37.846653+0000","last_unstale":"2024-04-22T06:32:18.969307+0000","last_undegraded":"2024-04-22T06:32:18.969307+0000","last_fullsized":"2024-04-22T06:32:18.969307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:53:56.896926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968602+0000","last_change":"2024-04-22T06:31:37.854385+0000","last_active":"2024-04-22T06:32:18.968602+0000","last_peered":"2024-04-22T06:32:18.968602+0000","last_clean":"2024-04-22T06:32:18.968602+0000","last_became_active":"2024-04-22T06:31:37.854097+0000","last_became_peered":"2024-04-22T06:31:37.854097+0000","last_unstale":"2024-04-22T06:32:18.968602+0000","last_undegraded":"2024-04-22T06:32:18.968602+0000","last_fullsized":"2024-04-22T06:32:18.968602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:39:55.266786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.993285+0000","last_change":"2024-04-22T06:32:19.151471+0000","last_active":"2024-04-22T06:32:19.993285+0000","last_peered":"2024-04-22T06:32:19.993285+0000","last_clean":"2024-04-22T06:32:19.993285+0000","last_became_active":"2024-04-22T06:32:19.151207+0000","last_became_peered":"2024-04-22T06:32:19.151207+0000","last_unstale":"2024-04-22T06:32:19.993285+0000","last_undegraded":"2024-04-22T06:32:19.993285+0000","last_fullsized":"2024-04-22T06:32:19.993285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:37:11.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966641+0000","last_change":"2024-04-22T06:31:37.847780+0000","last_active":"2024-04-22T06:32:18.966641+0000","last_peered":"2024-04-22T06:32:18.966641+0000","last_clean":"2024-04-22T06:32:18.966641+0000","last_became_active":"2024-04-22T06:31:37.847514+0000","last_became_peered":"2024-04-22T06:31:37.847514+0000","last_unstale":"2024-04-22T06:32:18.966641+0000","last_undegraded":"2024-04-22T06:32:18.966641+0000","last_fullsized":"2024-04-22T06:32:18.966641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:54:13.197634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966443+0000","last_change":"2024-04-22T06:31:37.843583+0000","last_active":"2024-04-22T06:32:18.966443+0000","last_peered":"2024-04-22T06:32:18.966443+0000","last_clean":"2024-04-22T06:32:18.966443+0000","last_became_active":"2024-04-22T06:31:37.843330+0000","last_became_peered":"2024-04-22T06:31:37.843330+0000","last_unstale":"2024-04-22T06:32:18.966443+0000","last_undegraded":"2024-04-22T06:32:18.966443+0000","last_fullsized":"2024-04-22T06:32:18.966443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:50:19.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967417+0000","last_change":"2024-04-22T06:31:37.855251+0000","last_active":"2024-04-22T06:32:18.967417+0000","last_peered":"2024-04-22T06:32:18.967417+0000","last_clean":"2024-04-22T06:32:18.967417+0000","last_became_active":"2024-04-22T06:31:37.854957+0000","last_became_peered":"2024-04-22T06:31:37.854957+0000","last_unstale":"2024-04-22T06:32:18.967417+0000","last_undegraded":"2024-04-22T06:32:18.967417+0000","last_fullsized":"2024-04-22T06:32:18.967417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:59:20.618142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981427+0000","last_change":"2024-04-22T06:31:37.846269+0000","last_active":"2024-04-22T06:32:18.981427+0000","last_peered":"2024-04-22T06:32:18.981427+0000","last_clean":"2024-04-22T06:32:18.981427+0000","last_became_active":"2024-04-22T06:31:37.846030+0000","last_became_peered":"2024-04-22T06:31:37.846030+0000","last_unstale":"2024-04-22T06:32:18.981427+0000","last_undegraded":"2024-04-22T06:32:18.981427+0000","last_fullsized":"2024-04-22T06:32:18.981427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.018043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968042+0000","last_change":"2024-04-22T06:31:37.849814+0000","last_active":"2024-04-22T06:32:18.968042+0000","last_peered":"2024-04-22T06:32:18.968042+0000","last_clean":"2024-04-22T06:32:18.968042+0000","last_became_active":"2024-04-22T06:31:37.849543+0000","last_became_peered":"2024-04-22T06:31:37.849543+0000","last_unstale":"2024-04-22T06:32:18.968042+0000","last_undegraded":"2024-04-22T06:32:18.968042+0000","last_fullsized":"2024-04-22T06:32:18.968042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:05.063490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294620+0000","last_change":"2024-04-22T06:31:37.854466+0000","last_active":"2024-04-22T06:32:19.294620+0000","last_peered":"2024-04-22T06:32:19.294620+0000","last_clean":"2024-04-22T06:32:19.294620+0000","last_became_active":"2024-04-22T06:31:37.848297+0000","last_became_peered":"2024-04-22T06:31:37.848297+0000","last_unstale":"2024-04-22T06:32:19.294620+0000","last_undegraded":"2024-04-22T06:32:19.294620+0000","last_fullsized":"2024-04-22T06:32:19.294620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:05:11.753535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968136+0000","last_change":"2024-04-22T06:31:37.842026+0000","last_active":"2024-04-22T06:32:18.968136+0000","last_peered":"2024-04-22T06:32:18.968136+0000","last_clean":"2024-04-22T06:32:18.968136+0000","last_became_active":"2024-04-22T06:31:37.841790+0000","last_became_peered":"2024-04-22T06:31:37.841790+0000","last_unstale":"2024-04-22T06:32:18.968136+0000","last_undegraded":"2024-04-22T06:32:18.968136+0000","last_fullsized":"2024-04-22T06:32:18.968136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:53.615708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968002+0000","last_change":"2024-04-22T06:31:37.854795+0000","last_active":"2024-04-22T06:32:18.968002+0000","last_peered":"2024-04-22T06:32:18.968002+0000","last_clean":"2024-04-22T06:32:18.968002+0000","last_became_active":"2024-04-22T06:31:37.854540+0000","last_became_peered":"2024-04-22T06:31:37.854540+0000","last_unstale":"2024-04-22T06:32:18.968002+0000","last_undegraded":"2024-04-22T06:32:18.968002+0000","last_fullsized":"2024-04-22T06:32:18.968002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:12:07.833687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.191784+0000","last_change":"2024-04-22T06:32:18.981673+0000","last_active":"2024-04-22T06:32:19.191784+0000","last_peered":"2024-04-22T06:32:19.191784+0000","last_clean":"2024-04-22T06:32:19.191784+0000","last_became_active":"2024-04-22T06:32:18.981385+0000","last_became_peered":"2024-04-22T06:32:18.981385+0000","last_unstale":"2024-04-22T06:32:19.191784+0000","last_undegraded":"2024-04-22T06:32:19.191784+0000","last_fullsized":"2024-04-22T06:32:19.191784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:12:05.631449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969043+0000","last_change":"2024-04-22T06:31:37.842636+0000","last_active":"2024-04-22T06:32:18.969043+0000","last_peered":"2024-04-22T06:32:18.969043+0000","last_clean":"2024-04-22T06:32:18.969043+0000","last_became_active":"2024-04-22T06:31:37.842374+0000","last_became_peered":"2024-04-22T06:31:37.842374+0000","last_unstale":"2024-04-22T06:32:18.969043+0000","last_undegraded":"2024-04-22T06:32:18.969043+0000","last_fullsized":"2024-04-22T06:32:18.969043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:09.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:33:58.999631+0000","last_change":"2024-04-22T06:31:37.843505+0000","last_active":"2024-04-22T06:33:58.999631+0000","last_peered":"2024-04-22T06:33:58.999631+0000","last_clean":"2024-04-22T06:33:58.999631+0000","last_became_active":"2024-04-22T06:31:37.843213+0000","last_became_peered":"2024-04-22T06:31:37.843213+0000","last_unstale":"2024-04-22T06:33:58.999631+0000","last_undegraded":"2024-04-22T06:33:58.999631+0000","last_fullsized":"2024-04-22T06:33:58.999631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:08:48.783670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.966202+0000","last_change":"2024-04-22T06:31:37.846205+0000","last_active":"2024-04-22T06:32:18.966202+0000","last_peered":"2024-04-22T06:32:18.966202+0000","last_clean":"2024-04-22T06:32:18.966202+0000","last_became_active":"2024-04-22T06:31:37.844801+0000","last_became_peered":"2024-04-22T06:31:37.844801+0000","last_unstale":"2024-04-22T06:32:18.966202+0000","last_undegraded":"2024-04-22T06:32:18.966202+0000","last_fullsized":"2024-04-22T06:32:18.966202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:49:45.871115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.150299+0000","last_change":"2024-04-22T06:31:37.842955+0000","last_active":"2024-04-22T06:32:19.150299+0000","last_peered":"2024-04-22T06:32:19.150299+0000","last_clean":"2024-04-22T06:32:19.150299+0000","last_became_active":"2024-04-22T06:31:37.842675+0000","last_became_peered":"2024-04-22T06:31:37.842675+0000","last_unstale":"2024-04-22T06:32:19.150299+0000","last_undegraded":"2024-04-22T06:32:19.150299+0000","last_fullsized":"2024-04-22T06:32:19.150299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:24:38.019348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968345+0000","last_change":"2024-04-22T06:31:37.848656+0000","last_active":"2024-04-22T06:32:18.968345+0000","last_peered":"2024-04-22T06:32:18.968345+0000","last_clean":"2024-04-22T06:32:18.968345+0000","last_became_active":"2024-04-22T06:31:37.848271+0000","last_became_peered":"2024-04-22T06:31:37.848271+0000","last_unstale":"2024-04-22T06:32:18.968345+0000","last_undegraded":"2024-04-22T06:32:18.968345+0000","last_fullsized":"2024-04-22T06:32:18.968345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:40:32.487120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.968555+0000","last_change":"2024-04-22T06:31:37.849353+0000","last_active":"2024-04-22T06:32:18.968555+0000","last_peered":"2024-04-22T06:32:18.968555+0000","last_clean":"2024-04-22T06:32:18.968555+0000","last_became_active":"2024-04-22T06:31:37.849072+0000","last_became_peered":"2024-04-22T06:31:37.849072+0000","last_unstale":"2024-04-22T06:32:18.968555+0000","last_undegraded":"2024-04-22T06:32:18.968555+0000","last_fullsized":"2024-04-22T06:32:18.968555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:12:21.174629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294891+0000","last_change":"2024-04-22T06:31:37.854829+0000","last_active":"2024-04-22T06:32:19.294891+0000","last_peered":"2024-04-22T06:32:19.294891+0000","last_clean":"2024-04-22T06:32:19.294891+0000","last_became_active":"2024-04-22T06:31:37.853515+0000","last_became_peered":"2024-04-22T06:31:37.853515+0000","last_unstale":"2024-04-22T06:32:19.294891+0000","last_undegraded":"2024-04-22T06:32:19.294891+0000","last_fullsized":"2024-04-22T06:32:19.294891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:01:50.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.965958+0000","last_change":"2024-04-22T06:31:37.848927+0000","last_active":"2024-04-22T06:32:18.965958+0000","last_peered":"2024-04-22T06:32:18.965958+0000","last_clean":"2024-04-22T06:32:18.965958+0000","last_became_active":"2024-04-22T06:31:37.848545+0000","last_became_peered":"2024-04-22T06:31:37.848545+0000","last_unstale":"2024-04-22T06:32:18.965958+0000","last_undegraded":"2024-04-22T06:32:18.965958+0000","last_fullsized":"2024-04-22T06:32:18.965958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:15:20.689914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294233+0000","last_change":"2024-04-22T06:31:37.857239+0000","last_active":"2024-04-22T06:32:19.294233+0000","last_peered":"2024-04-22T06:32:19.294233+0000","last_clean":"2024-04-22T06:32:19.294233+0000","last_became_active":"2024-04-22T06:31:37.856994+0000","last_became_peered":"2024-04-22T06:31:37.856994+0000","last_unstale":"2024-04-22T06:32:19.294233+0000","last_undegraded":"2024-04-22T06:32:19.294233+0000","last_fullsized":"2024-04-22T06:32:19.294233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:47:53.098825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967320+0000","last_change":"2024-04-22T06:31:37.857338+0000","last_active":"2024-04-22T06:32:18.967320+0000","last_peered":"2024-04-22T06:32:18.967320+0000","last_clean":"2024-04-22T06:32:18.967320+0000","last_became_active":"2024-04-22T06:31:37.857039+0000","last_became_peered":"2024-04-22T06:31:37.857039+0000","last_unstale":"2024-04-22T06:32:18.967320+0000","last_undegraded":"2024-04-22T06:32:18.967320+0000","last_fullsized":"2024-04-22T06:32:18.967320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.926075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294281+0000","last_change":"2024-04-22T06:31:37.847477+0000","last_active":"2024-04-22T06:32:19.294281+0000","last_peered":"2024-04-22T06:32:19.294281+0000","last_clean":"2024-04-22T06:32:19.294281+0000","last_became_active":"2024-04-22T06:31:37.846902+0000","last_became_peered":"2024-04-22T06:31:37.846902+0000","last_unstale":"2024-04-22T06:32:19.294281+0000","last_undegraded":"2024-04-22T06:32:19.294281+0000","last_fullsized":"2024-04-22T06:32:19.294281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:15:19.632556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.967670+0000","last_change":"2024-04-22T06:31:37.849123+0000","last_active":"2024-04-22T06:32:18.967670+0000","last_peered":"2024-04-22T06:32:18.967670+0000","last_clean":"2024-04-22T06:32:18.967670+0000","last_became_active":"2024-04-22T06:31:37.848785+0000","last_became_peered":"2024-04-22T06:31:37.848785+0000","last_unstale":"2024-04-22T06:32:18.967670+0000","last_undegraded":"2024-04-22T06:32:18.967670+0000","last_fullsized":"2024-04-22T06:32:18.967670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:39:27.177292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.981210+0000","last_change":"2024-04-22T06:31:37.840735+0000","last_active":"2024-04-22T06:32:18.981210+0000","last_peered":"2024-04-22T06:32:18.981210+0000","last_clean":"2024-04-22T06:32:18.981210+0000","last_became_active":"2024-04-22T06:31:37.840480+0000","last_became_peered":"2024-04-22T06:31:37.840480+0000","last_unstale":"2024-04-22T06:32:18.981210+0000","last_undegraded":"2024-04-22T06:32:18.981210+0000","last_fullsized":"2024-04-22T06:32:18.981210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:02:02.771706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:18.969561+0000","last_change":"2024-04-22T06:31:37.845420+0000","last_active":"2024-04-22T06:32:18.969561+0000","last_peered":"2024-04-22T06:32:18.969561+0000","last_clean":"2024-04-22T06:32:18.969561+0000","last_became_active":"2024-04-22T06:31:37.845152+0000","last_became_peered":"2024-04-22T06:31:37.845152+0000","last_unstale":"2024-04-22T06:32:18.969561+0000","last_undegraded":"2024-04-22T06:32:18.969561+0000","last_fullsized":"2024-04-22T06:32:18.969561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:14:24.576999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-22T06:32:19.294826+0000","last_change":"2024-04-22T06:31:37.849079+0000","last_active":"2024-04-22T06:32:19.294826+0000","last_peered":"2024-04-22T06:32:19.294826+0000","last_clean":"2024-04-22T06:32:19.294826+0000","last_became_active":"2024-04-22T06:31:37.846970+0000","last_became_peered":"2024-04-22T06:31:37.846970+0000","last_unstale":"2024-04-22T06:32:19.294826+0000","last_undegraded":"2024-04-22T06:32:19.294826+0000","last_fullsized":"2024-04-22T06:32:19.294826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T06:31:36.814790+0000","last_clean_scrub_stamp":"2024-04-22T06:31:36.814790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:11:04.342153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45811,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":244,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":91622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":153347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":153692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":116575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":115893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":705603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":39331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":38986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T06:35:02.547 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T06:35:02.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.579+0000 7fc3cf450640 1 Processor -- start 2024-04-22T06:35:02.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.579+0000 7fc3cf450640 1 -- start start 2024-04-22T06:35:02.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cf450640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8ea0 0x7fc3c80c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cf450640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc3c80c8950 0x7fc3c815b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cf450640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c80c41b0 con 0x7fc3c80ca3a0 2024-04-22T06:35:02.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cf450640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c815b850 con 0x7fc3c80c8950 2024-04-22T06:35:02.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cf450640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c80c2ac0 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cd9ed640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc3c80c8950 0x7fc3c815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cc9eb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc3c80ca3a0 0x7fc3c80c81f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39860/0 (socket says 172.21.15.113:39860) 2024-04-22T06:35:02.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cc9eb640 1 -- 172.21.15.113:0/2512429911 learned_addr learned my addr 172.21.15.113:0/2512429911 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:02.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cd1ec640 1 --2- 172.21.15.113:0/2512429911 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8ea0 0x7fc3c80c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cd9ed640 1 -- 172.21.15.113:0/2512429911 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8ea0 msgr2=0x7fc3c80c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cd9ed640 1 --2- 172.21.15.113:0/2512429911 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8ea0 0x7fc3c80c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cd9ed640 1 -- 172.21.15.113:0/2512429911 >> v1:172.21.15.113:6789/0 conn(0x7fc3c80ca3a0 legacy=0x7fc3c80c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.580+0000 7fc3cd9ed640 1 -- 172.21.15.113:0/2512429911 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c80b2380 con 0x7fc3c80c8950 2024-04-22T06:35:02.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.581+0000 7fc3cd9ed640 1 --2- 172.21.15.113:0/2512429911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8950 0x7fc3c815b310 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009d90 tx=0x7fc3c002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719447493558b2d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.581+0000 7fc3c7fff640 1 -- 172.21.15.113:0/2512429911 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0039070 con 0x7fc3c80c8950 2024-04-22T06:35:02.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.581+0000 7fc3c7fff640 1 -- 172.21.15.113:0/2512429911 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c002cc50 con 0x7fc3c80c8950 2024-04-22T06:35:02.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.581+0000 7fc3c7fff640 1 -- 172.21.15.113:0/2512429911 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0034440 con 0x7fc3c80c8950 2024-04-22T06:35:02.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.582+0000 7fc3cf450640 1 -- 172.21.15.113:0/2512429911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8950 msgr2=0x7fc3c815b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.582+0000 7fc3cf450640 1 --2- 172.21.15.113:0/2512429911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8950 0x7fc3c815b310 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009d90 tx=0x7fc3c002bea0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.582+0000 7fc3cf450640 1 -- 172.21.15.113:0/2512429911 shutdown_connections 2024-04-22T06:35:02.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.582+0000 7fc3cf450640 1 --2- 172.21.15.113:0/2512429911 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8950 0x7fc3c815b310 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.582+0000 7fc3cf450640 1 --2- 172.21.15.113:0/2512429911 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8ea0 0x7fc3c80c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.582+0000 7fc3cf450640 1 -- 172.21.15.113:0/2512429911 >> 172.21.15.113:0/2512429911 conn(0x7fc3c806f5f0 msgr2=0x7fc3c806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.582+0000 7fc3cf450640 1 -- 172.21.15.113:0/2512429911 shutdown_connections 2024-04-22T06:35:02.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.582+0000 7fc3cf450640 1 -- 172.21.15.113:0/2512429911 wait complete. 2024-04-22T06:35:02.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.583+0000 7fc3cf450640 1 Processor -- start 2024-04-22T06:35:02.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.583+0000 7fc3cf450640 1 -- start start 2024-04-22T06:35:02.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cf450640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8950 0x7fc3c80727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cf450640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8ea0 0x7fc3c80cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cf450640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3c80ca3a0 0x7fc3c80cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cf450640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c80c7f10 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cf450640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c80c79e0 con 0x7fc3c80ca3a0 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cf450640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c80c9f10 con 0x7fc3c80c8950 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8ea0 0x7fc3c80cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8ea0 0x7fc3c80cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49766/0 (socket says 172.21.15.113:49766) 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 -- 172.21.15.113:0/1846753746 learned_addr learned my addr 172.21.15.113:0/1846753746 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cd1ec640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8950 0x7fc3c80727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cd9ed640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3c80ca3a0 0x7fc3c80cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 -- 172.21.15.113:0/1846753746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8950 msgr2=0x7fc3c80727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8950 0x7fc3c80727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 -- 172.21.15.113:0/1846753746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3c80ca3a0 msgr2=0x7fc3c80cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3c80ca3a0 0x7fc3c80cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 -- 172.21.15.113:0/1846753746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c8073bd0 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.584+0000 7fc3cc9eb640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8ea0 0x7fc3c80cbe70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c3c0 tx=0x7fc3bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.585+0000 7fc3c5ffb640 1 -- 172.21.15.113:0/1846753746 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc017070 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.585+0000 7fc3c5ffb640 1 -- 172.21.15.113:0/1846753746 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3bc005ce0 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.585+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c8073eb0 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.585+0000 7fc3c5ffb640 1 -- 172.21.15.113:0/1846753746 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0072d0 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.585+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c80cb670 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.586+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c8068f50 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.586+0000 7fc3c5ffb640 1 -- 172.21.15.113:0/1846753746 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3bc01a070 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.586+0000 7fc3c5ffb640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3b406c920 0x7fc3b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.587+0000 7fc3c5ffb640 1 -- 172.21.15.113:0/1846753746 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc3bc08b200 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.587+0000 7fc3cd1ec640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3b406c920 0x7fc3b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.587+0000 7fc3cd1ec640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3b406c920 0x7fc3b406ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009b40 tx=0x7fc3b8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.592+0000 7fc3c5ffb640 1 -- 172.21.15.113:0/1846753746 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3bc058b50 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.678+0000 7f1e00f84640 1 Processor -- start 2024-04-22T06:35:02.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.678+0000 7f1e00f84640 1 -- start start 2024-04-22T06:35:02.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1e00f84640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1e00f84640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dfc075bc0 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1e00f84640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dfc075040 con 0x7f1dfc153040 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1e00f84640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc074df0 con 0x7f1dfc153420 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1df3fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1dfc0c7f80 0x7f1dfc159320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39874/0 (socket says 172.21.15.113:39874) 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1df3fff640 1 -- 172.21.15.113:0/1093246154 learned_addr learned my addr 172.21.15.113:0/1093246154 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1dfad9d640 1 --2- 172.21.15.113:0/1093246154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1df9d9b640 1 -- 172.21.15.113:0/1093246154 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173503757 0 0) 0x7f1dfc075bc0 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1df9d9b640 1 -- 172.21.15.113:0/1093246154 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de8003520 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1df9d9b640 1 -- 172.21.15.113:0/1093246154 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962080026 0 0) 0x7f1dfc075040 con 0x7f1dfc153040 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1df9d9b640 1 -- 172.21.15.113:0/1093246154 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dfc075bc0 con 0x7f1dfc153040 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1dfad9d640 1 -- 172.21.15.113:0/1093246154 >> v1:172.21.15.145:6789/0 conn(0x7f1dfc153040 legacy=0x7f1dfc0ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1dfad9d640 1 -- 172.21.15.113:0/1093246154 >> v1:172.21.15.113:6789/0 conn(0x7f1dfc0c7f80 legacy=0x7f1dfc159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.679+0000 7f1dfad9d640 1 -- 172.21.15.113:0/1093246154 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc075320 con 0x7f1dfc153420 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.680+0000 7f1dfad9d640 1 --2- 172.21.15.113:0/1093246154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc0707c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009dc0 tx=0x7f1df402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ec081a606259d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.680+0000 7f1df9d9b640 1 -- 172.21.15.113:0/1093246154 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4039070 con 0x7f1dfc153420 2024-04-22T06:35:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.680+0000 7f1df9d9b640 1 -- 172.21.15.113:0/1093246154 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df402ccd0 con 0x7f1dfc153420 2024-04-22T06:35:02.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.680+0000 7f1df9d9b640 1 -- 172.21.15.113:0/1093246154 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4034660 con 0x7f1dfc153420 2024-04-22T06:35:02.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.681+0000 7f1e00f84640 1 -- 172.21.15.113:0/1093246154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 msgr2=0x7f1dfc0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.681+0000 7f1e00f84640 1 --2- 172.21.15.113:0/1093246154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc0707c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009dc0 tx=0x7f1df402bf20 comp rx=0 tx=0).stop 2024-04-22T06:35:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.681+0000 7f1e00f84640 1 -- 172.21.15.113:0/1093246154 shutdown_connections 2024-04-22T06:35:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.681+0000 7f1e00f84640 1 --2- 172.21.15.113:0/1093246154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc0707c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.681+0000 7f1e00f84640 1 -- 172.21.15.113:0/1093246154 >> 172.21.15.113:0/1093246154 conn(0x7f1dfc06bd10 msgr2=0x7f1dfc06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.681+0000 7f1e00f84640 1 -- 172.21.15.113:0/1093246154 shutdown_connections 2024-04-22T06:35:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.681+0000 7f1e00f84640 1 -- 172.21.15.113:0/1093246154 wait complete. 2024-04-22T06:35:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.682+0000 7f1e00f84640 1 Processor -- start 2024-04-22T06:35:02.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.682+0000 7f1e00f84640 1 -- start start 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1e00f84640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1dfc0c7f80 0x7f1dfc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1e00f84640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1dfc153040 0x7f1dfc157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1e00f84640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1e00f84640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0c5500 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1e00f84640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0758e0 con 0x7f1dfc153040 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1e00f84640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc0c5680 con 0x7f1dfc153420 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfa59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1dfc0c7f80 0x7f1dfc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfa59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1dfc0c7f80 0x7f1dfc0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49778/0 (socket says 172.21.15.113:49778) 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfa59c640 1 -- 172.21.15.113:0/4027815387 learned_addr learned my addr 172.21.15.113:0/4027815387 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1df3fff640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1dfc153040 0x7f1dfc157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfad9d640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfa59c640 1 -- 172.21.15.113:0/4027815387 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 msgr2=0x7f1dfc146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfa59c640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfa59c640 1 -- 172.21.15.113:0/4027815387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1dfc153040 msgr2=0x7f1dfc157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfa59c640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1dfc153040 0x7f1dfc157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.683+0000 7f1dfa59c640 1 -- 172.21.15.113:0/4027815387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc157a30 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.684+0000 7f1dfa59c640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1dfc0c7f80 0x7f1dfc0ca6b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00c500 tx=0x7f1dec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.684+0000 7f1df2ffd640 1 -- 172.21.15.113:0/4027815387 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0052d0 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.684+0000 7f1df2ffd640 1 -- 172.21.15.113:0/4027815387 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dec005490 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.684+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc1f4050 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.684+0000 7f1df2ffd640 1 -- 172.21.15.113:0/4027815387 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec012870 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.684+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1f4610 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.685+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc068e40 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.685+0000 7f1df2ffd640 1 -- 172.21.15.113:0/4027815387 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1dec012a10 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.686+0000 7f1df2ffd640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1ddc06c920 0x7f1ddc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.686+0000 7f1df2ffd640 1 -- 172.21.15.113:0/4027815387 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1dec08baa0 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.686+0000 7f1df3fff640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1ddc06c920 0x7f1ddc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.686+0000 7f1df3fff640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1ddc06c920 0x7f1ddc06ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc15d3a0 tx=0x7f1de4007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.690+0000 7f1df2ffd640 1 -- 172.21.15.113:0/4027815387 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1dec059490 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.777+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc3c815a030 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.777+0000 7fc3c5ffb640 1 -- 172.21.15.113:0/1846753746 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fc3bc05ce50 con 0x7fc3c80c8ea0 2024-04-22T06:35:02.776 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-04-22T06:35:02.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3b406c920 msgr2=0x7fc3b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3b406c920 0x7fc3b406ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009b40 tx=0x7fc3b8009190 comp rx=0 tx=0).stop 2024-04-22T06:35:02.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8ea0 msgr2=0x7fc3c80cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8ea0 0x7fc3c80cbe70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c3c0 tx=0x7fc3bc00c880 comp rx=0 tx=0).stop 2024-04-22T06:35:02.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 shutdown_connections 2024-04-22T06:35:02.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3c80ca3a0 0x7fc3c80cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fc3b406c920 0x7fc3b406ede0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3c80c8ea0 0x7fc3c80cbe70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 --2- 172.21.15.113:0/1846753746 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc3c80c8950 0x7fc3c80727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 >> 172.21.15.113:0/1846753746 conn(0x7fc3c806f5f0 msgr2=0x7fc3c815a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 shutdown_connections 2024-04-22T06:35:02.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.779+0000 7fc3cf450640 1 -- 172.21.15.113:0/1846753746 wait complete. 2024-04-22T06:35:02.790 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T06:35:02.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.875+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dfc075040 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.876+0000 7f1df2ffd640 1 -- 172.21.15.113:0/4027815387 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18884 (secure 0 0 0) 0x7f1dec05d790 con 0x7f1dfc0c7f80 2024-04-22T06:35:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-04-22T06:35:02.876 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":26,"fsid":"3b8618c1-770c-4da4-9414-78b2efafbd55","created":"2024-04-22T06:31:12.905592+0000","modified":"2024-04-22T06:32:18.958775+0000","last_up_change":"2024-04-22T06:31:23.462673+0000","last_in_change":"2024-04-22T06:31:15.101467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T06:31:24.983891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T06:31:35.014748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T06:31:36.130266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-22T06:31:39.850561+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b89c1d-e9bd-43b2-9f9d-f1d4c6c2ee4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6801","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6803","nonce":3692586623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6805","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6807","nonce":3692586623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6815","nonce":3692586623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":3692586623},{"type":"v1","addr":"172.21.15.113:6811","nonce":3692586623}]},"public_addr":"172.21.15.113:6803/3692586623","cluster_addr":"172.21.15.113:6807/3692586623","heartbeat_back_addr":"172.21.15.113:6815/3692586623","heartbeat_front_addr":"172.21.15.113:6811/3692586623","state":["exists","up"]},{"osd":1,"uuid":"8707a934-6ab7-40cf-973d-622d2ff5a1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6802","nonce":2620218774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6806","nonce":2620218774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6814","nonce":2620218774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":2620218774},{"type":"v1","addr":"172.21.15.113:6810","nonce":2620218774}]},"public_addr":"172.21.15.113:6802/2620218774","cluster_addr":"172.21.15.113:6806/2620218774","heartbeat_back_addr":"172.21.15.113:6814/2620218774","heartbeat_front_addr":"172.21.15.113:6810/2620218774","state":["exists","up"]},{"osd":2,"uuid":"e5330893-6259-4582-a7cf-d1a53f31dc35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6819","nonce":3529664663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6823","nonce":3529664663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6829","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6831","nonce":3529664663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6825","nonce":3529664663},{"type":"v1","addr":"172.21.15.113:6827","nonce":3529664663}]},"public_addr":"172.21.15.113:6819/3529664663","cluster_addr":"172.21.15.113:6823/3529664663","heartbeat_back_addr":"172.21.15.113:6831/3529664663","heartbeat_front_addr":"172.21.15.113:6827/3529664663","state":["exists","up"]},{"osd":3,"uuid":"e45d909c-200e-4bd0-9b5a-7ffc9956d48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6818","nonce":1451172414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6822","nonce":1451172414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6830","nonce":1451172414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":1451172414},{"type":"v1","addr":"172.21.15.113:6826","nonce":1451172414}]},"public_addr":"172.21.15.113:6818/1451172414","cluster_addr":"172.21.15.113:6822/1451172414","heartbeat_back_addr":"172.21.15.113:6830/1451172414","heartbeat_front_addr":"172.21.15.113:6826/1451172414","state":["exists","up"]},{"osd":4,"uuid":"82a62abb-7b4e-4250-a570-a57f891c8eab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6801","nonce":1083398722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6805","nonce":1083398722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6811","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6813","nonce":1083398722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6807","nonce":1083398722},{"type":"v1","addr":"172.21.15.145:6809","nonce":1083398722}]},"public_addr":"172.21.15.145:6801/1083398722","cluster_addr":"172.21.15.145:6805/1083398722","heartbeat_back_addr":"172.21.15.145:6813/1083398722","heartbeat_front_addr":"172.21.15.145:6809/1083398722","state":["exists","up"]},{"osd":5,"uuid":"0f5a7cbb-2f26-405d-b09a-275fc05a262c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6804","nonce":294884846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6808","nonce":294884846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6815","nonce":294884846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":294884846},{"type":"v1","addr":"172.21.15.145:6812","nonce":294884846}]},"public_addr":"172.21.15.145:6804/294884846","cluster_addr":"172.21.15.145:6808/294884846","heartbeat_back_addr":"172.21.15.145:6815/294884846","heartbeat_front_addr":"172.21.15.145:6812/294884846","state":["exists","up"]},{"osd":6,"uuid":"c607e613-01ff-4908-a157-3f87c5bea33b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6817","nonce":289848006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6819","nonce":289848006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6823","nonce":289848006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":289848006},{"type":"v1","addr":"172.21.15.145:6821","nonce":289848006}]},"public_addr":"172.21.15.145:6817/289848006","cluster_addr":"172.21.15.145:6819/289848006","heartbeat_back_addr":"172.21.15.145:6823/289848006","heartbeat_front_addr":"172.21.15.145:6821/289848006","state":["exists","up"]},{"osd":7,"uuid":"3c031c2b-cf7e-48ad-957c-c709ad95c360","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6825","nonce":1218898013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6827","nonce":1218898013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6831","nonce":1218898013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1218898013},{"type":"v1","addr":"172.21.15.145:6829","nonce":1218898013}]},"public_addr":"172.21.15.145:6825/1218898013","cluster_addr":"172.21.15.145:6827/1218898013","heartbeat_back_addr":"172.21.15.145:6831/1218898013","heartbeat_front_addr":"172.21.15.145:6829/1218898013","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.237605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.302146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.320685+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.273197+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.233789+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.256089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T06:31:20.192662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T06:35:02.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.878+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1ddc06c920 msgr2=0x7f1ddc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1ddc06c920 0x7f1ddc06ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc15d3a0 tx=0x7f1de4007d30 comp rx=0 tx=0).stop 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1dfc0c7f80 msgr2=0x7f1dfc0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1dfc0c7f80 0x7f1dfc0ca6b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00c500 tx=0x7f1dec00c9c0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 shutdown_connections 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1dfc153420 0x7f1dfc146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1dfc153040 0x7f1dfc157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f1ddc06c920 0x7f1ddc06ede0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 --2- 172.21.15.113:0/4027815387 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1dfc0c7f80 0x7f1dfc0ca6b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 >> 172.21.15.113:0/4027815387 conn(0x7f1dfc06bd10 msgr2=0x7f1dfc0c9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 shutdown_connections 2024-04-22T06:35:02.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.879+0000 7f1e00f84640 1 -- 172.21.15.113:0/4027815387 wait complete. 2024-04-22T06:35:02.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.930+0000 7f8fffd2e640 1 Processor -- start 2024-04-22T06:35:02.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.931+0000 7f8fffd2e640 1 -- start start 2024-04-22T06:35:02.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.931+0000 7f8fffd2e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 0x7f8ff8163670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.931+0000 7f8fffd2e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff815b610 con 0x7f8ff8151ea0 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8fffd2e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff806e6f0 con 0x7f8ff8152280 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8fffd2e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff806f300 con 0x7f8ff80c3cb0 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffdaca640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8ff8151ea0 0x7f8ff80c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39878/0 (socket says 172.21.15.113:39878) 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffdaca640 1 -- 172.21.15.113:0/2601728997 learned_addr learned my addr 172.21.15.113:0/2601728997 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffe2cb640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 0x7f8ff8163670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005779686 0 0) 0x7f8ff815b610 con 0x7f8ff8151ea0 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fe4003520 con 0x7f8ff8151ea0 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204548768 0 0) 0x7f8ff806e6f0 con 0x7f8ff8152280 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ff815b610 con 0x7f8ff8152280 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 218458966 0 0) 0x7f8fe4003520 con 0x7f8ff8151ea0 2024-04-22T06:35:02.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 msgr2=0x7f8ff8163670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 0x7f8ff8163670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 >> v1:172.21.15.145:6789/0 conn(0x7f8ff8152280 legacy=0x7f8ff81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff806e9d0 con 0x7f8ff8151ea0 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f8ff4001670 con 0x7f8ff8151ea0 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 >> v1:172.21.15.113:6789/0 conn(0x7f8ff8151ea0 legacy=0x7f8ff80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8fe4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fe4004800 0x7f8fe4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 0x7f8fe40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff806f300 con 0x7f8fe4003b70 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe400ba70 con 0x7f8fe4004800 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe400bc70 con 0x7f8ff80c3cb0 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffdaca640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8fe4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffd2c9640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fe4004800 0x7f8fe4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.932+0000 7f8ffe2cb640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 0x7f8fe40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffdaca640 1 -- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 msgr2=0x7f8fe40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffdaca640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 0x7f8fe40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffdaca640 1 -- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fe4004800 msgr2=0x7f8fe4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffdaca640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fe4004800 0x7f8fe4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffdaca640 1 -- 172.21.15.113:0/2601728997 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe4003520 con 0x7f8fe4003b70 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffe2cb640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff80c3cb0 0x7f8fe40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffdaca640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8fe4003f70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4001eb0 tx=0x7f8fe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7637ab0aa8d7797 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4007ce0 con 0x7f8fe4003b70 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4030070 con 0x7f8fe4003b70 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.933+0000 7f8ffcac8640 1 -- 172.21.15.113:0/2601728997 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4005d10 con 0x7f8fe4003b70 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.934+0000 7f8fffd2e640 1 -- 172.21.15.113:0/2601728997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 msgr2=0x7f8fe4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.934+0000 7f8fffd2e640 1 --2- 172.21.15.113:0/2601728997 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8fe4003f70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4001eb0 tx=0x7f8fe4005830 comp rx=0 tx=0).stop 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.934+0000 7f8ffe2cb640 1 -- 172.21.15.113:0/2601728997 reap_dead start 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.934+0000 7f8fffd2e640 1 -- 172.21.15.113:0/2601728997 shutdown_connections 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.934+0000 7f8fffd2e640 1 -- 172.21.15.113:0/2601728997 >> 172.21.15.113:0/2601728997 conn(0x7f8ff80c8f00 msgr2=0x7f8ff80c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.934+0000 7f8fffd2e640 1 -- 172.21.15.113:0/2601728997 shutdown_connections 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.934+0000 7f8fffd2e640 1 -- 172.21.15.113:0/2601728997 wait complete. 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.935+0000 7f8fffd2e640 1 Processor -- start 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.935+0000 7f8fffd2e640 1 -- start start 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8fffd2e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8ff81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8fffd2e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ff81554c0 0x7f8ff8157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8fffd2e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff81f4be0 0x7f8ff81f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8fffd2e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff80c8cb0 con 0x7f8fe4003b70 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8fffd2e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff806ef90 con 0x7f8ff81554c0 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8fffd2e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff815b2d0 con 0x7f8ff81f4be0 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffdaca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8ff81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffdaca640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8ff81581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49804/0 (socket says 172.21.15.113:49804) 2024-04-22T06:35:02.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffdaca640 1 -- 172.21.15.113:0/3143639308 learned_addr learned my addr 172.21.15.113:0/3143639308 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffd2c9640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ff81554c0 0x7f8ff8157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffe2cb640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff81f4be0 0x7f8ff81f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffdaca640 1 -- 172.21.15.113:0/3143639308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff81f4be0 msgr2=0x7f8ff81f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffdaca640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff81f4be0 0x7f8ff81f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffdaca640 1 -- 172.21.15.113:0/3143639308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ff81554c0 msgr2=0x7f8ff8157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffdaca640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ff81554c0 0x7f8ff8157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.936+0000 7f8ffdaca640 1 -- 172.21.15.113:0/3143639308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff81f55a0 con 0x7f8fe4003b70 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.937+0000 7f8ffdaca640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8ff81581f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c300 tx=0x7f8ff806f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.937+0000 7f8fee7fc640 1 -- 172.21.15.113:0/3143639308 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4007ce0 con 0x7f8fe4003b70 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.937+0000 7f8fee7fc640 1 -- 172.21.15.113:0/3143639308 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4004bf0 con 0x7f8fe4003b70 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.937+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff81f1430 con 0x7f8fe4003b70 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.937+0000 7f8fee7fc640 1 -- 172.21.15.113:0/3143639308 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4001bf0 con 0x7f8fe4003b70 2024-04-22T06:35:02.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.937+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff81f19f0 con 0x7f8fe4003b70 2024-04-22T06:35:02.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.938+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff814f6c0 con 0x7f8fe4003b70 2024-04-22T06:35:02.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.938+0000 7f8fee7fc640 1 -- 172.21.15.113:0/3143639308 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ff4007070 con 0x7f8fe4003b70 2024-04-22T06:35:02.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.938+0000 7f8fee7fc640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8fdc06c890 0x7f8fdc06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:02.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.939+0000 7f8ffd2c9640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8fdc06c890 0x7f8fdc06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:02.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.939+0000 7f8fee7fc640 1 -- 172.21.15.113:0/3143639308 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8ff40ad560 con 0x7f8fe4003b70 2024-04-22T06:35:02.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.939+0000 7f8ffd2c9640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8fdc06c890 0x7f8fdc06ed50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8ff81e4370 tx=0x7f8fe8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:02.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:02.943+0000 7f8fee7fc640 1 -- 172.21.15.113:0/3143639308 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ff814f6c0 con 0x7f8fe4003b70 2024-04-22T06:35:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.133+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8ff8068e40 con 0x7f8fe4003b70 2024-04-22T06:35:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.133+0000 7f8fee7fc640 1 -- 172.21.15.113:0/3143639308 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f8ff81f55a0 con 0x7f8fe4003b70 2024-04-22T06:35:03.133 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-04-22T06:35:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8fdc06c890 msgr2=0x7f8fdc06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8fdc06c890 0x7f8fdc06ed50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8ff81e4370 tx=0x7f8fe8009040 comp rx=0 tx=0).stop 2024-04-22T06:35:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 msgr2=0x7f8ff81581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8ff81581f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c300 tx=0x7f8ff806f270 comp rx=0 tx=0).stop 2024-04-22T06:35:03.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 shutdown_connections 2024-04-22T06:35:03.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8ff81f4be0 0x7f8ff81f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:03.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ff81554c0 0x7f8ff8157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:03.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f8fdc06c890 0x7f8fdc06ed50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:03.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 --2- 172.21.15.113:0/3143639308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8fe4003b70 0x7f8ff81581f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:03.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 >> 172.21.15.113:0/3143639308 conn(0x7f8ff80c8f00 msgr2=0x7f8ff8150140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:03.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 shutdown_connections 2024-04-22T06:35:03.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.135+0000 7f8fffd2e640 1 -- 172.21.15.113:0/3143639308 wait complete. 2024-04-22T06:35:03.146 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/cephfs/fuse_mount.py", line 392, in umount_wait if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/cephfs/mount.py", line 196, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType 2024-04-22T06:35:03.890 INFO:tasks.ceph:Scrubbing osd.0 2024-04-22T06:35:03.890 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-22T06:35:03.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.996+0000 7f9c8af8f640 1 Processor -- start 2024-04-22T06:35:03.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.996+0000 7f9c8af8f640 1 -- start start 2024-04-22T06:35:03.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.996+0000 7f9c8af8f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9c8406b920 0x7f9c8406bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:03.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.996+0000 7f9c8af8f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8415ea80 con 0x7f9c8415b740 2024-04-22T06:35:03.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.996+0000 7f9c8af8f640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8415ed60 con 0x7f9c840cb750 2024-04-22T06:35:03.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.996+0000 7f9c8af8f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9c8415f040 con 0x7f9c8406b920 2024-04-22T06:35:03.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.997+0000 7f9c8952c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9c8406b920 0x7f9c8406bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:03.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.997+0000 7f9c83fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9c8415b740 0x7f9c8415bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39892/0 (socket says 172.21.15.113:39892) 2024-04-22T06:35:03.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.997+0000 7f9c8952c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9c8406b920 0x7f9c8406bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49816/0 (socket says 172.21.15.113:49816) 2024-04-22T06:35:03.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.997+0000 7f9c83fff640 1 -- 172.21.15.113:0/1586200694 learned_addr learned my addr 172.21.15.113:0/1586200694 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:03.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.997+0000 7f9c8952c640 1 -- 172.21.15.113:0/1586200694 >> v1:172.21.15.145:6789/0 conn(0x7f9c840cb750 legacy=0x7f9c84071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:03.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.997+0000 7f9c8952c640 1 -- 172.21.15.113:0/1586200694 >> v1:172.21.15.113:6789/0 conn(0x7f9c8415b740 legacy=0x7f9c8415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:03.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.997+0000 7f9c8952c640 1 -- 172.21.15.113:0/1586200694 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8415f320 con 0x7f9c8406b920 2024-04-22T06:35:03.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.997+0000 7f9c837fe640 1 -- 172.21.15.113:0/1586200694 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730474314 0 0) 0x7f9c8415ea80 con 0x7f9c8415b740 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c8952c640 1 --2- 172.21.15.113:0/1586200694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8406b920 0x7f9c8406bd30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009d90 tx=0x7f9c7c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1c7b79b36d8af1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c837fe640 1 -- 172.21.15.113:0/1586200694 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c039070 con 0x7f9c8406b920 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c837fe640 1 -- 172.21.15.113:0/1586200694 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c02cd80 con 0x7f9c8406b920 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c837fe640 1 -- 172.21.15.113:0/1586200694 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c034660 con 0x7f9c8406b920 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c8af8f640 1 -- 172.21.15.113:0/1586200694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8406b920 msgr2=0x7f9c8406bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c8af8f640 1 --2- 172.21.15.113:0/1586200694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8406b920 0x7f9c8406bd30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009d90 tx=0x7f9c7c02bfd0 comp rx=0 tx=0).stop 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c8af8f640 1 -- 172.21.15.113:0/1586200694 shutdown_connections 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c8af8f640 1 --2- 172.21.15.113:0/1586200694 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8406b920 0x7f9c8406bd30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c8af8f640 1 -- 172.21.15.113:0/1586200694 >> 172.21.15.113:0/1586200694 conn(0x7f9c84074d50 msgr2=0x7f9c84075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:03.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c8af8f640 1 -- 172.21.15.113:0/1586200694 shutdown_connections 2024-04-22T06:35:04.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.998+0000 7f9c8af8f640 1 -- 172.21.15.113:0/1586200694 wait complete. 2024-04-22T06:35:04.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.999+0000 7f9c8af8f640 1 Processor -- start 2024-04-22T06:35:04.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:03.999+0000 7f9c8af8f640 1 -- start start 2024-04-22T06:35:04.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8af8f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9c8406b920 0x7f9c841e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8af8f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9c840cb750 0x7f9c841f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8af8f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8415b740 0x7f9c840ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8af8f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8406c270 con 0x7f9c8415b740 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8af8f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9c84071c20 con 0x7f9c840cb750 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8af8f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8406c3f0 con 0x7f9c8406b920 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8952c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8415b740 0x7f9c840ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8952c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8415b740 0x7f9c840ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49830/0 (socket says 172.21.15.113:49830) 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.000+0000 7f9c8952c640 1 -- 172.21.15.113:0/3719735937 learned_addr learned my addr 172.21.15.113:0/3719735937 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c83fff640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9c840cb750 0x7f9c841f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c8952c640 1 -- 172.21.15.113:0/3719735937 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9c8406b920 msgr2=0x7f9c841e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c88d2b640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9c8406b920 0x7f9c841e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c8952c640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9c8406b920 0x7f9c841e7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c8952c640 1 -- 172.21.15.113:0/3719735937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9c840cb750 msgr2=0x7f9c841f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c8952c640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9c840cb750 0x7f9c841f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c8952c640 1 -- 172.21.15.113:0/3719735937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c841f43a0 con 0x7f9c8415b740 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c83fff640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9c840cb750 0x7f9c841f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:35:04.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c88d2b640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9c8406b920 0x7f9c841e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c8952c640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8415b740 0x7f9c840ced50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009d90 tx=0x7f9c7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c039050 con 0x7f9c8415b740 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c03a040 con 0x7f9c8415b740 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c841e4820 con 0x7f9c8415b740 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c03e610 con 0x7f9c8415b740 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.001+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c841f1c90 con 0x7f9c8415b740 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.002+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c841f4740 con 0x7f9c8415b740 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.002+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c7c047020 con 0x7f9c8415b740 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c817fa640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9c6806c8f0 0x7f9c6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9c7c0ae3b0 con 0x7f9c8415b740 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c88d2b640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9c6806c8f0 0x7f9c6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c817fa640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f9c68076300 0x7f9c680787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 --> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c7c02cd80 con 0x7f9c68076300 2024-04-22T06:35:04.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9c7c0b5050 con 0x7f9c8415b740 2024-04-22T06:35:04.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c83fff640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f9c68076300 0x7f9c680787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c88d2b640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9c6806c8f0 0x7f9c6806edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c78000f60 tx=0x7f9c78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.003+0000 7f9c83fff640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f9c68076300 0x7f9c680787a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.004+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 <== osd.0 v2:172.21.15.113:6801/3692586623 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c7c02cd80 con 0x7f9c68076300 2024-04-22T06:35:04.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.017+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 --> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9c84068f50 con 0x7f9c68076300 2024-04-22T06:35:04.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.017+0000 7f9c817fa640 1 -- 172.21.15.113:0/3719735937 <== osd.0 v2:172.21.15.113:6801/3692586623 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9c84068f50 con 0x7f9c68076300 2024-04-22T06:35:04.017 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:35:04.017 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T06:35:04.017 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:35:04.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f9c68076300 msgr2=0x7f9c680787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6801/3692586623,v1:172.21.15.113:6803/3692586623] conn(0x7f9c68076300 0x7f9c680787a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9c6806c8f0 msgr2=0x7f9c6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9c6806c8f0 0x7f9c6806edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c78000f60 tx=0x7f9c78009040 comp rx=0 tx=0).stop 2024-04-22T06:35:04.018 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8415b740 msgr2=0x7f9c840ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 --2- 172.21.15.113:0/3719735937 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c8415b740 0x7f9c840ced50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009d90 tx=0x7f9c7c004a40 comp rx=0 tx=0).stop 2024-04-22T06:35:04.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8952c640 1 -- 172.21.15.113:0/3719735937 reap_dead start 2024-04-22T06:35:04.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 shutdown_connections 2024-04-22T06:35:04.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 >> 172.21.15.113:0/3719735937 conn(0x7f9c84074d50 msgr2=0x7f9c840c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 shutdown_connections 2024-04-22T06:35:04.019 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.018+0000 7f9c8af8f640 1 -- 172.21.15.113:0/3719735937 wait complete. 2024-04-22T06:35:04.028 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-22T06:35:04.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.125+0000 7f660b954640 1 Processor -- start 2024-04-22T06:35:04.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.125+0000 7f660b954640 1 -- start start 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f660b954640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6604155460 0x7f660415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f660b954640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f660415f0d0 0x7f66040ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f660b954640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66040ceb40 0x7f66040739c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f660b954640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f66040c9ab0 con 0x7f660415f0d0 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f660b954640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f660415e700 con 0x7f6604155460 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f660b954640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f660415be80 con 0x7f66040ceb40 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f6608eef640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f660415f0d0 0x7f66040ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f6608eef640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f660415f0d0 0x7f66040ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49844/0 (socket says 172.21.15.113:49844) 2024-04-22T06:35:04.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f6608eef640 1 -- 172.21.15.113:0/878827385 learned_addr learned my addr 172.21.15.113:0/878827385 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f66096f0640 1 --2- 172.21.15.113:0/878827385 >> v2:172.21.15.145:3300/0 conn(0x7f6604155460 0x7f660415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.126+0000 7f6609ef1640 1 --2- 172.21.15.113:0/878827385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66040ceb40 0x7f66040739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.127+0000 7f6608eef640 1 -- 172.21.15.113:0/878827385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66040ceb40 msgr2=0x7f66040739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.127+0000 7f6608eef640 1 --2- 172.21.15.113:0/878827385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66040ceb40 0x7f66040739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.127+0000 7f6608eef640 1 -- 172.21.15.113:0/878827385 >> v2:172.21.15.145:3300/0 conn(0x7f6604155460 msgr2=0x7f660415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.127+0000 7f6608eef640 1 --2- 172.21.15.113:0/878827385 >> v2:172.21.15.145:3300/0 conn(0x7f6604155460 0x7f660415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.127+0000 7f6608eef640 1 -- 172.21.15.113:0/878827385 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660415b300 con 0x7f660415f0d0 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.127+0000 7f66096f0640 1 --2- 172.21.15.113:0/878827385 >> v2:172.21.15.145:3300/0 conn(0x7f6604155460 0x7f660415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:04.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.127+0000 7f6609ef1640 1 --2- 172.21.15.113:0/878827385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66040ceb40 0x7f66040739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:04.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.127+0000 7f6608eef640 1 --2- 172.21.15.113:0/878827385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f660415f0d0 0x7f66040ce600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f66040cb050 tx=0x7f65f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7bdbfb51630ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f6603fff640 1 -- 172.21.15.113:0/878827385 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f802e070 con 0x7f660415f0d0 2024-04-22T06:35:04.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f6603fff640 1 -- 172.21.15.113:0/878827385 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f8037070 con 0x7f660415f0d0 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f6603fff640 1 -- 172.21.15.113:0/878827385 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8031a00 con 0x7f660415f0d0 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 -- 172.21.15.113:0/878827385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f660415f0d0 msgr2=0x7f66040ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 --2- 172.21.15.113:0/878827385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f660415f0d0 0x7f66040ce600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f66040cb050 tx=0x7f65f802b880 comp rx=0 tx=0).stop 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 -- 172.21.15.113:0/878827385 shutdown_connections 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 --2- 172.21.15.113:0/878827385 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f66040ceb40 0x7f66040739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 --2- 172.21.15.113:0/878827385 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f660415f0d0 0x7f66040ce600 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 --2- 172.21.15.113:0/878827385 >> v2:172.21.15.145:3300/0 conn(0x7f6604155460 0x7f660415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 -- 172.21.15.113:0/878827385 >> 172.21.15.113:0/878827385 conn(0x7f6604074d50 msgr2=0x7f6604075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 -- 172.21.15.113:0/878827385 shutdown_connections 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.128+0000 7f660b954640 1 -- 172.21.15.113:0/878827385 wait complete. 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.129+0000 7f660b954640 1 Processor -- start 2024-04-22T06:35:04.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.129+0000 7f660b954640 1 -- start start 2024-04-22T06:35:04.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f660b954640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66040ceb40 0x7f6604152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f660b954640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6604155460 0x7f660415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f660b954640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f660415f0d0 0x7f6604153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f660b954640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f660415bba0 con 0x7f66040ceb40 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f660b954640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f660415b8c0 con 0x7f660415f0d0 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f660b954640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f660406c3c0 con 0x7f6604155460 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f66096f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66040ceb40 0x7f6604152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f66096f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66040ceb40 0x7f6604152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49852/0 (socket says 172.21.15.113:49852) 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f66096f0640 1 -- 172.21.15.113:0/1280535081 learned_addr learned my addr 172.21.15.113:0/1280535081 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f6609ef1640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f660415f0d0 0x7f6604153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f6608eef640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6604155460 0x7f660415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.132 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f66096f0640 1 -- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6604155460 msgr2=0x7f660415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f66096f0640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6604155460 0x7f660415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f66096f0640 1 -- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f660415f0d0 msgr2=0x7f6604153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f66096f0640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f660415f0d0 0x7f6604153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f66096f0640 1 -- 172.21.15.113:0/1280535081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66041f5060 con 0x7f66040ceb40 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f6608eef640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6604155460 0x7f660415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.130+0000 7f6609ef1640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f660415f0d0 0x7f6604153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.131+0000 7f66096f0640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66040ceb40 0x7f6604152530 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009fc0 tx=0x7f65fc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.131+0000 7f6601ffb640 1 -- 172.21.15.113:0/1280535081 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc01a070 con 0x7f66040ceb40 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.131+0000 7f6601ffb640 1 -- 172.21.15.113:0/1280535081 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65fc003bb0 con 0x7f66040ceb40 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.131+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6604150600 con 0x7f66040ceb40 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.131+0000 7f6601ffb640 1 -- 172.21.15.113:0/1280535081 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc004030 con 0x7f66040ceb40 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.131+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6604150ba0 con 0x7f66040ceb40 2024-04-22T06:35:04.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.132+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6604068e40 con 0x7f66040ceb40 2024-04-22T06:35:04.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.132+0000 7f6601ffb640 1 -- 172.21.15.113:0/1280535081 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65fc01d070 con 0x7f66040ceb40 2024-04-22T06:35:04.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.132+0000 7f6601ffb640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f65f006c8f0 0x7f65f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.133+0000 7f6608eef640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f65f006c8f0 0x7f65f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.133+0000 7f6601ffb640 1 -- 172.21.15.113:0/1280535081 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f65fc08c140 con 0x7f66040ceb40 2024-04-22T06:35:04.134 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.133+0000 7f6608eef640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f65f006c8f0 0x7f65f006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65f8036000 tx=0x7f65f803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.137+0000 7f6601ffb640 1 -- 172.21.15.113:0/1280535081 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65fc010070 con 0x7f66040ceb40 2024-04-22T06:35:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.313+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f6604074590 con 0x7f65f006c8f0 2024-04-22T06:35:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.313+0000 7f6601ffb640 1 -- 172.21.15.113:0/1280535081 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6604074590 con 0x7f65f006c8f0 2024-04-22T06:35:04.313 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 0 to deep-scrub 2024-04-22T06:35:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f65f006c8f0 msgr2=0x7f65f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f65f006c8f0 0x7f65f006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65f8036000 tx=0x7f65f803d040 comp rx=0 tx=0).stop 2024-04-22T06:35:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66040ceb40 msgr2=0x7f6604152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66040ceb40 0x7f6604152530 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009fc0 tx=0x7f65fc00d560 comp rx=0 tx=0).stop 2024-04-22T06:35:04.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 shutdown_connections 2024-04-22T06:35:04.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f660415f0d0 0x7f6604153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6604155460 0x7f660415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f65f006c8f0 0x7f65f006edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 --2- 172.21.15.113:0/1280535081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f66040ceb40 0x7f6604152530 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 >> 172.21.15.113:0/1280535081 conn(0x7f6604074d50 msgr2=0x7f660415a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 shutdown_connections 2024-04-22T06:35:04.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.316+0000 7f660b954640 1 -- 172.21.15.113:0/1280535081 wait complete. 2024-04-22T06:35:04.326 INFO:tasks.ceph:Scrubbing osd.1 2024-04-22T06:35:04.326 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-22T06:35:04.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.428+0000 7fcb78d3d640 1 Processor -- start 2024-04-22T06:35:04.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.428+0000 7fcb78d3d640 1 -- start start 2024-04-22T06:35:04.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb78d3d640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcb740c9610 0x7fcb74151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb78d3d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb74071fe0 con 0x7fcb740c83b0 2024-04-22T06:35:04.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb78d3d640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb740722c0 con 0x7fcb740c8790 2024-04-22T06:35:04.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb78d3d640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fcb740c9c30 con 0x7fcb740c9610 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb7259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcb740c83b0 0x7fcb7415be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39896/0 (socket says 172.21.15.113:39896) 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb7259c640 1 -- 172.21.15.113:0/3211437450 learned_addr learned my addr 172.21.15.113:0/3211437450 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702444803 0 0) 0x7fcb74071fe0 con 0x7fcb740c83b0 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb60003520 con 0x7fcb740c83b0 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb72d9d640 1 --2- 172.21.15.113:0/3211437450 >> v2:172.21.15.145:3300/0 conn(0x7fcb740c9610 0x7fcb74151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3174579129 0 0) 0x7fcb60003520 con 0x7fcb740c83b0 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 >> v2:172.21.15.145:3300/0 conn(0x7fcb740c9610 msgr2=0x7fcb74151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 --2- 172.21.15.113:0/3211437450 >> v2:172.21.15.145:3300/0 conn(0x7fcb740c9610 0x7fcb74151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 >> v1:172.21.15.145:6789/0 conn(0x7fcb740c8790 legacy=0x7fcb74158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb74158020 con 0x7fcb740c83b0 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7fcb64001670 con 0x7fcb740c83b0 2024-04-22T06:35:04.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 >> v1:172.21.15.113:6789/0 conn(0x7fcb740c83b0 legacy=0x7fcb7415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb600039b0 0x7fcb60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb60004800 0x7fcb60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb600051c0 0x7fcb6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6000c040 con 0x7fcb600051c0 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6000c1f0 con 0x7fcb600039b0 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.429+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6000c3f0 con 0x7fcb60004800 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb72d9d640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb600051c0 0x7fcb6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb7259c640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb600039b0 0x7fcb60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb6bfff640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb60004800 0x7fcb60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb72d9d640 1 -- 172.21.15.113:0/3211437450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb60004800 msgr2=0x7fcb60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb72d9d640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb60004800 0x7fcb60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb72d9d640 1 -- 172.21.15.113:0/3211437450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb600039b0 msgr2=0x7fcb60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb72d9d640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb600039b0 0x7fcb60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb72d9d640 1 -- 172.21.15.113:0/3211437450 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb60003520 con 0x7fcb600051c0 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.430+0000 7fcb72d9d640 1 -- 172.21.15.113:0/3211437450 reap_dead start 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb72d9d640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb600051c0 0x7fcb6000b9c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009fc0 tx=0x7fcb60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcedc92e4ada89 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c009c10 con 0x7fcb600051c0 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c02cc60 con 0x7fcb600051c0 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb71d9b640 1 -- 172.21.15.113:0/3211437450 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c003bd0 con 0x7fcb600051c0 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb78d3d640 1 -- 172.21.15.113:0/3211437450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb600051c0 msgr2=0x7fcb6000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb78d3d640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb600051c0 0x7fcb6000b9c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009fc0 tx=0x7fcb60005830 comp rx=0 tx=0).stop 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb78d3d640 1 -- 172.21.15.113:0/3211437450 shutdown_connections 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb78d3d640 1 --2- 172.21.15.113:0/3211437450 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb600051c0 0x7fcb6000b9c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb78d3d640 1 -- 172.21.15.113:0/3211437450 >> 172.21.15.113:0/3211437450 conn(0x7fcb74068120 msgr2=0x7fcb7406eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb78d3d640 1 -- 172.21.15.113:0/3211437450 shutdown_connections 2024-04-22T06:35:04.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.431+0000 7fcb78d3d640 1 -- 172.21.15.113:0/3211437450 wait complete. 2024-04-22T06:35:04.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb78d3d640 1 Processor -- start 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb78d3d640 1 -- start start 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb78d3d640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb600051c0 0x7fcb741f0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb78d3d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb741e2170 0x7fcb7414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb78d3d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb741e31c0 0x7fcb7414b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb78d3d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7fcb740c9eb0 con 0x7fcb741e31c0 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb78d3d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcb740725a0 con 0x7fcb741e2170 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb78d3d640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fcb740ca030 con 0x7fcb600051c0 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb72d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb741e31c0 0x7fcb7414b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb72d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb741e31c0 0x7fcb7414b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49868/0 (socket says 172.21.15.113:49868) 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb72d9d640 1 -- 172.21.15.113:0/2204951941 learned_addr learned my addr 172.21.15.113:0/2204951941 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:04.438 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb6bfff640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb741e2170 0x7fcb7414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.433+0000 7fcb7259c640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb600051c0 0x7fcb741f0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb72d9d640 1 -- 172.21.15.113:0/2204951941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb600051c0 msgr2=0x7fcb741f0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb72d9d640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcb600051c0 0x7fcb741f0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb72d9d640 1 -- 172.21.15.113:0/2204951941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb741e2170 msgr2=0x7fcb7414d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb72d9d640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcb741e2170 0x7fcb7414d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb72d9d640 1 -- 172.21.15.113:0/2204951941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7414ce00 con 0x7fcb741e31c0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb72d9d640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb741e31c0 0x7fcb7414b410 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c035d30 tx=0x7fcb6c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c035e90 con 0x7fcb741e31c0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c044070 con 0x7fcb741e31c0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb741e0df0 con 0x7fcb741e31c0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c003dc0 con 0x7fcb741e31c0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.434+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb741e13b0 con 0x7fcb741e31c0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.435+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb74068f50 con 0x7fcb741e31c0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.435+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb6c005d10 con 0x7fcb741e31c0 2024-04-22T06:35:04.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb6affd640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcb5406c8f0 0x7fcb5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fcb6c0ae5f0 con 0x7fcb741e31c0 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb7259c640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcb5406c8f0 0x7fcb5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb6affd640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fcb54076300 0x7fcb540787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 --> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb6c00df90 con 0x7fcb54076300 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcb6c0b5050 con 0x7fcb741e31c0 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb6bfff640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fcb54076300 0x7fcb540787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb7259c640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcb5406c8f0 0x7fcb5406edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb64001550 tx=0x7fcb640078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.436+0000 7fcb6bfff640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fcb54076300 0x7fcb540787a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.437+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 <== osd.1 v2:172.21.15.113:6800/2620218774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb6c00df90 con 0x7fcb54076300 2024-04-22T06:35:04.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.450+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 --> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcb740ca510 con 0x7fcb54076300 2024-04-22T06:35:04.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.450+0000 7fcb6affd640 1 -- 172.21.15.113:0/2204951941 <== osd.1 v2:172.21.15.113:6800/2620218774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcb740ca510 con 0x7fcb54076300 2024-04-22T06:35:04.450 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:35:04.450 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T06:35:04.450 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.450+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fcb54076300 msgr2=0x7fcb540787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.450+0000 7fcb78d3d640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6800/2620218774,v1:172.21.15.113:6802/2620218774] conn(0x7fcb54076300 0x7fcb540787a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcb5406c8f0 msgr2=0x7fcb5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb78d3d640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7fcb5406c8f0 0x7fcb5406edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb64001550 tx=0x7fcb640078f0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb741e31c0 msgr2=0x7fcb7414b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb78d3d640 1 --2- 172.21.15.113:0/2204951941 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb741e31c0 0x7fcb7414b410 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c035d30 tx=0x7fcb6c009750 comp rx=0 tx=0).stop 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb72d9d640 1 -- 172.21.15.113:0/2204951941 reap_dead start 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 shutdown_connections 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 >> 172.21.15.113:0/2204951941 conn(0x7fcb74068120 msgr2=0x7fcb74155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 shutdown_connections 2024-04-22T06:35:04.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.451+0000 7fcb78d3d640 1 -- 172.21.15.113:0/2204951941 wait complete. 2024-04-22T06:35:04.463 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-22T06:35:04.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.562+0000 7f0f2a2e0640 1 Processor -- start 2024-04-22T06:35:04.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.562+0000 7f0f2a2e0640 1 -- start start 2024-04-22T06:35:04.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.562+0000 7f0f2a2e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f24072c00 0x7f0f240c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.562+0000 7f0f2a2e0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0f24074380 0x7f0f241637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.562+0000 7f0f2a2e0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2415c850 con 0x7f0f240c8d00 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f2a2e0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f0f2415cb30 con 0x7f0f24074380 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f2a2e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2415ce10 con 0x7f0f24072c00 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f2887d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0f24074380 0x7f0f241637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f23fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0f240c8d00 0x7f0f240c7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39906/0 (socket says 172.21.15.113:39906) 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f23fff640 1 -- 172.21.15.113:0/4187215751 learned_addr learned my addr 172.21.15.113:0/4187215751 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f237fe640 1 --2- 172.21.15.113:0/4187215751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f24072c00 0x7f0f240c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f2887d640 1 -- 172.21.15.113:0/4187215751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f24072c00 msgr2=0x7f0f240c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f2887d640 1 --2- 172.21.15.113:0/4187215751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f24072c00 0x7f0f240c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f2887d640 1 -- 172.21.15.113:0/4187215751 >> v1:172.21.15.113:6789/0 conn(0x7f0f240c8d00 legacy=0x7f0f240c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.563+0000 7f0f2887d640 1 -- 172.21.15.113:0/4187215751 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2415d0f0 con 0x7f0f24074380 2024-04-22T06:35:04.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2887d640 1 --2- 172.21.15.113:0/4187215751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24074380 0x7f0f241637a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009d90 tx=0x7f0f1c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc987e9aace10a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f22ffd640 1 -- 172.21.15.113:0/4187215751 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c039070 con 0x7f0f24074380 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f22ffd640 1 -- 172.21.15.113:0/4187215751 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c02cce0 con 0x7f0f24074380 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f22ffd640 1 -- 172.21.15.113:0/4187215751 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c034660 con 0x7f0f24074380 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/4187215751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24074380 msgr2=0x7f0f241637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/4187215751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24074380 0x7f0f241637a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009d90 tx=0x7f0f1c02bf30 comp rx=0 tx=0).stop 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/4187215751 shutdown_connections 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/4187215751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24074380 0x7f0f241637a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/4187215751 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f24072c00 0x7f0f240c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/4187215751 >> 172.21.15.113:0/4187215751 conn(0x7f0f2406f2f0 msgr2=0x7f0f2406f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/4187215751 shutdown_connections 2024-04-22T06:35:04.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.564+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/4187215751 wait complete. 2024-04-22T06:35:04.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.565+0000 7f0f2a2e0640 1 Processor -- start 2024-04-22T06:35:04.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f2a2e0640 1 -- start start 2024-04-22T06:35:04.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f2a2e0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24072c00 0x7f0f240c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f2a2e0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f24074380 0x7f0f2415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f2a2e0640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f240c8d00 0x7f0f241e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f2a2e0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f0f241534a0 con 0x7f0f24072c00 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f2a2e0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2415c410 con 0x7f0f24074380 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f2a2e0640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f0f240c4b60 con 0x7f0f240c8d00 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f23fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24072c00 0x7f0f240c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f23fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24072c00 0x7f0f240c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49884/0 (socket says 172.21.15.113:49884) 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.566+0000 7f0f23fff640 1 -- 172.21.15.113:0/559059666 learned_addr learned my addr 172.21.15.113:0/559059666 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f237fe640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f24074380 0x7f0f2415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f2887d640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f240c8d00 0x7f0f241e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f23fff640 1 -- 172.21.15.113:0/559059666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f240c8d00 msgr2=0x7f0f241e3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f23fff640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f240c8d00 0x7f0f241e3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f23fff640 1 -- 172.21.15.113:0/559059666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f24074380 msgr2=0x7f0f2415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f23fff640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f24074380 0x7f0f2415b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f23fff640 1 -- 172.21.15.113:0/559059666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f241f45f0 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f23fff640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24072c00 0x7f0f240c43d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400c430 tx=0x7f0f1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f20ff9640 1 -- 172.21.15.113:0/559059666 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14017070 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f20ff9640 1 -- 172.21.15.113:0/559059666 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f14005ce0 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f241f48d0 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f20ff9640 1 -- 172.21.15.113:0/559059666 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f140072f0 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.567+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f241f4e90 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.568+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f24068e40 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.569+0000 7f0f20ff9640 1 -- 172.21.15.113:0/559059666 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f1401a070 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.569+0000 7f0f20ff9640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0f1006c8f0 0x7f0f1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.569+0000 7f0f20ff9640 1 -- 172.21.15.113:0/559059666 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0f1408b370 con 0x7f0f24072c00 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.569+0000 7f0f237fe640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0f1006c8f0 0x7f0f1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.569+0000 7f0f237fe640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0f1006c8f0 0x7f0f1006edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f241e2c70 tx=0x7f0f18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.573+0000 7f0f20ff9640 1 -- 172.21.15.113:0/559059666 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0f140593a0 con 0x7f0f24072c00 2024-04-22T06:35:04.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.748+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0f24071d30 con 0x7f0f1006c8f0 2024-04-22T06:35:04.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.749+0000 7f0f20ff9640 1 -- 172.21.15.113:0/559059666 <== mgr.4113 v2:172.21.15.113:6832/2607561866 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0f24071d30 con 0x7f0f1006c8f0 2024-04-22T06:35:04.748 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 1 to deep-scrub 2024-04-22T06:35:04.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0f1006c8f0 msgr2=0x7f0f1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0f1006c8f0 0x7f0f1006edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f241e2c70 tx=0x7f0f18008040 comp rx=0 tx=0).stop 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24072c00 msgr2=0x7f0f240c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24072c00 0x7f0f240c43d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400c430 tx=0x7f0f1400c8f0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 shutdown_connections 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f240c8d00 0x7f0f241e3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f24074380 0x7f0f2415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f0f1006c8f0 0x7f0f1006edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 --2- 172.21.15.113:0/559059666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0f24072c00 0x7f0f240c43d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 >> 172.21.15.113:0/559059666 conn(0x7f0f2406f2f0 msgr2=0x7f0f24071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 shutdown_connections 2024-04-22T06:35:04.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.751+0000 7f0f2a2e0640 1 -- 172.21.15.113:0/559059666 wait complete. 2024-04-22T06:35:04.761 INFO:tasks.ceph:Scrubbing osd.2 2024-04-22T06:35:04.761 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-22T06:35:04.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.865+0000 7f430323f640 1 Processor -- start 2024-04-22T06:35:04.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.865+0000 7f430323f640 1 -- start start 2024-04-22T06:35:04.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f430323f640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f42fc0cd880 0x7f42fc15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f430323f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42fc0cbb60 con 0x7f42fc1556d0 2024-04-22T06:35:04.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f430323f640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42fc0b3990 con 0x7f42fc0cc600 2024-04-22T06:35:04.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f430323f640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f42fc0b35b0 con 0x7f42fc0cd880 2024-04-22T06:35:04.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f4300fdb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f42fc1556d0 0x7f42fc0d0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:39910/0 (socket says 172.21.15.113:39910) 2024-04-22T06:35:04.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f4300fdb640 1 -- 172.21.15.113:0/971949097 learned_addr learned my addr 172.21.15.113:0/971949097 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-04-22T06:35:04.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f43017dc640 1 --2- 172.21.15.113:0/971949097 >> v2:172.21.15.145:3300/0 conn(0x7f42fc0cd880 0x7f42fc15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650130108 0 0) 0x7f42fc0cbb60 con 0x7f42fc1556d0 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e4003520 con 0x7f42fc1556d0 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1400696306 0 0) 0x7f42e4003520 con 0x7f42fc1556d0 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 >> v2:172.21.15.145:3300/0 conn(0x7f42fc0cd880 msgr2=0x7f42fc15bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 --2- 172.21.15.113:0/971949097 >> v2:172.21.15.145:3300/0 conn(0x7f42fc0cd880 0x7f42fc15bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 >> v1:172.21.15.145:6789/0 conn(0x7f42fc0cc600 legacy=0x7f42fc0cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc0cb5a0 con 0x7f42fc1556d0 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 982501330 0 0) 0x7f42f8001670 con 0x7f42fc1556d0 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 >> v1:172.21.15.113:6789/0 conn(0x7f42fc1556d0 legacy=0x7f42fc0d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42e40039b0 0x7f42e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42e40051c0 0x7f42e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc0b35b0 con 0x7f42e4004800 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f42e400c060 con 0x7f42e40039b0 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.866+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f42e400c260 con 0x7f42e40051c0 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f42f3fff640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f4300fdb640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42e40039b0 0x7f42e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f43017dc640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42e40051c0 0x7f42e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f42f3fff640 1 -- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42e40051c0 msgr2=0x7f42e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f42f3fff640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42e40051c0 0x7f42e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f42f3fff640 1 -- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42e40039b0 msgr2=0x7f42e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f42f3fff640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42e40039b0 0x7f42e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f42f3fff640 1 -- 172.21.15.113:0/971949097 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e4003520 con 0x7f42e4004800 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f43017dc640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42e40051c0 0x7f42e400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.867+0000 7f43017dc640 1 -- 172.21.15.113:0/971949097 reap_dead start 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f42f3fff640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42e4004c80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f42ec001750 tx=0x7f42e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972a5fd6e14d1fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec001370 con 0x7f42e4004800 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ec0052d0 con 0x7f42e4004800 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f42f37fe640 1 -- 172.21.15.113:0/971949097 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec003830 con 0x7f42e4004800 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f430323f640 1 -- 172.21.15.113:0/971949097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 msgr2=0x7f42e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f430323f640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42e4004c80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f42ec001750 tx=0x7f42e4005830 comp rx=0 tx=0).stop 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f430323f640 1 -- 172.21.15.113:0/971949097 shutdown_connections 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f430323f640 1 --2- 172.21.15.113:0/971949097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42e4004c80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f430323f640 1 -- 172.21.15.113:0/971949097 >> 172.21.15.113:0/971949097 conn(0x7f42fc068360 msgr2=0x7f42fc074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f430323f640 1 -- 172.21.15.113:0/971949097 shutdown_connections 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.868+0000 7f430323f640 1 -- 172.21.15.113:0/971949097 wait complete. 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.869+0000 7f430323f640 1 Processor -- start 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.869+0000 7f430323f640 1 -- start start 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f430323f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42fc1f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f430323f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42fc1587c0 0x7f42fc0d0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f430323f640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42fc0c85f0 0x7f42fc1f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f430323f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc0cbd70 con 0x7f42e4004800 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f430323f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc0b3c30 con 0x7f42fc1587c0 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f430323f640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f42fc0cbef0 con 0x7f42fc0c85f0 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f4300fdb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42fc1f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f4300fdb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42fc1f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49900/0 (socket says 172.21.15.113:49900) 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f4300fdb640 1 -- 172.21.15.113:0/2281110123 learned_addr learned my addr 172.21.15.113:0/2281110123 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.870+0000 7f42f3fff640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42fc1587c0 0x7f42fc0d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f43017dc640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42fc0c85f0 0x7f42fc1f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f4300fdb640 1 -- 172.21.15.113:0/2281110123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42fc0c85f0 msgr2=0x7f42fc1f1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f4300fdb640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42fc0c85f0 0x7f42fc1f1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f4300fdb640 1 -- 172.21.15.113:0/2281110123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42fc1587c0 msgr2=0x7f42fc0d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f4300fdb640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42fc1587c0 0x7f42fc0d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f4300fdb640 1 -- 172.21.15.113:0/2281110123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc14e210 con 0x7f42e4004800 2024-04-22T06:35:04.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f42f3fff640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42fc1587c0 0x7f42fc0d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:04.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f43017dc640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f42fc0c85f0 0x7f42fc1f1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T06:35:04.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f4300fdb640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42fc1f4c50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f42f8007370 tx=0x7f42f8007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f801a070 con 0x7f42e4004800 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f800f940 con 0x7f42e4004800 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f800fd30 con 0x7f42e4004800 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42fc1f5190 con 0x7f42e4004800 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.871+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42fc157350 con 0x7f42e4004800 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.872+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42fc068f50 con 0x7f42e4004800 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.872+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42f801d070 con 0x7f42e4004800 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f42f17fa640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f42e806c8f0 0x7f42e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f42f808b810 con 0x7f42e4004800 2024-04-22T06:35:04.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f42f3fff640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f42e806c8f0 0x7f42e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f42f17fa640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f42e8076300 0x7f42e80787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 --> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42e8078e70 con 0x7f42e8076300 2024-04-22T06:35:04.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f42f80902c0 con 0x7f42e4004800 2024-04-22T06:35:04.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f43017dc640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f42e8076300 0x7f42e80787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f42f3fff640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f42e806c8f0 0x7f42e806edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f42ec033000 tx=0x7f42ec009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.873+0000 7f43017dc640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f42e8076300 0x7f42e80787a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:04.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.874+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 <== osd.2 v2:172.21.15.113:6817/3529664663 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42e8078e70 con 0x7f42e8076300 2024-04-22T06:35:04.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.887+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 --> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f42fc0cc130 con 0x7f42e8076300 2024-04-22T06:35:04.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.887+0000 7f42f17fa640 1 -- 172.21.15.113:0/2281110123 <== osd.2 v2:172.21.15.113:6817/3529664663 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f42fc0cc130 con 0x7f42e8076300 2024-04-22T06:35:04.886 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-04-22T06:35:04.887 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T06:35:04.887 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-04-22T06:35:04.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.887+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f42e8076300 msgr2=0x7f42e80787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.887+0000 7f430323f640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6817/3529664663,v1:172.21.15.113:6819/3529664663] conn(0x7f42e8076300 0x7f42e80787a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.887+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f42e806c8f0 msgr2=0x7f42e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.887+0000 7f430323f640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f42e806c8f0 0x7f42e806edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f42ec033000 tx=0x7f42ec009030 comp rx=0 tx=0).stop 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.887+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 msgr2=0x7f42fc1f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.887+0000 7f430323f640 1 --2- 172.21.15.113:0/2281110123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42e4004800 0x7f42fc1f4c50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f42f8007370 tx=0x7f42f8007830 comp rx=0 tx=0).stop 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.888+0000 7f43017dc640 1 -- 172.21.15.113:0/2281110123 reap_dead start 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.888+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 shutdown_connections 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.888+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 >> 172.21.15.113:0/2281110123 conn(0x7f42fc068360 msgr2=0x7f42fc154610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.888+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 shutdown_connections 2024-04-22T06:35:04.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.888+0000 7f430323f640 1 -- 172.21.15.113:0/2281110123 wait complete. 2024-04-22T06:35:04.897 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-22T06:35:04.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.996+0000 7f9d5598e640 1 Processor -- start 2024-04-22T06:35:04.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.996+0000 7f9d5598e640 1 -- start start 2024-04-22T06:35:04.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d5598e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d50155380 0x7f9d500c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d5598e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9d500c92f0 0x7f9d500c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d5598e640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5015b5a0 con 0x7f9d5015b0f0 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d5598e640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9d5006fab0 con 0x7f9d500c92f0 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d5598e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5015b880 con 0x7f9d50155380 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d4effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d50155380 0x7f9d500c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d4f7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9d500c92f0 0x7f9d500c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d4effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d50155380 0x7f9d500c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.113:58634/0 (socket says 172.21.15.113:58634) 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.997+0000 7f9d4effd640 1 -- 172.21.15.113:0/3865855424 learned_addr learned my addr 172.21.15.113:0/3865855424 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:04.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.998+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/3865855424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d50155380 msgr2=0x7f9d500c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T06:35:04.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.998+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/3865855424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d50155380 0x7f9d500c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:04.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.998+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/3865855424 >> v1:172.21.15.145:6789/0 conn(0x7f9d5015b0f0 legacy=0x7f9d5006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:04.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.998+0000 7f9d4dffb640 1 -- 172.21.15.113:0/3865855424 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131875851 0 0) 0x7f9d5015b5a0 con 0x7f9d5015b0f0 2024-04-22T06:35:04.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.998+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/3865855424 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5015bb60 con 0x7f9d500c92f0 2024-04-22T06:35:04.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.998+0000 7f9d4effd640 1 --2- 172.21.15.113:0/3865855424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d50155380 0x7f9d500c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T06:35:05.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/3865855424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d500c92f0 0x7f9d500c97a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d480097a0 tx=0x7f9d4802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7448be58d6705040 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:05.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d4dffb640 1 -- 172.21.15.113:0/3865855424 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48035020 con 0x7f9d500c92f0 2024-04-22T06:35:05.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d4dffb640 1 -- 172.21.15.113:0/3865855424 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d48031830 con 0x7f9d500c92f0 2024-04-22T06:35:05.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d4dffb640 1 -- 172.21.15.113:0/3865855424 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48031c00 con 0x7f9d500c92f0 2024-04-22T06:35:05.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d5598e640 1 -- 172.21.15.113:0/3865855424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d500c92f0 msgr2=0x7f9d500c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:05.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d5598e640 1 --2- 172.21.15.113:0/3865855424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d500c92f0 0x7f9d500c97a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d480097a0 tx=0x7f9d4802b8d0 comp rx=0 tx=0).stop 2024-04-22T06:35:05.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d5598e640 1 -- 172.21.15.113:0/3865855424 shutdown_connections 2024-04-22T06:35:05.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d5598e640 1 --2- 172.21.15.113:0/3865855424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d500c92f0 0x7f9d500c97a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d5598e640 1 --2- 172.21.15.113:0/3865855424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d50155380 0x7f9d500c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d5598e640 1 -- 172.21.15.113:0/3865855424 >> 172.21.15.113:0/3865855424 conn(0x7f9d500ca0d0 msgr2=0x7f9d500ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d5598e640 1 -- 172.21.15.113:0/3865855424 shutdown_connections 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:04.999+0000 7f9d5598e640 1 -- 172.21.15.113:0/3865855424 wait complete. 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.000+0000 7f9d5598e640 1 Processor -- start 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d5598e640 1 -- start start 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d5598e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d501586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d5598e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d500bf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d5598e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 0x7f9d501559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:05.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d5598e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d500c8510 con 0x7f9d5015b0f0 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d5598e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50155760 con 0x7f9d50155380 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d5598e640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d500c8690 con 0x7f9d500c92f0 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d4f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 0x7f9d501559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d4f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 0x7f9d501559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:49910/0 (socket says 172.21.15.113:49910) 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 learned_addr learned my addr 172.21.15.113:0/2504168250 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d501586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.001+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d500bf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:05.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d501586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d500bf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d500bf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d50152260 con 0x7f9d5015b0f0 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 0x7f9d501559e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009890 tx=0x7f9d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48004230 con 0x7f9d5015b0f0 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d480043d0 con 0x7f9d5015b0f0 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d5598e640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d50152520 con 0x7f9d5015b0f0 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4803a920 con 0x7f9d5015b0f0 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.002+0000 7f9d5598e640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d501f3e70 con 0x7f9d5015b0f0 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.003+0000 7f9d5598e640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d50068e40 con 0x7f9d5015b0f0 2024-04-22T06:35:05.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.004+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d48038020 con 0x7f9d5015b0f0 2024-04-22T06:35:05.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.004+0000 7f9d37fff640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:05.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.004+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9d480ade50 con 0x7f9d5015b0f0 2024-04-22T06:35:05.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.004+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T06:35:05.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.004+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d3c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d400072c0 tx=0x7f9d4000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T06:35:05.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.008+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d48041070 con 0x7f9d5015b0f0 2024-04-22T06:35:05.059 INFO:tasks.ceph.osd.0:Sent signal 15 2024-04-22T06:35:05.060 INFO:tasks.ceph.osd.1:Sent signal 15 2024-04-22T06:35:05.060 INFO:tasks.ceph.osd.2:Sent signal 15 2024-04-22T06:35:05.060 INFO:tasks.ceph.osd.3:Sent signal 15 2024-04-22T06:35:05.061 INFO:tasks.ceph.osd.4:Sent signal 15 2024-04-22T06:35:05.061 INFO:tasks.ceph.osd.5:Sent signal 15 2024-04-22T06:35:05.061 INFO:tasks.ceph.osd.6:Sent signal 15 2024-04-22T06:35:05.061 INFO:tasks.ceph.osd.7:Sent signal 15 2024-04-22T06:35:05.061 INFO:tasks.ceph.mds.a:Sent signal 15 2024-04-22T06:35:05.062 INFO:tasks.ceph.mds.c:Sent signal 15 2024-04-22T06:35:05.062 INFO:tasks.ceph.mds.e:Sent signal 15 2024-04-22T06:35:05.062 INFO:tasks.ceph.mds.b:Sent signal 15 2024-04-22T06:35:05.062 INFO:tasks.ceph.mds.d:Sent signal 15 2024-04-22T06:35:05.063 INFO:tasks.ceph.mds.f:Sent signal 15 2024-04-22T06:35:05.063 INFO:tasks.ceph.mon.a:Sent signal 15 2024-04-22T06:35:05.063 INFO:tasks.ceph.mon.b:Sent signal 15 2024-04-22T06:35:05.063 INFO:tasks.ceph.mon.c:Sent signal 15 2024-04-22T06:35:05.064 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-04-22T06:35:05.064 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-04-22T06:35:05.065 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-04-22T06:35:05.061+0000 7f1bf352b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33417) UID: 0 2024-04-22T06:35:05.065 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-04-22T06:35:05.061+0000 7f1bf352b640 -1 osd.0 26 *** Got signal Terminated *** 2024-04-22T06:35:05.065 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-04-22T06:35:05.061+0000 7f1bf352b640 -1 osd.0 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-22T06:35:05.065 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f69c548a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33663) UID: 0 2024-04-22T06:35:05.065 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f69c548a640 -1 osd.4 26 *** Got signal Terminated *** 2024-04-22T06:35:05.066 INFO:tasks.ceph.osd.4.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f69c548a640 -1 osd.4 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-22T06:35:05.066 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-22T06:35:05.061+0000 7f905e8c7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33425) UID: 0 2024-04-22T06:35:05.066 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-22T06:35:05.061+0000 7f905e8c7640 -1 osd.1 26 *** Got signal Terminated *** 2024-04-22T06:35:05.067 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-04-22T06:35:05.061+0000 7f905e8c7640 -1 osd.1 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-22T06:35:05.067 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f7dd1a2a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33665) UID: 0 2024-04-22T06:35:05.067 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f7dd1a2a640 -1 osd.5 26 *** Got signal Terminated *** 2024-04-22T06:35:05.067 INFO:tasks.ceph.osd.5.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f7dd1a2a640 -1 osd.5 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-22T06:35:05.067 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f73c40f5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33668) UID: 0 2024-04-22T06:35:05.068 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f73c40f5640 -1 osd.6 26 *** Got signal Terminated *** 2024-04-22T06:35:05.068 INFO:tasks.ceph.osd.6.smithi145.stderr:2024-04-22T06:35:05.063+0000 7f73c40f5640 -1 osd.6 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-22T06:35:05.068 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-04-22T06:35:05.062+0000 7f16fe58d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33430) UID: 0 2024-04-22T06:35:05.068 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-04-22T06:35:05.062+0000 7f16fe58d640 -1 osd.2 26 *** Got signal Terminated *** 2024-04-22T06:35:05.068 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-04-22T06:35:05.062+0000 7f16fe58d640 -1 osd.2 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-22T06:35:05.069 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-04-22T06:35:05.062+0000 7ff53dd63640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33436) UID: 0 2024-04-22T06:35:05.069 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-04-22T06:35:05.062+0000 7ff53dd63640 -1 osd.3 26 *** Got signal Terminated *** 2024-04-22T06:35:05.069 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-04-22T06:35:05.062+0000 7ff53dd63640 -1 osd.3 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-22T06:35:05.069 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-04-22T06:35:05.064+0000 7fb787b8d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33671) UID: 0 2024-04-22T06:35:05.069 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-04-22T06:35:05.064+0000 7fb787b8d640 -1 osd.7 26 *** Got signal Terminated *** 2024-04-22T06:35:05.069 INFO:tasks.ceph.osd.7.smithi145.stderr:2024-04-22T06:35:05.064+0000 7fb787b8d640 -1 osd.7 26 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-22T06:35:05.070 INFO:tasks.ceph.mds.a.smithi113.stderr:2024-04-22T06:35:05.063+0000 7fee526c0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 39452) UID: 0 2024-04-22T06:35:05.070 INFO:tasks.ceph.mds.a.smithi113.stderr:2024-04-22T06:35:05.063+0000 7fee526c0640 -1 mds.a *** got signal Terminated *** 2024-04-22T06:35:05.070 INFO:tasks.ceph.mds.b.smithi145.stderr:2024-04-22T06:35:05.065+0000 7fa5985b7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 39300) UID: 0 2024-04-22T06:35:05.070 INFO:tasks.ceph.mds.b.smithi145.stderr:2024-04-22T06:35:05.065+0000 7fa5985b7640 -1 mds.b *** got signal Terminated *** 2024-04-22T06:35:05.071 INFO:tasks.ceph.mds.c.smithi113.stderr:2024-04-22T06:35:05.063+0000 7f04322ef640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 39460) UID: 0 2024-04-22T06:35:05.071 INFO:tasks.ceph.mds.c.smithi113.stderr:2024-04-22T06:35:05.063+0000 7f04322ef640 -1 mds.c *** got signal Terminated *** 2024-04-22T06:35:05.071 INFO:tasks.ceph.mds.d.smithi145.stderr:2024-04-22T06:35:05.065+0000 7fe18da1e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 39303) UID: 0 2024-04-22T06:35:05.071 INFO:tasks.ceph.mds.d.smithi145.stderr:2024-04-22T06:35:05.065+0000 7fe18da1e640 -1 mds.d *** got signal Terminated *** 2024-04-22T06:35:05.072 INFO:tasks.ceph.mds.e.smithi113.stderr:2024-04-22T06:35:05.064+0000 7f836c84b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i e (PID: 39465) UID: 0 2024-04-22T06:35:05.072 INFO:tasks.ceph.mds.e.smithi113.stderr:2024-04-22T06:35:05.064+0000 7f836c84b640 -1 mds.e *** got signal Terminated *** 2024-04-22T06:35:05.072 INFO:tasks.ceph.mds.f.smithi145.stderr:2024-04-22T06:35:05.065+0000 7f961f885640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i f (PID: 39305) UID: 0 2024-04-22T06:35:05.072 INFO:tasks.ceph.mds.f.smithi145.stderr:2024-04-22T06:35:05.065+0000 7f961f885640 -1 mds.f *** got signal Terminated *** 2024-04-22T06:35:05.073 INFO:tasks.ceph.mon.a.smithi113.stderr:2024-04-22T06:35:05.065+0000 7fdaefdbd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 33140) UID: 0 2024-04-22T06:35:05.073 INFO:tasks.ceph.mon.a.smithi113.stderr:2024-04-22T06:35:05.065+0000 7fdaefdbd640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-22T06:35:05.073 INFO:tasks.ceph.mon.c.smithi145.stderr:2024-04-22T06:35:05.066+0000 7f2cf0a1c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 33086) UID: 0 2024-04-22T06:35:05.073 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-04-22T06:35:05.065+0000 7efe390c9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 33176) UID: 0 2024-04-22T06:35:05.074 INFO:tasks.ceph.mon.b.smithi145.stderr:2024-04-22T06:35:05.066+0000 7fbf4169e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 33084) UID: 0 2024-04-22T06:35:05.074 INFO:tasks.ceph.mon.b.smithi145.stderr:2024-04-22T06:35:05.066+0000 7fbf4169e640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-22T06:35:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 msgr2=0x7f9d501559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-22T06:35:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 msgr2=0x7f9d501559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-22T06:35:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 0x7f9d501559e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009890 tx=0x7f9d480046c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 0x7f9d501559e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009890 tx=0x7f9d480046c0 comp rx=0 tx=0).stop 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 msgr2=0x7f9d501559e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d37fff640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d5015b0f0 0x7f9d501559e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d37fff640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d3c078550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d37fff640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d3c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d37fff640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d3c07d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e320 con 0x7f9d3c076140 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e4a0 con 0x7f9d50155380 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e670 con 0x7f9d500c92f0 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d3c07d910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d3c07d910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d3c078550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.066+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d3c078550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.067+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d3c07ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.067+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d3c07ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:05.076 INFO:tasks.ceph.mon.c.smithi145.stderr:2024-04-22T06:35:05.066+0000 7f2cf0a1c640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-04-22T06:35:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.084+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-04-22T06:35:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.084+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-22T06:35:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.084+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d3c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d400072c0 tx=0x7f9d4000b040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T06:35:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.084+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d3c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d400072c0 tx=0x7f9d4000b040 comp rx=0 tx=0).stop 2024-04-22T06:35:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.084+0000 7f9d37fff640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d3c06edb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-22T06:35:05.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.084+0000 7f9d37fff640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d3c06edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:05.265 INFO:tasks.ceph.mgr.x.smithi145.stderr:daemon-helper: command crashed with signal 15 2024-04-22T06:35:05.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.267+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d3c078550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:05.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.267+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d3c078550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:05.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.267+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d3c07d910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:05.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.267+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d3c07d910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:05.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.268+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d3c07ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:05.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.268+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d3c07ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:05.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.668+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d3c078550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:05.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.668+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d3c078550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:05.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.668+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d3c07d910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:05.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.668+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d3c07d910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:05.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.669+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d3c07ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:05.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:05.669+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d3c07ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:06.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.005+0000 7f9d367fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:06.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.005+0000 7f9d367fc640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9d50153ea0 con 0x7f9d3c06c8f0 2024-04-22T06:35:06.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.005+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:06.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.005+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:06.205 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.206+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:06.205 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.206+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:06.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.469+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d3c07d910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:06.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.469+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d3c07d910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:06.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.469+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d3c078550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:06.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.469+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d3c078550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:06.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.470+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d3c07ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:06.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.470+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d3c07ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:06.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.607+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:06.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:06.607+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:07.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:07.408+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:07.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:07.408+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d3c07d910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d3c07d910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d3c07ae40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d3c07ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d3c078550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d3c078550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e320 con 0x7f9d3c076140 2024-04-22T06:35:08.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e4a0 con 0x7f9d50155380 2024-04-22T06:35:08.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e670 con 0x7f9d500c92f0 2024-04-22T06:35:08.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:08.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:08.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:08.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:08.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:08.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.002+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:08.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.203+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:08.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.203+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:08.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.203+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:08.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.203+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:08.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.203+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:08.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.203+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:08.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.604+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:08.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.604+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:08.602 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.604+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:08.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.604+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:08.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.604+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:08.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:08.604+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:09.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:09.009+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:09.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:09.009+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:09.111 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:35:09.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:35:09.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:09.405+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:09.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:09.405+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:09.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:09.405+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:09.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:09.405+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:09.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:09.405+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:09.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:09.405+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:11.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:11.007+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:11.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:11.007+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:11.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:11.008+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:11.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:11.008+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:11.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:11.008+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:11.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:11.008+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:12.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:12.211+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:12.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:12.211+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:14.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.209+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:14.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.209+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:14.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.211+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:14.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.211+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:14.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.211+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:14.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.211+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e320 con 0x7f9d3c076140 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e4a0 con 0x7f9d50155380 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e670 con 0x7f9d500c92f0 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:14.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:14.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.753+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:14.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.954+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:14.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.954+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:14.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.954+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:14.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.954+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:14.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.954+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:14.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:14.954+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:15.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:15.355+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:15.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:15.355+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:15.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:15.355+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:15.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:15.355+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:15.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:15.355+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:15.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:15.355+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:16.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:16.156+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:16.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:16.156+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:16.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:16.156+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:16.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:16.156+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:16.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:16.156+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:16.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:16.156+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:17.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:17.758+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:17.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:17.758+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:17.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:17.758+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:17.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:17.758+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:17.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:17.758+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:17.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:17.758+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:18.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:18.612+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:18.610 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:18.612+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:35:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:20.960+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:20.961+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:20.961+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:20.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:20.961+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:20.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:20.961+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:20.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:20.961+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:24.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e320 con 0x7f9d3c076140 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e4a0 con 0x7f9d50155380 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e670 con 0x7f9d500c92f0 2024-04-22T06:35:24.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:24.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:24.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:24.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:24.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:24.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:24.878+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.079+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.079+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.079+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.079+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.079+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.079+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:25.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.480+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:25.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.480+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:25.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.480+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:25.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.480+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:25.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.480+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:25.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:25.480+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:26.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:26.281+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:26.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:26.281+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:26.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:26.281+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:26.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:26.281+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:26.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:26.281+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:26.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:26.281+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:27.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:27.883+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:27.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:27.883+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:27.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:27.883+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:27.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:27.883+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:27.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:27.883+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:27.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:27.883+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:31.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:31.086+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:31.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:31.086+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:31.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:31.086+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:31.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:31.086+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:31.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:31.086+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:31.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:31.086+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:31.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:31.413+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:31.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:31.413+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:35:37.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:37.491+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:37.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:37.491+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:35:37.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:37.492+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:37.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:37.492+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:37.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:37.492+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:35:37.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:37.492+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:35:39.244 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:35:39.247 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:40.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e320 con 0x7f9d3c076140 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e4a0 con 0x7f9d50155380 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e670 con 0x7f9d500c92f0 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:40.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.066+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:35:40.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.267+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:40.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.267+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:40.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.267+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:40.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.267+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:40.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.267+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:40.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.267+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:35:40.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.668+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:40.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.668+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:40.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.668+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:40.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.668+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:40.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.668+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:40.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:40.668+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:35:41.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:41.469+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:41.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:41.469+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:41.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:41.469+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:41.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:41.469+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:41.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:41.469+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:41.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:41.469+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:35:43.069 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:43.070+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:43.070+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:43.070+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:43.070+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:43.070+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:43.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:43.070+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:35:46.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:46.271+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:46.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:46.271+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:46.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:46.274+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:46.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:46.274+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:46.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:46.274+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:46.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:46.274+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:35:46.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:46.413+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:35:46.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:46.413+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:35:52.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:52.678+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:35:52.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:52.678+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:35:52.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:52.680+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:35:52.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:52.680+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:35:52.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:52.680+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:35:52.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:35:52.680+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:36:01.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:01.422+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:36:01.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:01.422+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:02.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:36:02.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:36:02.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:36:02.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:36:02.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 msgr2=0x7f9d2c00ae00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:36:02.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d3c076140 0x7f9d2c00ae00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:36:02.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e320 con 0x7f9d2c00b340 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e4a0 con 0x7f9d50155380 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e670 con 0x7f9d500c92f0 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:36:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:02.848+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:36:03.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.049+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:03.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.049+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:36:03.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.049+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:03.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.049+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:03.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.049+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:36:03.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.049+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:36:03.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.450+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:03.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.450+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:36:03.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.450+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:03.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.450+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:03.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.450+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:36:03.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:03.450+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:36:04.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:04.251+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:04.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:04.251+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:36:04.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:04.251+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:04.251+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:04.251+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:36:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:04.251+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:36:05.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:05.852+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:05.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:05.852+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:05.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:05.852+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:36:05.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:05.852+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:36:05.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:05.852+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:05.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:05.852+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:36:09.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:09.056+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:09.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:09.056+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:09.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:09.056+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:36:09.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:09.056+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:36:09.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:09.056+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:09.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:09.056+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:36:09.373 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:36:09.377 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:36:15.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:15.462+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:15.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:15.462+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:36:15.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:15.462+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:15.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:15.462+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:15.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:15.462+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:36:15.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:15.462+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:36:16.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:16.424+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:36:16.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:16.424+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:28.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:28.273+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:28.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:28.273+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:28.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:28.274+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:28.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:28.274+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:28.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:28.274+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:28.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:28.274+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:31.426+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:36:31.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:31.426+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:32.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:36:32.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00d730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e320 con 0x7f9d2c00b340 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e4a0 con 0x7f9d50155380 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e670 con 0x7f9d500c92f0 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:32.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:36:32.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:32.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:32.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:36:32.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:32.847+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:36:33.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.048+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:33.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.048+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:36:33.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.048+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:33.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.048+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:33.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.048+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:36:33.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.048+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:36:33.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.449+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.449+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:36:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.449+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.449+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.449+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:36:33.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:33.449+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:36:34.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:34.250+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:34.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:34.250+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:36:34.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:34.250+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:34.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:34.250+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:34.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:34.250+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:36:34.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:34.250+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:36:35.850 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:35.851+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:35.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:35.851+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:36:35.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:35.851+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:35.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:35.851+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:35.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:35.851+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:36:35.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:35.851+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-22T06:36:39.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:39.055+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:39.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:39.055+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:36:39.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:39.055+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:39.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:39.055+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:39.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:39.055+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:36:39.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:39.055+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-22T06:36:39.519 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:36:39.523 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:36:45.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:45.456+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:45.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:45.456+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:36:45.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:45.462+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:45.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:45.462+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:36:45.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:45.462+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:45.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:45.462+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-22T06:36:46.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:46.427+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:36:46.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:46.427+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:58.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:58.269+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:36:58.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:58.269+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:58.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:58.274+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:36:58.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:58.274+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:36:58.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:58.274+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:36:58.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:36:58.274+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:37:01.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:01.431+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 msgr2=0x7f9d501586b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:6832/2607561866 2024-04-22T06:37:01.429 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:01.431+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:6832/2607561866,v1:172.21.15.113:6833/2607561866] conn(0x7f9d3c06c8f0 0x7f9d501586b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-22T06:37:02.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c007bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c007bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c0078e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e320 con 0x7f9d2c00b340 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e4a0 con 0x7f9d50155380 2024-04-22T06:37:02.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d36ffd640 1 -- 172.21.15.113:0/2504168250 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c07e670 con 0x7f9d500c92f0 2024-04-22T06:37:02.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:02.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:02.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:02.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c0078e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:02.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:02.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:02.849+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c0078e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:03.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.050+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:03.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.050+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:03.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.050+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c0078e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:03.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.050+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:03.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.050+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:03.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.050+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c0078e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:03.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.451+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:03.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.451+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:03.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.451+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:03.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.451+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c0078e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:03.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.451+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:03.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:03.451+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c0078e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:04.251+0000 7f9d4effd640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 msgr2=0x7f9d2c00b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:04.251+0000 7f9d4effd640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9d2c00b340 0x7f9d2c00b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:04.251+0000 7f9d4f7fe640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 msgr2=0x7f9d2c0078e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:04.251+0000 7f9d4e7fc640 1 -- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 msgr2=0x7f9d2c00ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:04.251+0000 7f9d4f7fe640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9d500c92f0 0x7f9d2c0078e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:04.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:04.251+0000 7f9d4e7fc640 1 --2- 172.21.15.113:0/2504168250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d50155380 0x7f9d2c00ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:04.926 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-22T06:37:04.927 INFO:tasks.ceph:Scrubbing osd.3 2024-04-22T06:37:04.927 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-22T06:37:05.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.040+0000 7f8b11e81640 1 Processor -- start 2024-04-22T06:37:05.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.040+0000 7f8b11e81640 1 -- start start 2024-04-22T06:37:05.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.040+0000 7f8b11e81640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 0x7f8b0c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:05.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.040+0000 7f8b11e81640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8b0c0c83b0 2024-04-22T06:37:05.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.040+0000 7f8b11e81640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8b0c0c8790 2024-04-22T06:37:05.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.040+0000 7f8b11e81640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0c0c9c30 con 0x7f8b0c0c9610 2024-04-22T06:37:05.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.041+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8b0c0c83b0 legacy=0x7f8b0c15be30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:05.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.041+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 msgr2=0x7f8b0c151bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:05.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.041+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8b0c0c8790 legacy=0x7f8b0c158820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:05.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.041+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 0x7f8b0c151bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:05.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.242+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8b0c0c83b0 legacy=0x7f8b0c15be30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:05.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.242+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8b0c0c8790 legacy=0x7f8b0c158820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:05.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.242+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 msgr2=0x7f8b0c151bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:05.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.242+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 0x7f8b0c151bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:05.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.643+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8b0c0c83b0 legacy=0x7f8b0c15be30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:05.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.643+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8b0c0c8790 legacy=0x7f8b0c158820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:05.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.643+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 msgr2=0x7f8b0c151bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:05.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:05.643+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 0x7f8b0c151bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:06.444+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8b0c0c83b0 legacy=0x7f8b0c15be30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:06.444+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 msgr2=0x7f8b0c151bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:06.444+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8b0c0c8790 legacy=0x7f8b0c158820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:06.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:06.444+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 0x7f8b0c151bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:08.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 msgr2=0x7f8b0c151bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8b0c0c9610 0x7f8b0c151bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8b0c0c8790 legacy=0x7f8b0c158820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8b0c0c83b0 legacy=0x7f8b0c15be30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 0x7f8af8005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 0x7f8af80086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af80036d0 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8006230 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 msgr2=0x7f8af8005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 0x7f8af8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 msgr2=0x7f8af80086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:08.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.041+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 0x7f8af80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:08.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.242+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 msgr2=0x7f8af8005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.242+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 0x7f8af8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.242+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 msgr2=0x7f8af80086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:08.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.242+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 0x7f8af80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:08.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.643+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 msgr2=0x7f8af8005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:08.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.643+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 0x7f8af8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:08.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.643+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 msgr2=0x7f8af80086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:08.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:08.643+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 0x7f8af80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:09.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:09.444+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 msgr2=0x7f8af8005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:09.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:09.444+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 0x7f8af8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:09.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:09.444+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 msgr2=0x7f8af80086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:09.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:09.444+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 0x7f8af80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:09.590 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:37:09.593 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 msgr2=0x7f8af80086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006230 0x7f8af80086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 msgr2=0x7f8af8005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af80036d0 0x7f8af8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 0x7f8af8010810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c158020 con 0x7f8af8007e00 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8003b40 2024-04-22T06:37:11.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af800e420 2024-04-22T06:37:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 msgr2=0x7f8af8010810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 0x7f8af8010810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:11.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.041+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8003b40 legacy=0x7f8af80066e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:11.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.242+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 msgr2=0x7f8af8010810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:11.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.242+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:11.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.242+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 0x7f8af8010810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:11.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.242+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8003b40 legacy=0x7f8af80066e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:11.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.643+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:11.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.643+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 msgr2=0x7f8af8010810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:11.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.643+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 0x7f8af8010810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:11.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:11.643+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8003b40 legacy=0x7f8af80066e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:12.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:12.444+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 msgr2=0x7f8af8010810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:12.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:12.444+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:12.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:12.444+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 0x7f8af8010810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:12.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:12.444+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8003b40 legacy=0x7f8af80066e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 msgr2=0x7f8af8010810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af800e420 0x7f8af8010810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8003b40 legacy=0x7f8af80066e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 0x7f8af8013200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 0x7f8af8015c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8010de0 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af80137e0 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 msgr2=0x7f8af8013200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 msgr2=0x7f8af8015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 0x7f8af8013200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:14.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.042+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 0x7f8af8015c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:14.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.243+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 msgr2=0x7f8af8015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:14.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.243+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 msgr2=0x7f8af8013200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:14.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.243+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 0x7f8af8015c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:14.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.243+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 0x7f8af8013200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:14.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.644+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 msgr2=0x7f8af8015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.644+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 msgr2=0x7f8af8013200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.644+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 0x7f8af8015c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:14.644+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 0x7f8af8013200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:15.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:15.445+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 msgr2=0x7f8af8015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:15.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:15.445+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 msgr2=0x7f8af8013200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:15.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:15.445+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 0x7f8af8015c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:15.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:15.445+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 0x7f8af8013200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:17.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 msgr2=0x7f8af8015c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:17.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80137e0 0x7f8af8015c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 msgr2=0x7f8af8013200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8010de0 0x7f8af8013200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 0x7f8af8006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 0x7f8af8015bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8007e00 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8005b50 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af80066e0 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 msgr2=0x7f8af8006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 0x7f8af8006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:17.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.042+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:17.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.243+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:17.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.243+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 msgr2=0x7f8af8006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:17.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.243+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 0x7f8af8006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:17.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.243+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:17.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.243+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:17.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.644+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:17.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.644+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 msgr2=0x7f8af8006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:17.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.644+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:17.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.644+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:17.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:17.644+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 0x7f8af8006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:18.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:18.445+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:18.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:18.445+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:18.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:18.445+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 msgr2=0x7f8af8006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:18.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:18.445+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:18.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:18.445+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 0x7f8af8006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:20.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 msgr2=0x7f8af8006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:20.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af80066e0 0x7f8af8006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:20.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:20.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8005b50 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:20.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:20.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af80131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:20.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c158020 con 0x7f8af8007790 2024-04-22T06:37:20.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:37:20.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:20.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:20.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.042+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007790 legacy=0x7f8af8010430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:20.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.243+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:20.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.243+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:20.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.243+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007790 legacy=0x7f8af8010430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:20.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.644+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:20.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.644+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:20.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:20.644+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007790 legacy=0x7f8af8010430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:21.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:21.445+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:21.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:21.445+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:21.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:21.445+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007790 legacy=0x7f8af8010430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007790 legacy=0x7f8af8010430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8006680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:23.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 0x7f8af80131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:23.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8007e00 2024-04-22T06:37:23.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007790 2024-04-22T06:37:23.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:23.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8007220 2024-04-22T06:37:23.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:23.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:23.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:23.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.043+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:23.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.244+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:23.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.244+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:23.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.244+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:23.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.244+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:23.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.244+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:23.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.645+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:23.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.645+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:23.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.645+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:23.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.645+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:23.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:23.645+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:24.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:24.446+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:24.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:24.446+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:24.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:24.446+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:24.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:24.446+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:24.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:24.446+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:26.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:26.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:26.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:26.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007790 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:26.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007e00 legacy=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 0x7f8af8015bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c158020 con 0x7f8af8005b50 2024-04-22T06:37:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8006bc0 2024-04-22T06:37:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8005b50 legacy=0x7f8af8010410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:26.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.043+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:26.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.244+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8005b50 legacy=0x7f8af8010410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:26.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.244+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:26.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.244+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:26.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.645+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8005b50 legacy=0x7f8af8010410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:26.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.645+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:26.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:26.645+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:27.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:27.447+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8005b50 legacy=0x7f8af8010410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:27.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:27.447+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:27.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:27.447+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:29.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.043+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.043+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8006bc0 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.043+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8005b50 legacy=0x7f8af8010410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 0x7f8af8015bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8007220 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c158020 con 0x7f8af8017280 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007790 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:29.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.044+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.245+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.245+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.245+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:29.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.245+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:29.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.646+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:29.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.646+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:29.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.646+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:29.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:29.646+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:30.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:30.447+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:30.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:30.447+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:30.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:30.447+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:30.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:30.447+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 msgr2=0x7f8af8015bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007790 0x7f8af8015bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af8008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007e00 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8017e40 2024-04-22T06:37:32.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af8008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af8008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:32.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.044+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:32.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.245+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af8008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:32.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.245+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af8008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:32.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.245+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:32.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.245+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:32.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.646+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af8008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:32.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.646+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af8008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:32.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.646+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:32.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:32.646+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:33.447+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af8008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:33.447+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af8008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:33.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:33.447+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:33.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:33.447+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af8008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af8008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af80081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af8006680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8017280 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007e00 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8017e40 2024-04-22T06:37:35.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:35.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af80081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:35.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:35.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:35.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.044+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:35.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.245+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:35.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.245+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af80081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:35.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.245+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:35.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.245+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:35.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.245+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:35.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.646+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:35.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.646+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af80081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:35.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.646+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:35.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.646+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:35.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:35.646+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:36.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:36.447+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:36.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:36.447+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af80081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:36.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:36.447+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:36.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:36.447+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:36.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:36.447+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:38.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af8006680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:38.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8017e40 0x7f8af8006680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:38.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 msgr2=0x7f8af80081e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:38.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007e00 0x7f8af80081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:38.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8017280 legacy=0x7f8af8017660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:38.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:38.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af80103d0 2024-04-22T06:37:38.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:37:38.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af80103d0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:38.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.044+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:38.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.045+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:38.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.245+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af80103d0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:38.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.246+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:38.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.246+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:38.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.646+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af80103d0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:38.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.647+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:38.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:38.647+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:39.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:39.447+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af80103d0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:39.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:39.448+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:39.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:39.448+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:39.863 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:37:39.866 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:37:41.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af80103d0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8006610 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8017e40 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8007220 2024-04-22T06:37:41.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:41.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:41.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:41.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:41.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.045+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:41.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.246+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:41.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.246+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:41.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.246+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:41.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.246+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:41.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.246+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.647+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.647+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.647+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.647+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:41.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:41.647+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:42.448+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:42.448+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:42.448+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:42.448+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:42.448+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:44.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:44.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:44.043 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 msgr2=0x7f8af80131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:44.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8017e40 0x7f8af80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:44.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:44.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:44.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af80177c0 2024-04-22T06:37:44.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8015bd0 2024-04-22T06:37:44.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:44.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80177c0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:44.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.045+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:44.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.246+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80177c0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:44.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.246+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:44.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.246+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:44.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.647+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80177c0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:44.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.647+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:44.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:44.647+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:45.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:45.448+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80177c0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:45.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:45.448+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:45.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:45.448+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015bd0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80177c0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 0x7f8af8017c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8015bd0 2024-04-22T06:37:47.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8006610 2024-04-22T06:37:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8007220 2024-04-22T06:37:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 msgr2=0x7f8af8017c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 0x7f8af8017c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:47.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.045+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:47.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.246+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 msgr2=0x7f8af8017c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:47.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.246+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:47.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.246+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 0x7f8af8017c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:47.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.246+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:47.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.246+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:47.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.647+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:47.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.647+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 msgr2=0x7f8af8017c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:47.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.647+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 0x7f8af8017c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:47.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.647+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:47.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:47.647+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:48.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:48.448+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:48.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:48.448+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 msgr2=0x7f8af8017c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:48.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:48.448+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 0x7f8af8017c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:48.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:48.448+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:48.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:48.448+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.044+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8007760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af8007760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.044+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 msgr2=0x7f8af8017c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.044+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006610 0x7f8af8017c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.044+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af8007db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.044+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 0x7f8af800e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.044+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af80131d0 2024-04-22T06:37:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.044+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af800c1b0 2024-04-22T06:37:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.045+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 msgr2=0x7f8af800e5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.045+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.045+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 0x7f8af800e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:50.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.246+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 msgr2=0x7f8af800e5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:50.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.246+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:50.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.246+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 0x7f8af800e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:50.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.647+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 msgr2=0x7f8af800e5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.647+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 0x7f8af800e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:50.647+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:51.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:51.448+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 msgr2=0x7f8af800e5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:51.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:51.448+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:51.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:51.448+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 0x7f8af800e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:53.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 msgr2=0x7f8af800e5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:53.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af800c1b0 0x7f8af800e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:53.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af80131d0 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8006610 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b0bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:53.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.045+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:53.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.246+0000 7f8b0bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:53.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.246+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:53.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.246+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:53.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.246+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:53.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.246+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:53.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.647+0000 7f8b0bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:53.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.647+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:53.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.647+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:53.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.647+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:53.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:53.647+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:54.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:54.448+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:54.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:54.448+0000 7f8b0bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:54.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:54.448+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:54.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:54.448+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:54.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:54.448+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:56.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:56.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:56.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:56.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:56.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:56.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:56.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8015bd0 2024-04-22T06:37:56.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8008470 2024-04-22T06:37:56.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:56.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:56.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.045+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:56.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.246+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:56.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.246+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:56.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.246+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:56.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.647+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:56.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.647+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:56.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:56.647+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:57.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:57.448+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:37:57.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:57.448+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:37:57.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:57.448+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800d1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af80131d0 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8006610 2024-04-22T06:37:59.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:59.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:59.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:59.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:59.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.046+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:37:59.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.247+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:59.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.247+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:59.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.247+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:59.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.247+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:59.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.247+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:37:59.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.648+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:37:59.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.648+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:37:59.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.648+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:37:59.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.648+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:37:59.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:37:59.648+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:00.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:00.449+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:00.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:00.449+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:00.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:00.449+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:00.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:00.449+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:00.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:00.449+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8015bd0 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8008470 2024-04-22T06:38:02.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800b1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:02.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:02.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.046+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:02.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.247+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800b1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:02.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.247+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:02.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.247+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:02.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.648+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800b1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:02.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.648+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:02.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:02.648+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:03.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:03.449+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800b1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:03.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:03.449+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:03.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:03.449+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:05.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8015bd0 legacy=0x7f8af800b1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8006aa0 2024-04-22T06:38:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:38:05.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8006610 2024-04-22T06:38:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006aa0 legacy=0x7f8af801c750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:05.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.046+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:05.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.247+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006aa0 legacy=0x7f8af801c750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.247+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.247+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.247+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:05.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.247+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:05.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.648+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006aa0 legacy=0x7f8af801c750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:05.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.648+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:05.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.648+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:05.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.648+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:05.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:05.648+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:06.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:06.449+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006aa0 legacy=0x7f8af801c750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:06.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:06.449+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:06.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:06.449+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:06.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:06.449+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:06.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:06.449+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:08.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006aa0 legacy=0x7f8af801c750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af80131d0 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8008470 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:08.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:08.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.047+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:08.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.248+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:08.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.248+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:08.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.248+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:08.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.649+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:08.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.649+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:08.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:08.649+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:09.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:09.450+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:09.450+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:09.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:09.450+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:09.922 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:38:09.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:38:11.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:11.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008470 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:11.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af80131d0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:11.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:11.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:11.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:11.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8013bc0 2024-04-22T06:38:11.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:38:11.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8006610 2024-04-22T06:38:11.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:11.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:11.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:11.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:11.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.047+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:11.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.248+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:11.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.248+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:11.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.248+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:11.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.248+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:11.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.248+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:11.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.649+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:11.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.649+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:11.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.649+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:11.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.649+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:11.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:11.649+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:12.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:12.450+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:12.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:12.450+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:12.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:12.450+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:12.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:12.450+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:12.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:12.450+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:14.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:14.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:14.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:14.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:14.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8016270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:14.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8015390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:14.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8013fa0 2024-04-22T06:38:14.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8006aa0 2024-04-22T06:38:14.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8013fa0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:14.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8015390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:14.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.047+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8015390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:14.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.248+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8015390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:14.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.248+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8013fa0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:14.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.248+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8015390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:14.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.649+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8013fa0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:14.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.649+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8015390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:14.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:14.649+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8015390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:15.450+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8015390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:15.450+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8013fa0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:15.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:15.450+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8015390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:17.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8015390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:17.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8015390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8013fa0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8007d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8008470 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8006aa0 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.047+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8007220 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.048+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.048+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.048+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:17.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.048+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:17.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.048+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.249+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.249+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.249+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.249+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.249+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:17.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.650+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:17.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.650+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:17.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.650+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:17.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.650+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:17.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:17.650+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:18.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:18.451+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:18.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:18.451+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:18.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:18.451+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:18.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:18.451+0000 7f8b0bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:18.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:18.451+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8013bc0 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8006610 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8014380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:20.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.048+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:20.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.249+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8014380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:20.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.249+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:20.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.249+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:20.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.650+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:20.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.650+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8014380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:20.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:20.650+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:21.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:21.451+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8014380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:21.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:21.451+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:21.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:21.451+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8014380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8008470 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:38:23.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8006610 2024-04-22T06:38:23.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:23.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:23.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:23.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:23.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.048+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:23.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.249+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:23.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.249+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:23.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.249+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:23.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.249+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:23.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.249+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:23.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.650+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:23.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.650+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:23.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.650+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:23.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.650+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:23.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:23.650+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:24.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:24.451+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:24.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:24.451+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:24.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:24.451+0000 7f8b0affd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:24.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:24.451+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:24.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:24.451+0000 7f8b0affd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af80179d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8007220 0x7f8af80179d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:26.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8013bc0 2024-04-22T06:38:26.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8006aa0 2024-04-22T06:38:26.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:26.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:26.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.048+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:26.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.249+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:26.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.249+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:26.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.249+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:26.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.650+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:26.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.650+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:26.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:26.650+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:27.451+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:27.451+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:27.451+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:29.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:29.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8006aa0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:29.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8013bc0 legacy=0x7f8af8007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:29.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:29.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 0x7f8af80151a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:29.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:29.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8008470 2024-04-22T06:38:29.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8014380 2024-04-22T06:38:29.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8006610 2024-04-22T06:38:29.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 msgr2=0x7f8af80151a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:29.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:29.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 0x7f8af80151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:29.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:29.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.048+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:29.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.249+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 msgr2=0x7f8af80151a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:29.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.249+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:29.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.249+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 0x7f8af80151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:29.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.249+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:29.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.249+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:29.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.650+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:29.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.650+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 msgr2=0x7f8af80151a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:29.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.650+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 0x7f8af80151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:29.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.650+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:29.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:29.650+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:30.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:30.451+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:30.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:30.451+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 msgr2=0x7f8af80151a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:30.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:30.451+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 0x7f8af80151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:30.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:30.451+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:30.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:30.451+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:32.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.048+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:32.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.048+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:32.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.048+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 msgr2=0x7f8af80151a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:32.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8014380 0x7f8af80151a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:32.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.048+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:32.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.049+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:32.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.049+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8007220 2024-04-22T06:38:32.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.049+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8013bc0 2024-04-22T06:38:32.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.049+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:32.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.049+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:32.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.049+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:32.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.250+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:32.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.250+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:32.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.250+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:32.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.651+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:32.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.651+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:32.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:32.651+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:33.452+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:33.452+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:33.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:33.452+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:35.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:35.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8007220 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8008470 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8013bc0 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8006610 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:35.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.049+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:35.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.250+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:35.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.250+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:35.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.250+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:35.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.250+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:35.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.250+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:35.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.650+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:35.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.650+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:35.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.650+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:35.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.650+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:35.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:35.650+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:36.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:36.451+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:36.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:36.451+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:36.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:36.451+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:36.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:36.451+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:36.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:36.451+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8006610 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8008470 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af8017990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8014380 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8017990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af8017990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:38.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.048+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014380 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:38.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.249+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8017990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:38.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.249+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af8017990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:38.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.249+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014380 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.650+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8017990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.650+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af8017990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:38.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:38.650+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014380 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:39.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:39.451+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8017990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:39.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:39.451+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af8017990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:39.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:39.451+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014380 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:40.060 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:38:40.063 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:38:41.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 msgr2=0x7f8af8017990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:41.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8007220 0x7f8af8017990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014380 legacy=0x7f8af8007d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8006610 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8014e70 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8007220 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:41.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.049+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:41.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.250+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:41.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.250+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:41.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.250+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:41.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.250+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:41.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.651+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:41.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.651+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:41.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.651+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:41.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:41.651+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:42.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:42.452+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:42.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:42.452+0000 7f8b0bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:42.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:42.452+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:42.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:42.452+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:44.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:44.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 0x7f8af8017910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8013bc0 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8008470 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:44.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.049+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.250+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.250+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.250+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:44.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.250+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:44.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.651+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:44.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.651+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:44.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.651+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:44.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:44.651+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:45.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:45.452+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:45.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:45.452+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:45.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:45.452+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:45.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:45.452+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008470 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c158020 con 0x7f8af8006610 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8014e70 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8013bc0 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:47.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:47.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:47.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.050+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:47.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.251+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:47.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.251+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:47.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.251+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:47.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.251+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:47.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.652+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:47.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.652+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:47.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.652+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:47.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:47.652+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:48.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:48.453+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:48.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:48.453+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:48.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:48.453+0000 7f8b0affd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:48.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:48.453+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8013bc0 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 0x7f8af8017910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8008430 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8007220 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:50.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.050+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:50.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.251+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:50.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.251+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:50.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.251+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:50.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.251+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:50.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.652+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:50.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.652+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:50.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.652+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:50.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:50.652+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:51.453+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:51.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:51.453+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:51.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:51.453+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:51.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:51.453+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:53.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:53.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8007220 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:53.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:53.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8008430 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:53.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af80101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:53.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:53.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8006610 2024-04-22T06:38:53.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c158020 con 0x7f8af8014e70 2024-04-22T06:38:53.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8015250 2024-04-22T06:38:53.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:53.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:53.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:53.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.050+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af80101d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:53.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.251+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:53.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.251+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:53.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.251+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:53.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.251+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af80101d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:53.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.652+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:53.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.652+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:53.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.652+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:53.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:53.652+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af80101d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:54.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:54.453+0000 7f8b0bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:38:54.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:54.453+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:54.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:54.453+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:38:54.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:54.453+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af80101d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:56.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af80101d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:56.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af80101d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:56.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b097fa640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8014e70 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b097fa640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8008430 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8013bc0 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:56.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.050+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:56.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.251+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:56.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.251+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:56.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.251+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:56.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.251+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:56.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.652+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:56.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.652+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:56.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.652+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:56.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:56.652+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:57.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:57.453+0000 7f8b0affd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:57.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:57.453+0000 7f8b0affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:57.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:57.453+0000 7f8b0b7fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:57.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:57.453+0000 7f8b0b7fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:38:59.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:59.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:59.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:38:59.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:38:59.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af8017280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:59.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:59.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b0bfff640 1 -- reap_dead start 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008d70 con 0x7f8af8008430 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f8af8008f20 con 0x7f8af8013bc0 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b097fa640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f8af80101d0 con 0x7f8af8015250 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:59.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.051+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:38:59.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.252+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:59.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.252+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:59.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.252+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:59.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.252+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:59.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.252+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:59.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.252+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:38:59.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.653+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:38:59.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.653+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:59.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.653+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:38:59.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.653+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:38:59.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.653+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:38:59.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:38:59.653+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:00.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:00.454+0000 7f8b0bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:00.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:00.454+0000 7f8b0bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:00.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:00.454+0000 7f8b0b7fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:00.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:00.454+0000 7f8b0affd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:00.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:00.454+0000 7f8b0b7fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:00.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:00.454+0000 7f8b0affd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b097fa640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 msgr2=0x7f8af8017280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b097fa640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8af8015250 0x7f8af8017280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b097fa640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 msgr2=0x7f8af8017910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b097fa640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8af8013bc0 0x7f8af8017910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b097fa640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 msgr2=0x7f8af80076f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b097fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8af8008430 0x7f8af80076f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b097fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c071fe0 con 0x7f8af8006610 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b097fa640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0722c0 con 0x7f8af8010350 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.051+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8010350 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:02.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.252+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:02.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.252+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8010350 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:02.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.653+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:02.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:02.653+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8010350 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:03.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:03.454+0000 7f8b0b7fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f8af8006610 legacy=0x7f8af8007d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:03.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:03.454+0000 7f8b0affd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f8af8010350 legacy=0x7f8af8014760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:04.960 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-22T06:39:04.961 INFO:tasks.ceph:Scrubbing osd.4 2024-04-22T06:39:04.962 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-22T06:39:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.076+0000 7f1b7f74b640 1 Processor -- start 2024-04-22T06:39:05.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.076+0000 7f1b7f74b640 1 -- start start 2024-04-22T06:39:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7f74b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 0x7f1b781630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7f74b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 0x7f1b780c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7f74b640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b7815f440 2024-04-22T06:39:05.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7f74b640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b781598a0 2024-04-22T06:39:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7f74b640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b78163610 2024-04-22T06:39:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b7815f440 legacy=0x7f1b780cc5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 msgr2=0x7f1b781630d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 0x7f1b781630d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 msgr2=0x7f1b780c8100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:05.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.077+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 0x7f1b780c8100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:05.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.278+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b7815f440 legacy=0x7f1b780cc5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:05.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.278+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 msgr2=0x7f1b781630d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:05.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.278+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 0x7f1b781630d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:05.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.278+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 msgr2=0x7f1b780c8100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:05.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.278+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 0x7f1b780c8100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:05.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.679+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b7815f440 legacy=0x7f1b780cc5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:05.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.679+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 msgr2=0x7f1b781630d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:05.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.679+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 0x7f1b781630d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:05.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.679+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 msgr2=0x7f1b780c8100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:05.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:05.679+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 0x7f1b780c8100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:06.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:06.480+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b7815f440 legacy=0x7f1b780cc5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:06.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:06.480+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 msgr2=0x7f1b781630d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:06.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:06.480+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 0x7f1b781630d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:06.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:06.480+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 msgr2=0x7f1b780c8100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:06.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:06.480+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 0x7f1b780c8100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:08.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 msgr2=0x7f1b780c8100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:08.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b78163610 0x7f1b780c8100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 msgr2=0x7f1b781630d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b781598a0 0x7f1b781630d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b7815f440 legacy=0x7f1b780cc5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 0x7f1b5c005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c006120 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c003690 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006120 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:08.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.077+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:08.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.278+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:08.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.278+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006120 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:08.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.278+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:08.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.679+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:08.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.679+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006120 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:08.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:08.679+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:09.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:09.480+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006120 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:09.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:09.480+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:09.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:09.480+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:10.195 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:39:10.199 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:39:11.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:11.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c003690 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:11.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006120 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:11.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:11.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:11.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:11.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c00a330 2024-04-22T06:39:11.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c009eb0 2024-04-22T06:39:11.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c00a870 2024-04-22T06:39:11.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:11.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00a330 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:11.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:11.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:11.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.077+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.278+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00a330 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.278+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.278+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.278+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:11.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.278+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:11.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.679+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00a330 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:11.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.679+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:11.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.679+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:11.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.679+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:11.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:11.679+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:12.480+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00a330 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:12.480+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:12.480+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:12.480+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:12.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:12.480+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00a330 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 0x7f1b5c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c00e260 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00d760 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c012880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:14.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 msgr2=0x7f1b5c00dba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:14.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.078+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 0x7f1b5c00dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:14.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.279+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 msgr2=0x7f1b5c00dba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:14.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.279+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c012880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:14.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.279+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 0x7f1b5c00dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:14.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.680+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 msgr2=0x7f1b5c00dba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:14.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.680+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c012880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:14.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:14.680+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 0x7f1b5c00dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:15.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:15.481+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c012880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:15.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:15.481+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 msgr2=0x7f1b5c00dba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:15.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:15.481+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 0x7f1b5c00dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 msgr2=0x7f1b5c00dba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d760 0x7f1b5c00dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c012880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c00e260 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c009eb0 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c00a870 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:17.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:17.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.078+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.279+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.279+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.279+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.279+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:17.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.279+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:17.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.680+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:17.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.680+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:17.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.681+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:17.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.681+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:17.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:17.681+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:18.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:18.481+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:18.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:18.481+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:18.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:18.482+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:18.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:18.482+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:18.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:18.482+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:20.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:20.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:20.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:20.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:20.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:20.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 0x7f1b5c0138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:20.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c014740 2024-04-22T06:39:20.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00dc00 2024-04-22T06:39:20.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.078+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014740 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:20.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.079+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 msgr2=0x7f1b5c0138b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:20.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.079+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 0x7f1b5c0138b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:20.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.279+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014740 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:20.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.280+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 msgr2=0x7f1b5c0138b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:20.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.280+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 0x7f1b5c0138b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:20.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.680+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014740 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:20.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.681+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 msgr2=0x7f1b5c0138b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:20.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:20.681+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 0x7f1b5c0138b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:21.478 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:21.480+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014740 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:21.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:21.481+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 msgr2=0x7f1b5c0138b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:21.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:21.481+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 0x7f1b5c0138b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 msgr2=0x7f1b5c0138b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00dc00 0x7f1b5c0138b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014740 legacy=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c00e260 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c009eb0 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c00a870 2024-04-22T06:39:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:23.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:23.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:23.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:23.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.077+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:23.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.278+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:23.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.278+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:23.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.278+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:23.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.278+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:23.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.278+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:23.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.679+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:23.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.679+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:23.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.679+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:23.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.679+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:23.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:23.679+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:24.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:24.480+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:24.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:24.480+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:24.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:24.480+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:24.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:24.480+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:24.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:24.480+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c00d100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c009eb0 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 0x7f1b5c0085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c00dc00 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c0138f0 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00dc00 legacy=0x7f1b5c014740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:26.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.078+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:26.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.279+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00dc00 legacy=0x7f1b5c014740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:26.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.279+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:26.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.279+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:26.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.680+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00dc00 legacy=0x7f1b5c014740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:26.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.680+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:26.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:26.680+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:27.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:27.481+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00dc00 legacy=0x7f1b5c014740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:27.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:27.481+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:27.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:27.481+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:29.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:29.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138f0 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:29.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00dc00 legacy=0x7f1b5c014740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c014ff0 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c00e260 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:29.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.078+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:29.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.279+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:29.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.279+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:29.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.279+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:29.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.279+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:29.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.680+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:29.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.680+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:29.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.680+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:29.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:29.680+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:30.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:30.481+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:30.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:30.481+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:30.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:30.481+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:30.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:30.481+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:32.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:32.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:32.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:32.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:32.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 0x7f1b5c00d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:32.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 0x7f1b5c0085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:32.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c0138f0 2024-04-22T06:39:32.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c014720 2024-04-22T06:39:32.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 msgr2=0x7f1b5c00d0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:32.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:32.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 0x7f1b5c00d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:32.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.078+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:32.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.279+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 msgr2=0x7f1b5c00d0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:32.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.279+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:32.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.279+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 0x7f1b5c00d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:32.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.279+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:32.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.680+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 msgr2=0x7f1b5c00d0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:32.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.680+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:32.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.680+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 0x7f1b5c00d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:32.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:32.680+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:33.479 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:33.481+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:33.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:33.481+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 msgr2=0x7f1b5c00d0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:33.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:33.481+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:33.480 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:33.481+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 0x7f1b5c00d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:35.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:35.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c014720 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:35.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 msgr2=0x7f1b5c00d0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:35.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138f0 0x7f1b5c00d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 0x7f1b5c009610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c014ff0 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c00e260 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c009230 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 msgr2=0x7f1b5c009610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:35.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.079+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 0x7f1b5c009610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:35.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.280+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:35.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.280+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 msgr2=0x7f1b5c009610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:35.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.280+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:35.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.280+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 0x7f1b5c009610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:35.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.681+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:35.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.681+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 msgr2=0x7f1b5c009610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:35.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.681+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:35.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:35.681+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 0x7f1b5c009610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:36.482+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:36.482+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 msgr2=0x7f1b5c009610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:36.482+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 0x7f1b5c009610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:36.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:36.482+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 msgr2=0x7f1b5c009610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009230 0x7f1b5c009610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c014ff0 legacy=0x7f1b5c008b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c0085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c00d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c0138d0 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c00a870 2024-04-22T06:39:38.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c00d080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:38.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c00d080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:38.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:38.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.079+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:38.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.280+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c00d080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:38.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.280+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c00d080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:38.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.280+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:38.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.280+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:38.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.681+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c00d080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:38.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.681+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c00d080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:38.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.681+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:38.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:38.681+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:39.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:39.482+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c00d080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:39.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:39.482+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c00d080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:39.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:39.482+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:39.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:39.482+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:40.282 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:39:40.285 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:39:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:41.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c00d080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c00d080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c00e260 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c0138d0 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c00e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:41.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.079+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:41.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.280+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:41.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.280+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:41.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.280+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c00e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:41.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.280+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:41.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.681+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:41.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.681+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c00e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.681+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:41.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:41.681+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:42.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:42.482+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:42.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:42.482+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:42.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:42.482+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:42.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:42.482+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c00e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:44.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:44.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:44.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c00e800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 0x7f1b5c009590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c011f30 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c00d080 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:44.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.080+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:44.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.281+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:44.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.281+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:44.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.281+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:44.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.281+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:44.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.682+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:44.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.682+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:44.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.682+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:44.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:44.682+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:45.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:45.483+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:45.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:45.483+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:45.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:45.483+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:45.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:45.483+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:47.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:47.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00d080 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:47.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:47.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:47.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:47.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 0x7f1b5c012c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:47.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c009590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:47.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c0138d0 2024-04-22T06:39:47.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:39:47.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c012880 2024-04-22T06:39:47.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:47.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c0131a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:47.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 msgr2=0x7f1b5c012c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:47.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:47.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.080+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 0x7f1b5c012c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:47.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.281+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c0131a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:47.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.281+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:47.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.281+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 msgr2=0x7f1b5c012c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:47.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.281+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 0x7f1b5c012c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:47.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.281+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:47.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.682+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:47.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.682+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c0131a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:47.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.682+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 msgr2=0x7f1b5c012c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:47.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.682+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:47.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:47.682+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 0x7f1b5c012c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:48.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:48.483+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:48.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:48.483+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 msgr2=0x7f1b5c012c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:48.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:48.483+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c0131a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:48.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:48.483+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:48.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:48.483+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 0x7f1b5c012c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:50.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.080+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 msgr2=0x7f1b5c012c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:50.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.080+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c012880 0x7f1b5c012c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:50.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.080+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c009590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:50.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.080+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c009590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:50.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.080+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0138d0 legacy=0x7f1b5c0131a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:50.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.080+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:50.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.080+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c00e260 2024-04-22T06:39:50.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.080+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c011f30 2024-04-22T06:39:50.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.081+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:50.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.081+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:50.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.081+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:50.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.282+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:50.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.282+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:50.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.282+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:50.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.683+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:50.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.683+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:50.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:50.683+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:51.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:51.484+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:51.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:51.484+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:51.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:51.484+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:53.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 msgr2=0x7f1b5c012340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:53.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c011f30 0x7f1b5c012340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:53.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00e260 legacy=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:53.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:53.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:53.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:53.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c00f810 2024-04-22T06:39:53.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:39:53.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c0138d0 2024-04-22T06:39:53.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00f810 legacy=0x7f1b5c018fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:53.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:53.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:53.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:53.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.081+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:53.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.282+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:53.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.282+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00f810 legacy=0x7f1b5c018fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:53.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.282+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:53.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.282+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:53.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.282+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:53.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.683+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:53.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.683+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00f810 legacy=0x7f1b5c018fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:53.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.683+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:53.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.683+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:53.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:53.683+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:54.484+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:54.484+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00f810 legacy=0x7f1b5c018fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:39:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:54.484+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:54.484+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:39:54.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:54.484+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:56.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:56.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:56.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:56.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:56.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00f810 legacy=0x7f1b5c018fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:56.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 0x7f1b5c013350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:56.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c00e800 2024-04-22T06:39:56.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00f360 2024-04-22T06:39:56.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e800 legacy=0x7f1b5c00ec50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:56.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 msgr2=0x7f1b5c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:56.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.081+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 0x7f1b5c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:56.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.282+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 msgr2=0x7f1b5c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:56.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.282+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e800 legacy=0x7f1b5c00ec50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:56.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.282+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 0x7f1b5c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:56.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.683+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 msgr2=0x7f1b5c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:56.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.683+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e800 legacy=0x7f1b5c00ec50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:56.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:56.683+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 0x7f1b5c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:57.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:57.484+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 msgr2=0x7f1b5c013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:57.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:57.484+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 0x7f1b5c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:39:57.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:57.484+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e800 legacy=0x7f1b5c00ec50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 msgr2=0x7f1b5c013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c00f360 0x7f1b5c013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00e800 legacy=0x7f1b5c00ec50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c011c00 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c0138d0 2024-04-22T06:39:59.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:59.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:59.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c011c00 legacy=0x7f1b5c008580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:59.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:59.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.081+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:39:59.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.282+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:59.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.282+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:59.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.282+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c011c00 legacy=0x7f1b5c008580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:59.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.282+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:59.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.282+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:39:59.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.683+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:39:59.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.683+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:39:59.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.683+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:39:59.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.683+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c011c00 legacy=0x7f1b5c008580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:39:59.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:39:59.683+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:00.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:00.484+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:00.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:00.484+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:00.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:00.484+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:00.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:00.484+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c011c00 legacy=0x7f1b5c008580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:00.482 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:00.484+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:02.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:02.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:02.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:02.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:02.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c011c00 legacy=0x7f1b5c008580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:02.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 0x7f1b5c0093a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:02.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c00ec50 2024-04-22T06:40:02.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00f0b0 2024-04-22T06:40:02.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00ec50 legacy=0x7f1b5c008c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:02.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 msgr2=0x7f1b5c0093a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:02.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.082+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 0x7f1b5c0093a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:02.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.283+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00ec50 legacy=0x7f1b5c008c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:02.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.283+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 msgr2=0x7f1b5c0093a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:02.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.283+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 0x7f1b5c0093a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:02.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.684+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00ec50 legacy=0x7f1b5c008c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:02.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.684+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 msgr2=0x7f1b5c0093a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:02.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:02.684+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 0x7f1b5c0093a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:03.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:03.485+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00ec50 legacy=0x7f1b5c008c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:03.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:03.485+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 msgr2=0x7f1b5c0093a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:03.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:03.485+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 0x7f1b5c0093a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 msgr2=0x7f1b5c0093a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f0b0 0x7f1b5c0093a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c00ec50 legacy=0x7f1b5c008c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:05.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c011820 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c0138d0 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c011820 legacy=0x7f1b5c012ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:05.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.082+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.283+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.283+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c011820 legacy=0x7f1b5c012ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.283+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.283+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:05.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.283+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:05.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.684+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:05.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.684+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c011820 legacy=0x7f1b5c012ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:05.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.684+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:05.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.684+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:05.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:05.684+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:06.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:06.485+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c011820 legacy=0x7f1b5c012ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:06.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:06.485+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:06.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:06.485+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:06.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:06.485+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:06.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:06.485+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:08.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 msgr2=0x7f1b5c014010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:08.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0138d0 0x7f1b5c014010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:08.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:08.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c00a870 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:08.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c011820 legacy=0x7f1b5c012ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:08.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 0x7f1b5c011c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:08.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c012140 2024-04-22T06:40:08.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00f030 2024-04-22T06:40:08.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 msgr2=0x7f1b5c011c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:08.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c012140 legacy=0x7f1b5c012550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:08.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.081+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 0x7f1b5c011c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:08.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.282+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 msgr2=0x7f1b5c011c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:08.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.282+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c012140 legacy=0x7f1b5c012550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:08.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.282+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 0x7f1b5c011c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:08.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.683+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 msgr2=0x7f1b5c011c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:08.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.683+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c012140 legacy=0x7f1b5c012550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:08.682 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:08.683+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 0x7f1b5c011c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:09.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:09.484+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 msgr2=0x7f1b5c011c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:09.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:09.484+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c012140 legacy=0x7f1b5c012550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:09.483 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:09.484+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 0x7f1b5c011c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:10.436 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:40:10.440 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:40:11.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 msgr2=0x7f1b5c011c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00f030 0x7f1b5c011c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c012140 legacy=0x7f1b5c012550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 0x7f1b5c010f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c00f030 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c010b30 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c00f410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 msgr2=0x7f1b5c010f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:11.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:11.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 0x7f1b5c010f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:11.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.082+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:11.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.283+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c00f410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:11.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.283+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:11.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.283+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 msgr2=0x7f1b5c010f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:11.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.283+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 0x7f1b5c010f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:11.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.283+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:11.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.684+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c00f410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:11.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.684+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 msgr2=0x7f1b5c010f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:11.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.684+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:11.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.684+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:11.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:11.684+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 0x7f1b5c010f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:12.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:12.485+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 msgr2=0x7f1b5c010f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:12.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:12.485+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c00f410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:12.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:12.485+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:12.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:12.485+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 0x7f1b5c010f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:12.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:12.485+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:14.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 msgr2=0x7f1b5c010f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:14.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c010b30 0x7f1b5c010f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:14.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:14.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:14.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c00f410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:14.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:14.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c006550 2024-04-22T06:40:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c013830 2024-04-22T06:40:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:14.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.082+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:14.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.283+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:14.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.283+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:14.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.283+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:14.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.684+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:14.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.684+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:14.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:14.684+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:15.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:15.485+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:15.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:15.485+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:15.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:15.485+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:17.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:17.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:17.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:17.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c006550 2024-04-22T06:40:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c00f030 2024-04-22T06:40:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:40:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c009080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.082+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:17.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.283+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:17.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.283+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c009080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:17.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.283+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:17.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.283+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:17.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.684+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:17.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.684+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:17.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.684+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c009080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:17.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:17.684+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:18.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:18.485+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:18.492 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:18.485+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c009080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:18.485+0000 7f1b7dce8640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:18.493 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:18.485+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:20.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c009080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 0x7f1b5c010420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c013830 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c009790 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 msgr2=0x7f1b5c010420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.083+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 0x7f1b5c010420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.284+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.284+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.284+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 msgr2=0x7f1b5c010420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:20.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.284+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 0x7f1b5c010420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:20.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.685+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:20.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.685+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:20.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.685+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 msgr2=0x7f1b5c010420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:20.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:20.685+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 0x7f1b5c010420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:21.486+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:21.486+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:21.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:21.486+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 msgr2=0x7f1b5c010420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:21.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:21.486+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 0x7f1b5c010420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:23.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 msgr2=0x7f1b5c010420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:23.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c009790 0x7f1b5c010420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:23.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 msgr2=0x7f1b5c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:23.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013830 0x7f1b5c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:23.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:23.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c01bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c006550 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c010960 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c011280 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c01bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c01bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:23.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.083+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:23.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.284+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:23.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.284+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:23.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.284+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c01bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:23.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.284+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:23.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.284+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c01bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:23.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.685+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:23.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.685+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:23.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.685+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:23.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.685+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c01bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:23.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:23.685+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c01bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:24.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:24.486+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:24.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:24.486+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:24.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:24.486+0000 7f1b7dce8640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:24.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:24.486+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c01bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:24.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:24.486+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c01bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c01bff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c01bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c006550 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c0176d0 2024-04-22T06:40:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c00a870 2024-04-22T06:40:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c010040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.083+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.284+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c010040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.284+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:26.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.284+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:26.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.685+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c010040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:26.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.685+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:26.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:26.685+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:27.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:27.486+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c010040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:27.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:27.486+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:27.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:27.486+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:29.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:29.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c00a870 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:29.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c010040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:29.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:29.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c008970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:29.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:29.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c0176d0 2024-04-22T06:40:29.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c010960 2024-04-22T06:40:29.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c011280 2024-04-22T06:40:29.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:29.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:29.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:29.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:29.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.083+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c008970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:29.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.284+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:29.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.284+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:29.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.284+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:29.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.284+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:29.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.284+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c008970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:29.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.685+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:29.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.685+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:29.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.685+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:29.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.685+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:29.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:29.685+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c008970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:30.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:30.487+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:30.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:30.487+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:30.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:30.487+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:30.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:30.487+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:30.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:30.487+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c008970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:32.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 msgr2=0x7f1b5c008970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:32.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c011280 0x7f1b5c008970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:32.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 msgr2=0x7f1b5c010d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:32.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c010960 0x7f1b5c010d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:32.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:32.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 0x7f1b5c013fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:32.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c00a870 2024-04-22T06:40:32.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c006550 2024-04-22T06:40:32.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00a870 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:32.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:32.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.084+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:32.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.285+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00a870 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:32.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.285+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:32.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.285+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:32.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.686+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00a870 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:32.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.686+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:32.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:32.686+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:33.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:33.487+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00a870 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:33.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:33.487+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:33.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:33.487+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:35.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c006550 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00a870 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 0x7f1b5c00f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c0176d0 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815f8f0 con 0x7f1b5c00f570 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c005ad0 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b7dce8640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 msgr2=0x7f1b5c00f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f570 legacy=0x7f1b5c00f950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:35.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.084+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 0x7f1b5c00f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:35.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.285+0000 7f1b7dce8640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:35.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.285+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 msgr2=0x7f1b5c00f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:35.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.285+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f570 legacy=0x7f1b5c00f950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:35.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.285+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 0x7f1b5c00f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:35.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.686+0000 7f1b7dce8640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:35.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.686+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f570 legacy=0x7f1b5c00f950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:35.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.686+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 msgr2=0x7f1b5c00f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:35.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:35.686+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 0x7f1b5c00f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:36.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:36.487+0000 7f1b7dce8640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:36.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:36.487+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 msgr2=0x7f1b5c00f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:36.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:36.487+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f570 legacy=0x7f1b5c00f950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:36.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:36.487+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 0x7f1b5c00f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 msgr2=0x7f1b5c00f030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c005ad0 0x7f1b5c00f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f570 legacy=0x7f1b5c00f950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0176d0 legacy=0x7f1b5c008eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 0x7f1b5c016fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 0x7f1b5c004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c004ac0 2024-04-22T06:40:38.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c013fd0 2024-04-22T06:40:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 msgr2=0x7f1b5c004f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 0x7f1b5c004f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 msgr2=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:38.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.084+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 0x7f1b5c016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:38.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.285+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 msgr2=0x7f1b5c004f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:38.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.285+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 0x7f1b5c004f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:38.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.285+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 msgr2=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:38.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.285+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 0x7f1b5c016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:38.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.686+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 msgr2=0x7f1b5c004f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:38.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.686+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 0x7f1b5c004f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:38.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.686+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 msgr2=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:38.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:38.686+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 0x7f1b5c016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:39.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:39.487+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 msgr2=0x7f1b5c004f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:39.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:39.487+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 0x7f1b5c004f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:39.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:39.487+0000 7f1b7d4e7640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 msgr2=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:39.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:39.487+0000 7f1b7d4e7640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 0x7f1b5c016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:40.699 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:40:40.702 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:40:41.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 msgr2=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:41.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013fd0 0x7f1b5c016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:41.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 msgr2=0x7f1b5c004f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:41.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ac0 0x7f1b5c004f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:41.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:41.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:41.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:41.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c0059f0 2024-04-22T06:40:41.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c013fd0 2024-04-22T06:40:41.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c0176d0 2024-04-22T06:40:41.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.084+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:41.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.085+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:41.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.085+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:41.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.085+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:41.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.085+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:41.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.285+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.286+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.286+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.286+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:41.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.286+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:41.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.686+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:41.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.687+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:41.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.687+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:41.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.687+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:41.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:41.687+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:42.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:42.487+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:42.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:42.488+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:42.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:42.488+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:42.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:42.488+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:42.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:42.488+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:44.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:44.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:44.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:44.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:44.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:44.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 0x7f1b5c008460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:44.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c00f030 2024-04-22T06:40:44.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c008050 2024-04-22T06:40:44.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 msgr2=0x7f1b5c008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:44.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 0x7f1b5c008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:44.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.085+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:44.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.286+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 msgr2=0x7f1b5c008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:44.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.286+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 0x7f1b5c008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:44.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.286+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:44.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.687+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 msgr2=0x7f1b5c008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:44.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.687+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 0x7f1b5c008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:44.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:44.687+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:45.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:45.488+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 msgr2=0x7f1b5c008460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:45.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:45.488+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 0x7f1b5c008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:45.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:45.488+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:47.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 msgr2=0x7f1b5c008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:47.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008050 0x7f1b5c008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:47.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c00f030 legacy=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:47.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c0089a0 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c013fd0 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c0176d0 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0089a0 legacy=0x7f1b5c008d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:47.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.085+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:47.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.286+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:47.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.286+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:47.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.286+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0089a0 legacy=0x7f1b5c008d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:47.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.286+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:47.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.286+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:47.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.687+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:47.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.687+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0089a0 legacy=0x7f1b5c008d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:47.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.687+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:47.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.687+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:47.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:47.687+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:48.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:48.488+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:48.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:48.488+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:48.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:48.488+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0089a0 legacy=0x7f1b5c008d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:48.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:48.488+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:48.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:48.488+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:50.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c0176d0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c0054b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c0054b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c0089a0 legacy=0x7f1b5c008d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c0059f0 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c008460 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:50.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.085+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:50.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.286+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:50.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.286+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:50.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.286+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:50.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.687+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:50.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.687+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:50.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:50.687+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:51.485 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:51.488+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:51.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:51.488+0000 7f1b7cce6640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:51.486 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:51.488+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:53.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:53.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:53.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c0059f0 legacy=0x7f1b5c016fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:53.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:53.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:53.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 0x7f1b5c013fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:53.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c006e70 2024-04-22T06:40:53.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c004ef0 2024-04-22T06:40:53.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c008460 2024-04-22T06:40:53.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:53.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:53.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:53.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:53.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.085+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:53.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.286+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:53.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.286+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:53.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.286+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:53.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.286+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:53.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.286+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:53.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.687+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:53.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.687+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:53.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.687+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:53.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.687+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:53.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:53.687+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:54.488+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:54.488+0000 7f1b7dce8640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:40:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:54.488+0000 7f1b7dce8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:54.488+0000 7f1b7cce6640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:54.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:54.488+0000 7f1b7cce6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:56.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:56.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:56.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b6effd640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 msgr2=0x7f1b5c013fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:56.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c004ef0 0x7f1b5c013fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:56.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:56.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:56.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c005450 2024-04-22T06:40:56.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c013430 2024-04-22T06:40:56.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005450 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:56.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:56.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.085+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:56.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.286+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005450 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:56.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.286+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:56.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.286+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:56.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.687+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005450 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:56.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.687+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:56.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:56.687+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:57.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:57.488+0000 7f1b7d4e7640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005450 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:40:57.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:57.488+0000 7f1b7cce6640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:57.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:57.488+0000 7f1b7cce6640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:40:59.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:59.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:40:59.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b6effd640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005450 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b7dce8640 1 -- reap_dead start 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b6effd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78160190 con 0x7f1b5c006e70 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b6effd640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c008460 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b6effd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7815feb0 con 0x7f1b5c013430 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:59.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.085+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:40:59.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.286+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:59.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.286+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:59.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.286+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:59.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.286+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:59.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.286+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:40:59.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.687+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:40:59.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.687+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:40:59.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.687+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:40:59.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.687+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:40:59.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:40:59.687+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:00.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:00.488+0000 7f1b7cce6640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:00.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:00.488+0000 7f1b7dce8640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:00.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:00.488+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:00.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:00.488+0000 7f1b7dce8640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:00.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:00.488+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:02.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b6effd640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 msgr2=0x7f1b5c005890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:02.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b5c013430 0x7f1b5c005890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b6effd640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 msgr2=0x7f1b5c006930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b6effd640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b5c008460 0x7f1b5c006930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b6effd640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f1b5c006e70 legacy=0x7f1b5c007250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b6effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b6effd640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c009e90 con 0x7f1b5c005430 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b6effd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7815fbd0 con 0x7f1b5c013fd0 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:02.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.086+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005430 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:02.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.287+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:02.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.287+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:02.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.287+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005430 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.688+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:02.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.688+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:02.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:02.688+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005430 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:03.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:03.489+0000 7f1b7d4e7640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 msgr2=0x7f1b5c004ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:03.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:03.489+0000 7f1b7d4e7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1b5c013fd0 0x7f1b5c004ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:03.487 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:03.489+0000 7f1b7cce6640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f1b5c005430 legacy=0x7f1b5c007960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:04.997 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-22T06:41:04.997 INFO:tasks.ceph:Scrubbing osd.5 2024-04-22T06:41:04.997 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-22T06:41:05.107 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.109+0000 7f9bde881640 1 Processor -- start 2024-04-22T06:41:05.108 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.109+0000 7f9bde881640 1 -- start start 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bde881640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 0x7f9bd81587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bde881640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 0x7f9bd80c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bde881640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd8158d30 con 0x7f9bd8151950 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bde881640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bd80c83b0 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bde881640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bd80c8790 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bd8151950 legacy=0x7f9bd81595d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 msgr2=0x7f9bd81587f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 msgr2=0x7f9bd80c9610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:05.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 0x7f9bd81587f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:05.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.110+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 0x7f9bd80c9610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:05.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.311+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bd8151950 legacy=0x7f9bd81595d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:05.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.311+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 msgr2=0x7f9bd81587f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:05.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.311+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 msgr2=0x7f9bd80c9610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:05.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.311+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 0x7f9bd81587f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:05.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.311+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 0x7f9bd80c9610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:05.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.712+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bd8151950 legacy=0x7f9bd81595d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:05.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.712+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 msgr2=0x7f9bd81587f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:05.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.712+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 msgr2=0x7f9bd80c9610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:05.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.712+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 0x7f9bd81587f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:05.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:05.712+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 0x7f9bd80c9610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:06.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:06.513+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bd8151950 legacy=0x7f9bd81595d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:06.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:06.513+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 msgr2=0x7f9bd81587f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:06.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:06.513+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 msgr2=0x7f9bd80c9610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:06.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:06.513+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 0x7f9bd81587f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:06.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:06.513+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 0x7f9bd80c9610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:08.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 msgr2=0x7f9bd80c9610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:08.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bd80c8790 0x7f9bd80c9610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:08.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 msgr2=0x7f9bd81587f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:08.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bd80c83b0 0x7f9bd81587f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:08.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bd8151950 legacy=0x7f9bd81595d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:08.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 0x7f9bc400ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:08.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc40058d0 2024-04-22T06:41:08.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4009580 2024-04-22T06:41:08.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 msgr2=0x7f9bc400ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:08.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 0x7f9bc400ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:08.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.110+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40058d0 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:08.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.311+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 msgr2=0x7f9bc400ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:08.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.311+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 0x7f9bc400ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:08.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.311+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40058d0 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:08.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.712+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 msgr2=0x7f9bc400ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:08.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.712+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 0x7f9bc400ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:08.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:08.712+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40058d0 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:09.513+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 msgr2=0x7f9bc400ba40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:09.513+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 0x7f9bc400ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:09.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:09.513+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40058d0 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:10.815 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:41:10.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:41:11.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 msgr2=0x7f9bc400ba40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4009580 0x7f9bc400ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40058d0 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc400cc90 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc400c100 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400bb00 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bdce1e640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:11.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.111+0000 7f9bdce1e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:11.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.312+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:11.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.312+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:11.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.312+0000 7f9bdce1e640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:11.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.312+0000 7f9bdce1e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.713+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.713+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:11.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.713+0000 7f9bdce1e640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:11.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:11.713+0000 7f9bdce1e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:12.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:12.514+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:12.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:12.514+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:12.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:12.514+0000 7f9bdce1e640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:12.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:12.514+0000 7f9bdce1e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:14.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:14.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 0x7f9bc40120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 0x7f9bc4010bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc40127a0 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4011cc0 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 msgr2=0x7f9bc4010bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 0x7f9bc4010bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 msgr2=0x7f9bc40120d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:14.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.111+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 0x7f9bc40120d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:14.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.312+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 msgr2=0x7f9bc4010bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:14.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.312+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 0x7f9bc4010bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:14.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.312+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 msgr2=0x7f9bc40120d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:14.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.312+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 0x7f9bc40120d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:14.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.713+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 msgr2=0x7f9bc4010bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:14.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.713+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 0x7f9bc4010bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:14.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.713+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 msgr2=0x7f9bc40120d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:14.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:14.713+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 0x7f9bc40120d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:15.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:15.514+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 msgr2=0x7f9bc4010bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:15.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:15.514+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 0x7f9bc4010bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:15.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:15.514+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 msgr2=0x7f9bc40120d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:15.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:15.514+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 0x7f9bc40120d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:17.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 msgr2=0x7f9bc40120d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:17.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4011cc0 0x7f9bc40120d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:17.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 msgr2=0x7f9bc4010bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40127a0 0x7f9bc4010bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc400cc90 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc400c100 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400bb00 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:17.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.112+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:17.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.313+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:17.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.313+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:17.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.313+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:17.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.313+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.714+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.714+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.714+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:17.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:17.714+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:18.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:18.515+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:18.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:18.515+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:18.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:18.515+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:18.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:18.515+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc4007d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 0x7f9bc40120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4011190 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4010bb0 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:20.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.112+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:20.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.313+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:20.311 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.313+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:20.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.313+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:20.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.313+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:20.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.714+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:20.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.714+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:20.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.714+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:20.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:20.714+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:21.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:21.515+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:21.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:21.515+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:21.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:21.515+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:21.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:21.515+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:23.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:23.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010bb0 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:23.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:23.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:23.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:23.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:23.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:23.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc400c100 2024-04-22T06:41:23.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4011190 2024-04-22T06:41:23.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.112+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc400bb00 2024-04-22T06:41:23.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.113+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:23.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.113+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:23.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.113+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:23.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.113+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:23.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.113+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:23.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.314+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:23.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.314+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:23.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.314+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:23.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.314+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:23.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.314+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.715+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.715+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.715+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.715+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:23.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:23.715+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:24.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:24.516+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:24.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:24.516+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:24.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:24.516+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:24.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:24.516+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:24.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:24.516+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:26.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 msgr2=0x7f9bc4010510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:26.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400bb00 0x7f9bc4010510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:26.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:26.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:26.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:26.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:26.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc400cc90 2024-04-22T06:41:26.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4010b80 2024-04-22T06:41:26.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc400d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:26.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:26.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.113+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.314+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc400d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.314+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:26.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.314+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:26.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.715+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc400d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:26.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.715+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:26.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:26.715+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:27.516+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc400d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:27.516+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:27.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:27.516+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:29.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:29.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:29.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400cc90 legacy=0x7f9bc400d4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc400c100 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4011190 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4010b80 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:29.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.113+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:29.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.314+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:29.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.314+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:29.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.314+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:29.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.314+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:29.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.314+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:29.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.715+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:29.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.715+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:29.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.715+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:29.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.715+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:29.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:29.715+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:30.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:30.516+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:30.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:30.516+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:30.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:30.516+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:30.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:30.516+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:30.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:30.516+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:32.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40115a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40115a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400c100 legacy=0x7f9bc400c4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc400bb00 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400cc90 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400bb00 legacy=0x7f9bc4008d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:32.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.113+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:32.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.314+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400bb00 legacy=0x7f9bc4008d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:32.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.314+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:32.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.314+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:32.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.715+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400bb00 legacy=0x7f9bc4008d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:32.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.715+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:32.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:32.715+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:33.516+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400bb00 legacy=0x7f9bc4008d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:33.516+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:33.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:33.516+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400bb00 legacy=0x7f9bc4008d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc4017500 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc4010b80 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400cc90 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017500 legacy=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:35.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:35.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:35.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.114+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400c100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:35.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.315+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017500 legacy=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:35.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.315+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:35.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.315+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400c100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:35.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.315+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:35.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.716+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017500 legacy=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:35.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.716+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:35.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.716+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400c100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:35.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:35.716+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:36.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:36.517+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017500 legacy=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:36.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:36.517+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:36.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:36.517+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400c100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:36.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:36.517+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:38.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400cc90 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400c100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017500 legacy=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4011190 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc40104c0 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:38.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.113+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:38.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.314+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:38.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.314+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:38.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.314+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:38.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.314+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:38.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.715+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:38.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.715+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:38.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.715+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:38.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:38.715+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:39.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:39.516+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:39.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:39.516+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:39.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:39.516+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:39.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:39.516+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:40.889 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:41:40.892 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 msgr2=0x7f9bc40120a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4011190 0x7f9bc40120a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc40120a0 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc40104c0 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4010b80 2024-04-22T06:41:41.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400aa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:41.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:41.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:41.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.113+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:41.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.314+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400aa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:41.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.314+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:41.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.314+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:41.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.314+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:41.713 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.715+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400aa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:41.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.715+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:41.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.715+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:41.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:41.715+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:42.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:42.516+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400aa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:42.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:42.516+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:42.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:42.516+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:42.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:42.516+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:44.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:44.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:44.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:44.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400aa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:44.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:44.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 0x7f9bc4016fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:44.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4007d30 2024-04-22T06:41:44.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc400c9c0 2024-04-22T06:41:44.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:44.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:44.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:44.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.114+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:44.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.315+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:44.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.315+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:44.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.315+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:44.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.315+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:44.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.716+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:44.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.716+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:44.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.716+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:44.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:44.716+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:45.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:45.517+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:45.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:45.517+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:45.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:45.517+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:45.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:45.517+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:47.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:47.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:47.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 msgr2=0x7f9bc4016fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:47.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4007d30 0x7f9bc4016fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:47.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc40104c0 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400c9c0 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4010b80 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:47.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.114+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:47.313 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.315+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:47.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.315+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:47.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.315+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:47.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.315+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:47.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.315+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:47.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.716+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:47.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.716+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:47.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.716+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:47.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.716+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:47.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:47.716+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:48.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:48.517+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:48.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:48.517+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:48.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:48.517+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:48.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:48.517+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:48.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:48.517+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:50.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:50.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc400b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 0x7f9bc40173a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc40120a0 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4016fc0 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 msgr2=0x7f9bc40173a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:50.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.115+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 0x7f9bc40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:50.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.316+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:50.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.316+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 msgr2=0x7f9bc40173a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:50.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.316+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 0x7f9bc40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:50.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.717+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:50.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.717+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 msgr2=0x7f9bc40173a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:50.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:50.717+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 0x7f9bc40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:51.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:51.518+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:51.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:51.518+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 msgr2=0x7f9bc40173a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:51.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:51.518+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 0x7f9bc40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:53.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 msgr2=0x7f9bc40173a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4016fc0 0x7f9bc40173a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc40120a0 legacy=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc40178e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc40104c0 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400c9c0 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4010b80 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:53.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:53.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:53.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc40178e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:53.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.115+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.316+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.316+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.316+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.316+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:53.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.316+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc40178e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:53.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.717+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:53.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.717+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:53.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.717+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc40178e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:53.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.717+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:53.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:53.717+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:54.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:54.518+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:41:54.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:54.518+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:54.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:54.518+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:54.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:54.518+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc40178e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:54.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:54.518+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc40178e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c9c0 0x7f9bc40178e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc4016f40 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc40120a0 2024-04-22T06:41:56.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4016f40 legacy=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:56.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:56.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.115+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:56.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.316+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4016f40 legacy=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:56.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.316+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:56.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.316+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:56.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.717+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:56.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.717+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4016f40 legacy=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:56.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:56.717+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:41:57.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:57.518+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:41:57.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:57.518+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4016f40 legacy=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:57.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:57.518+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:41:59.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:59.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:41:59.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4016f40 legacy=0x7f9bc400b110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:41:59.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:41:59.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:41:59.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc4017320 2024-04-22T06:41:59.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc40104c0 2024-04-22T06:41:59.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4010b80 2024-04-22T06:41:59.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:59.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:59.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:59.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.115+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:41:59.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.316+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:59.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.316+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:59.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.316+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:59.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.316+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:41:59.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.717+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:41:59.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.717+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:41:59.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.717+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:41:59.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:41:59.717+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:00.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:00.518+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:00.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:00.518+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:00.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:00.518+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:00.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:00.518+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:02.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 0x7f9bc4017700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400c9c0 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc40120a0 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:02.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.116+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:02.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.317+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:02.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.317+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:02.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.317+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:02.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.317+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:02.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.718+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:02.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.718+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:02.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.718+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:02.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:02.718+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:03.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:03.519+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:03.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:03.519+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:03.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:03.519+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:03.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:03.519+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:05.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:05.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:05.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:05.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c9c0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:05.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:05.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 0x7f9bc400b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc40104c0 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400b110 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4010b80 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 msgr2=0x7f9bc400b4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 0x7f9bc400b4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bdce1e640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:05.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.116+0000 7f9bdce1e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:05.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.317+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 msgr2=0x7f9bc400b4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:05.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.317+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 0x7f9bc400b4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:05.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.317+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:05.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.317+0000 7f9bdce1e640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:05.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.317+0000 7f9bdce1e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.718+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 msgr2=0x7f9bc400b4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.718+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 0x7f9bc400b4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.718+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.718+0000 7f9bdce1e640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:05.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:05.718+0000 7f9bdce1e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:06.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:06.519+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 msgr2=0x7f9bc400b4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:06.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:06.519+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 0x7f9bc400b4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:06.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:06.519+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:06.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:06.519+0000 7f9bdce1e640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:06.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:06.519+0000 7f9bdce1e640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:08.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:08.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:08.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 msgr2=0x7f9bc400b4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:08.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400b110 0x7f9bc400b4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:08.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:08.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:08.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc4017320 2024-04-22T06:42:08.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc40120a0 2024-04-22T06:42:08.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.116+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:08.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.117+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:08.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.117+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:08.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.317+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:08.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.318+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:08.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.318+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:08.715 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.718+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.719+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:08.716 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:08.719+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:09.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:09.519+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:09.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:09.520+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:09.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:09.520+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:11.034 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:42:11.037 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:42:11.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc400a9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:11.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc400a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:11.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4017320 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:11.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:11.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:11.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc4010b80 2024-04-22T06:42:11.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc40104c0 2024-04-22T06:42:11.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc40120a0 2024-04-22T06:42:11.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:11.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:11.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:11.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.117+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:11.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.318+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:11.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.318+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:11.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.318+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:11.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.318+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:11.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.719+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:11.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.719+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:11.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.719+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:11.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:11.719+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:12.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:12.520+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:12.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:12.520+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:12.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:12.520+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:12.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:12.520+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:14.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40120a0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc40104c0 legacy=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 0x7f9bc400b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 0x7f9bc4007d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400a9c0 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc400b610 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 msgr2=0x7f9bc400b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 0x7f9bc400b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 msgr2=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:14.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.117+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 0x7f9bc4007d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:14.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.318+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 msgr2=0x7f9bc400b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:14.315 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.318+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 0x7f9bc400b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:14.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.318+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 msgr2=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:14.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.318+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 0x7f9bc4007d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:14.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.719+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 msgr2=0x7f9bc400b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:14.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.719+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 0x7f9bc400b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:14.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.719+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 msgr2=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:14.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:14.719+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 0x7f9bc4007d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:15.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:15.520+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 msgr2=0x7f9bc400b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:15.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:15.520+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 0x7f9bc400b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:15.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:15.520+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 msgr2=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:15.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:15.520+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 0x7f9bc4007d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:17.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 msgr2=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:17.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b610 0x7f9bc4007d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:17.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 msgr2=0x7f9bc400b0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:17.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a9c0 0x7f9bc400b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:17.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc400c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc40120a0 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc40104c0 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc400c600 con 0x7f9bc4010b80 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:17.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.117+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:17.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.318+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:17.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.318+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:17.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.318+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:17.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.318+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:17.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.318+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:17.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.318+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:17.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.719+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:17.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.719+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:17.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.719+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:17.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.719+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:17.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.719+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:17.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:17.719+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:18.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:18.520+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:18.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:18.520+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:18.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:18.520+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:18.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:18.520+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:18.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:18.520+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:18.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:18.520+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:20.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:20.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:20.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:20.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc40104c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:20.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:20.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:20.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc400b4b0 2024-04-22T06:42:20.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc400b0d0 2024-04-22T06:42:20.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc400fb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:20.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.118+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b0d0 legacy=0x7f9bc400f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.319+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc400fb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:20.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.319+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b0d0 legacy=0x7f9bc400f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:20.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.720+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc400fb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:20.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:20.720+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b0d0 legacy=0x7f9bc400f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:21.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:21.520+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc400fb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:21.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:21.520+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b0d0 legacy=0x7f9bc400f460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:23.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b0d0 legacy=0x7f9bc400f460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:23.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc400fb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:23.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:23.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc400c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:23.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc4010b80 2024-04-22T06:42:23.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc4008d40 2024-04-22T06:42:23.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400b4b0 2024-04-22T06:42:23.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:23.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:23.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4008d40 legacy=0x7f9bc401e420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:23.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.117+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:23.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.318+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:23.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.318+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4008d40 legacy=0x7f9bc401e420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:23.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.318+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:23.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.318+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:23.717 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.719+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:23.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.719+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:23.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.719+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:23.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:23.719+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4008d40 legacy=0x7f9bc401e420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:24.520+0000 7f9bdce1e640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:24.520+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:24.520+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4008d40 legacy=0x7f9bc401e420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:24.520+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:26.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:26.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:26.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4008d40 legacy=0x7f9bc401e420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4007d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc40120a0 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4011570 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:26.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.117+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:26.316 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.318+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:26.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.318+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:26.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.318+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:26.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.318+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:26.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.719+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:26.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.719+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:26.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.719+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:26.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:26.719+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:27.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:27.520+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:27.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:27.520+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:27.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:27.520+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:27.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:27.520+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc40120a0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc4017700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc4010b80 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc4011570 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400b4b0 2024-04-22T06:42:29.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:29.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4011570 legacy=0x7f9bc400a070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:29.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:29.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.118+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.319+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.319+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4011570 legacy=0x7f9bc400a070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.319+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:29.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.319+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:29.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.720+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:29.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.720+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:29.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.720+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4011570 legacy=0x7f9bc400a070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:29.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:29.720+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:30.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:30.521+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:30.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:30.521+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:30.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:30.521+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4011570 legacy=0x7f9bc400a070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:30.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:30.521+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:32.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:32.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400b4b0 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:32.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4011570 legacy=0x7f9bc400a070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:32.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 0x7f9bc400c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 0x7f9bc401c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4010470 2024-04-22T06:42:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4008d20 2024-04-22T06:42:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 msgr2=0x7f9bc401c410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:32.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.118+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 0x7f9bc401c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:32.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.319+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:32.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.319+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:32.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.319+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 msgr2=0x7f9bc401c410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:32.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.319+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 0x7f9bc401c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:32.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.720+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:32.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.720+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:32.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.720+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 msgr2=0x7f9bc401c410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:32.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:32.720+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 0x7f9bc401c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:33.521+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:33.521+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:33.521+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 msgr2=0x7f9bc401c410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:33.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:33.521+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 0x7f9bc401c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:35.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 msgr2=0x7f9bc401c410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:35.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4008d20 0x7f9bc401c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 msgr2=0x7f9bc400c0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010470 0x7f9bc400c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4017700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc400b4b0 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400c0c0 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4010b80 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:35.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:35.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.118+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:35.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.319+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:35.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.319+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:35.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.319+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:35.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.319+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:35.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.319+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:35.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.720+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:35.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.720+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:35.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.720+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:35.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.720+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:35.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:35.720+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:36.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:36.521+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:36.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:36.521+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:36.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:36.521+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:36.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:36.521+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:36.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:36.521+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:38.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 msgr2=0x7f9bc4017700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:38.117 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4010b80 0x7f9bc4017700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 0x7f9bc400a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc400f460 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400a070 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:38.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.119+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400f460 legacy=0x7f9bc400f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:38.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.320+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:38.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.320+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:38.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.320+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400f460 legacy=0x7f9bc400f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:38.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.721+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:38.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.721+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:38.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:38.721+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400f460 legacy=0x7f9bc400f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:39.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:39.522+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:39.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:39.522+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:39.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:39.522+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400f460 legacy=0x7f9bc400f870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400a070 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400f460 legacy=0x7f9bc400f870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc400c0c0 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd815b750 con 0x7f9bc4010b80 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400b4b0 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:41.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:41.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:41.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.119+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:41.167 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:42:41.171 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:42:41.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.320+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:41.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.320+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:41.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.320+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:41.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.320+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:41.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.721+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:41.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.721+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:41.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.721+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:41.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:41.721+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:42.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:42.522+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:42.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:42.522+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:42.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:42.522+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:42.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:42.522+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:44.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:44.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:44.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:44.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:44.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 0x7f9bc400a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:44.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 0x7f9bc400fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:44.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400f870 2024-04-22T06:42:44.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4017700 2024-04-22T06:42:44.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 msgr2=0x7f9bc400fc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:44.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.119+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 0x7f9bc400fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:44.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.120+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:44.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.120+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:44.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.321+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 msgr2=0x7f9bc400fc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:44.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.321+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 0x7f9bc400fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:44.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.321+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:44.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.321+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:44.719 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.722+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 msgr2=0x7f9bc400fc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:44.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.722+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 0x7f9bc400fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:44.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.722+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:44.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:44.722+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:45.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:45.523+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 msgr2=0x7f9bc400fc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:45.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:45.523+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 0x7f9bc400fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:45.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:45.523+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:45.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:45.523+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:47.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:47.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4017700 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:47.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 msgr2=0x7f9bc400fc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:47.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400f870 0x7f9bc400fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:47.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:47.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc400a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:47.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:47.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc400c0c0 2024-04-22T06:42:47.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4010b80 2024-04-22T06:42:47.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc400b4b0 2024-04-22T06:42:47.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:47.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:47.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:47.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:47.121 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.120+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:47.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.321+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:47.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.321+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:47.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.321+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:47.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.321+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:47.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.321+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:47.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.722+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:47.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.722+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:47.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.722+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:47.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.722+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:47.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:47.722+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:48.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:48.523+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:48.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:48.523+0000 7f9bdce1e640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:48.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:48.523+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:48.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:48.523+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:48.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:48.523+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:50.118 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400b4b0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4010b80 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400c0c0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 0x7f9bc400fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc4014f10 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4008d20 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 msgr2=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 0x7f9bc400fc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:50.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.120+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4014f10 legacy=0x7f9bc4015320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:50.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.321+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 msgr2=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:50.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.321+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 0x7f9bc400fc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:50.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.321+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4014f10 legacy=0x7f9bc4015320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:50.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.722+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 msgr2=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:50.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.722+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 0x7f9bc400fc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:50.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:50.722+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4014f10 legacy=0x7f9bc4015320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:51.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:51.523+0000 7f9bd7fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 msgr2=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:51.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:51.523+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 0x7f9bc400fc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:51.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:51.523+0000 7f9bd77fe640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4014f10 legacy=0x7f9bc4015320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:53.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 msgr2=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:53.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4008d20 0x7f9bc400fc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:53.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4014f10 legacy=0x7f9bc4015320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:53.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:53.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:53.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 0x7f9bc400a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:53.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc400b4b0 2024-04-22T06:42:53.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4010b80 2024-04-22T06:42:53.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc400c0c0 2024-04-22T06:42:53.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:53.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:53.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:53.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:53.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.120+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:53.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.321+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:53.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.321+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:53.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.321+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:53.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.321+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:53.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.322+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:53.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.722+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:53.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.722+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:53.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.722+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:53.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.722+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:53.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:53.723+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:54.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:54.523+0000 7f9bdce1e640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:54.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:54.523+0000 7f9bdce1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:54.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:54.523+0000 7f9bd77fe640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:42:54.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:54.523+0000 7f9bd77fe640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:54.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:54.524+0000 7f9bd7fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd5ffb640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 msgr2=0x7f9bc4011570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc400c0c0 0x7f9bc4011570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc4010b80 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 0x7f9bc4016300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc4010030 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400fc50 2024-04-22T06:42:56.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010030 legacy=0x7f9bc4007d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:56.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 msgr2=0x7f9bc4016300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:56.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.121+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 0x7f9bc4016300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:56.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.322+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010030 legacy=0x7f9bc4007d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:56.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.322+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 msgr2=0x7f9bc4016300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:56.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.322+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 0x7f9bc4016300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:56.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.723+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010030 legacy=0x7f9bc4007d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:56.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.723+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 msgr2=0x7f9bc4016300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:56.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:56.723+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 0x7f9bc4016300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:57.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:57.524+0000 7f9bd77fe640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010030 legacy=0x7f9bc4007d10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:57.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:57.524+0000 7f9bd7fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 msgr2=0x7f9bc4016300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:42:57.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:57.524+0000 7f9bd7fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 0x7f9bc4016300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:42:59.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 msgr2=0x7f9bc4016300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc400fc50 0x7f9bc4016300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc4010030 legacy=0x7f9bc4007d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bdce1e640 1 -- reap_dead start 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 0x7f9bc400a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc4012d30 con 0x7f9bc400b4b0 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd5ffb640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc400d1c0 con 0x7f9bc4010b80 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc400c0c0 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:42:59.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.121+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:59.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.322+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:59.319 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.322+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:59.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.322+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:42:59.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.322+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:42:59.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.723+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:42:59.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.723+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:42:59.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.723+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:42:59.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:42:59.723+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:00.524+0000 7f9bd7fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:00.524+0000 7f9bd77fe640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:00.524+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:00.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:00.524+0000 7f9bdce1e640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:02.119 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd5ffb640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 msgr2=0x7f9bc400a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9bc400c0c0 0x7f9bc400a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f9bc4010b80 legacy=0x7f9bc400fc50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd5ffb640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f9bc400b4b0 legacy=0x7f9bc4009960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd5ffb640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd5ffb640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 0x7f9bc4016710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd5ffb640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd815c2d0 con 0x7f9bc4016300 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd5ffb640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815b470 con 0x7f9bc4011570 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 msgr2=0x7f9bc4016710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:02.120 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.121+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 0x7f9bc4016710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:02.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.322+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 msgr2=0x7f9bc4016710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:02.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.322+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.322+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 0x7f9bc4016710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:02.329 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.322+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:02.720 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.723+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 msgr2=0x7f9bc4016710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:02.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.723+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:02.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.723+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 0x7f9bc4016710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:02.721 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:02.723+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:03.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:03.524+0000 7f9bd77fe640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 msgr2=0x7f9bc4016710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:03.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:03.524+0000 7f9bd77fe640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc4016300 0x7f9bc4016710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:03.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:03.524+0000 7f9bd7fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 msgr2=0x7f9bc4008d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:03.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:03.524+0000 7f9bd7fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc4011570 0x7f9bc4008d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:05.031 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-22T06:43:05.031 INFO:tasks.ceph:Scrubbing osd.6 2024-04-22T06:43:05.032 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-22T06:43:05.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.145+0000 7f7b207ce640 1 Processor -- start 2024-04-22T06:43:05.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.145+0000 7f7b207ce640 1 -- start start 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b207ce640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b18070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b207ce640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b18071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b207ce640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b180cf490 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b207ce640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b180cadd0 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b207ce640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b18155140 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b18071210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b18071210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b180cf490 legacy=0x7f7b180c9ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:05.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b18070cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:05.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.146+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b18070cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:05.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.346+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b18071210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:05.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.346+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b18071210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:05.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.346+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b180cf490 legacy=0x7f7b180c9ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:05.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.346+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b18070cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:05.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.346+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b18070cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:05.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.747+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b18071210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:05.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.747+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b18071210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:05.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.747+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b180cf490 legacy=0x7f7b180c9ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:05.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.747+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b18070cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:05.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:05.747+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b18070cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:06.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:06.548+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b18071210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:06.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:06.548+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b18071210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:06.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:06.548+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b18070cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:06.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:06.548+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b18070cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:06.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:06.548+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b180cf490 legacy=0x7f7b180c9ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:08.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b18070cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:08.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b18070cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:08.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b18071210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:08.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b18071210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:08.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b180cf490 legacy=0x7f7b180c9ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:08.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 0x7f7b04005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:08.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b04006190 2024-04-22T06:43:08.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b040036c0 2024-04-22T06:43:08.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04006190 legacy=0x7f7b04008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:08.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:08.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.146+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:08.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.347+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04006190 legacy=0x7f7b04008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:08.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.347+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:08.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.347+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:08.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.748+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04006190 legacy=0x7f7b04008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:08.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.748+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:08.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:08.748+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:09.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:09.549+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04006190 legacy=0x7f7b04008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:09.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:09.549+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:09.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:09.549+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:11.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040036c0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04006190 legacy=0x7f7b04008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 0x7f7b0400a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b04005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b180cadd0 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04009ef0 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b04008d80 con 0x7f7b18155140 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:11.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400a960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:11.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.146+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:11.291 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:43:11.294 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:43:11.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.347+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:11.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.347+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:11.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.347+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400a960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:11.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.347+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:11.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.347+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:11.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.347+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:11.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.748+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:11.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.748+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:11.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.748+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:11.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.748+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400a960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:11.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.748+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:11.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:11.748+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:12.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:12.549+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:12.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:12.549+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:12.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:12.549+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:12.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:12.549+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400a960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:12.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:12.549+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:12.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:12.549+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:14.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400a960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:14.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:14.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:14.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04009ef0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:14.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:14.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b180cadd0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:14.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04008fa0 2024-04-22T06:43:14.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b040094b0 2024-04-22T06:43:14.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04008fa0 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:14.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.146+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:14.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.347+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04008fa0 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:14.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.347+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.748+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04008fa0 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:14.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:14.748+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:15.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:15.549+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04008fa0 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:15.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:15.549+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04008fa0 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b04017380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04013840 2024-04-22T06:43:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b040094b0 2024-04-22T06:43:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b18155140 2024-04-22T06:43:17.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04015c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:17.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b04017380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:17.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:17.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.147+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b04017380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:17.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.348+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04015c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:17.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.348+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:17.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.348+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b04017380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:17.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.348+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b04017380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:17.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.749+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04015c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:17.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.749+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:17.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.749+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b04017380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:17.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:17.749+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b04017380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:18.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:18.550+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04015c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:18.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:18.550+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:18.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:18.550+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b04017380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:18.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:18.550+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b04017380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:20.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b04017380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:20.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b04017380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040094b0 legacy=0x7f7b04012120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04015c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 0x7f7b04005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b0400f1f0 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b0400a9e0 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:20.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.147+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:20.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.348+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:20.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.348+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:20.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.348+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:20.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.348+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:20.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.749+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:20.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.749+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:20.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.749+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:20.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:20.749+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:21.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:21.550+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:21.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:21.550+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:21.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:21.550+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:21.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:21.550+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:23.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:23.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:23.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:23.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400f1f0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:23.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:23.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:23.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:23.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b04013840 2024-04-22T06:43:23.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b0400a9e0 2024-04-22T06:43:23.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b18155140 2024-04-22T06:43:23.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:23.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:23.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:23.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:23.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.147+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:23.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.348+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:23.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.348+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:23.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.348+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:23.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.348+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:23.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.348+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.749+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:23.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.749+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.749+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.749+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:23.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:23.749+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:24.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:24.550+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:24.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:24.550+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:24.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:24.550+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:24.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:24.550+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:24.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:24.550+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:26.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:26.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b18155140 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:26.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 msgr2=0x7f7b0400a310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:26.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a9e0 0x7f7b0400a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:26.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:26.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 0x7f7b04005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:26.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04014c30 2024-04-22T06:43:26.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04015800 2024-04-22T06:43:26.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:26.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:26.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.148+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:26.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.349+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:26.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.349+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:26.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.349+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:26.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.750+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:26.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.750+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:26.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:26.750+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:27.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:27.551+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:27.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:27.551+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:27.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:27.551+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:29.146 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015800 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 0x7f7b04011ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b04013840 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04014c30 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04016e40 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 msgr2=0x7f7b04011ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 0x7f7b04011ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.148+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:29.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.349+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:29.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.349+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 msgr2=0x7f7b04011ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:29.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.349+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 0x7f7b04011ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:29.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.349+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:29.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.750+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 msgr2=0x7f7b04011ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:29.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.750+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:29.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.750+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 0x7f7b04011ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:29.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:29.750+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:30.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:30.551+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:30.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:30.551+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 msgr2=0x7f7b04011ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:30.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:30.551+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 0x7f7b04011ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:30.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:30.551+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:32.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 msgr2=0x7f7b04011ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:32.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016e40 0x7f7b04011ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:32.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014c30 legacy=0x7f7b04015010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:32.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:32.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 0x7f7b04005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:32.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 0x7f7b0400f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:32.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b0400a310 2024-04-22T06:43:32.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b0400a9e0 2024-04-22T06:43:32.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:32.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:32.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:32.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.148+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:32.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.349+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:32.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.349+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:32.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.349+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:32.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.349+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:32.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.750+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:32.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.750+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:32.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.750+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:32.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:32.750+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:33.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:33.551+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:33.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:33.551+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:33.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:33.551+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:33.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:33.551+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:35.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:35.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b0400a9e0 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:35.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 msgr2=0x7f7b0400f790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:35.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400a310 0x7f7b0400f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:35.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 0x7f7b04008610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:35.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 0x7f7b04005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:35.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:35.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04013840 2024-04-22T06:43:35.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04014330 2024-04-22T06:43:35.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04013230 2024-04-22T06:43:35.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04013c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:35.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:35.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.148+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:35.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.149+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:35.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.149+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:35.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.349+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04013c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:35.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.350+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:35.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.350+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:35.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.350+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:35.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.350+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:35.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.750+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04013c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:35.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.751+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:35.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.751+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:35.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.751+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:35.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:35.751+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:36.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:36.551+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04013c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:36.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:36.552+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:36.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:36.552+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:36.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:36.552+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:36.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:36.552+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:38.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:38.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013230 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:38.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:38.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04014330 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:38.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013840 legacy=0x7f7b04013c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:38.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 0x7f7b040117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:38.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b04016e40 2024-04-22T06:43:38.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04014e20 2024-04-22T06:43:38.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 msgr2=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:38.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 0x7f7b040117a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:38.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.149+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04016e40 legacy=0x7f7b04014710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:38.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.350+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 msgr2=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:38.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.350+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 0x7f7b040117a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:38.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.350+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04016e40 legacy=0x7f7b04014710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:38.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.751+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 msgr2=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:38.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.751+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 0x7f7b040117a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:38.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:38.751+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04016e40 legacy=0x7f7b04014710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:39.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:39.552+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 msgr2=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:39.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:39.552+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 0x7f7b040117a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:39.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:39.552+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04016e40 legacy=0x7f7b04014710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:41.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 msgr2=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:41.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04014e20 0x7f7b040117a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04016e40 legacy=0x7f7b04014710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 0x7f7b04008610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 0x7f7b04005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04015260 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04016730 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04016350 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:41.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.149+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:41.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.350+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:41.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.350+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:41.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.350+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:41.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.350+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:41.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.350+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:41.655 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:43:41.658 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:43:41.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.751+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:41.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.751+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:41.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.751+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:41.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.751+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:41.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:41.751+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:42.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:42.552+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:42.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:42.552+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:42.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:42.552+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:42.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:42.552+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:42.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:42.552+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:44.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04016350 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 msgr2=0x7f7b04005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016730 0x7f7b04005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 0x7f7b040147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b0400bfe0 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b0400cb00 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400bfe0 legacy=0x7f7b0400c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 msgr2=0x7f7b040147c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:44.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.149+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 0x7f7b040147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:44.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.350+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400bfe0 legacy=0x7f7b0400c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:44.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.350+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 msgr2=0x7f7b040147c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:44.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.350+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 0x7f7b040147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:44.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.751+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400bfe0 legacy=0x7f7b0400c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:44.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.751+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 msgr2=0x7f7b040147c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:44.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:44.751+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 0x7f7b040147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:45.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:45.552+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400bfe0 legacy=0x7f7b0400c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:45.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:45.552+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 msgr2=0x7f7b040147c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:45.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:45.552+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 0x7f7b040147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:47.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 msgr2=0x7f7b040147c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:47.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400cb00 0x7f7b040147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:47.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400bfe0 legacy=0x7f7b0400c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:47.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:47.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b0400c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:47.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b04008610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b0400c900 2024-04-22T06:43:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04005b40 2024-04-22T06:43:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04015260 2024-04-22T06:43:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400c900 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:47.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.150+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:47.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.351+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400c900 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:47.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.351+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:47.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.351+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:47.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.351+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:47.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.351+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:47.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.752+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400c900 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:47.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.752+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:47.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.752+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:47.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.752+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:47.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:47.752+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:48.553+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400c900 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:48.553+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:48.553+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:48.553+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:48.553+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:50.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b04008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b04008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400c900 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 0x7f7b04012ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b040162f0 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04016700 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 msgr2=0x7f7b04012ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 0x7f7b04012ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:50.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.149+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040162f0 legacy=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:50.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.350+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 msgr2=0x7f7b04012ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:50.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.350+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 0x7f7b04012ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:50.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.350+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040162f0 legacy=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:50.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.751+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 msgr2=0x7f7b04012ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:50.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.751+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 0x7f7b04012ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:50.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:50.751+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040162f0 legacy=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:51.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:51.552+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 msgr2=0x7f7b04012ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:51.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:51.552+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 0x7f7b04012ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:51.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:51.552+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040162f0 legacy=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:53.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 msgr2=0x7f7b04012ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:53.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04016700 0x7f7b04012ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:53.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b040162f0 legacy=0x7f7b040117a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:53.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:53.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 0x7f7b0400c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:53.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:53.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04015260 2024-04-22T06:43:53.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04005b40 2024-04-22T06:43:53.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b0400c3c0 2024-04-22T06:43:53.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:53.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:53.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:53.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:53.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.149+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:53.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.350+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.350+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.350+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.350+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:53.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.350+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:53.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.751+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:53.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.751+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:53.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.751+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:53.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.751+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:53.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:53.751+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:54.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:54.552+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:43:54.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:54.552+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:43:54.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:54.552+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:54.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:54.552+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:54.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:54.552+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:56.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b0400c3c0 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 0x7f7b040136b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b0400f760 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b040132a0 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400f760 legacy=0x7f7b04011b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 msgr2=0x7f7b040136b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:56.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.150+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 0x7f7b040136b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:56.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.351+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400f760 legacy=0x7f7b04011b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:56.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.351+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 msgr2=0x7f7b040136b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:56.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.351+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 0x7f7b040136b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:56.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.752+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400f760 legacy=0x7f7b04011b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:56.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.752+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 msgr2=0x7f7b040136b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:56.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:56.752+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 0x7f7b040136b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:57.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:57.553+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 msgr2=0x7f7b040136b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:57.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:57.553+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400f760 legacy=0x7f7b04011b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:57.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:57.553+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 0x7f7b040136b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:43:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 msgr2=0x7f7b040136b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040132a0 0x7f7b040136b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:43:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400f760 legacy=0x7f7b04011b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:43:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:43:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b0400c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:43:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b0400c3c0 2024-04-22T06:43:59.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04005b40 2024-04-22T06:43:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04015260 2024-04-22T06:43:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400c3c0 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:59.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.150+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:43:59.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.351+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400c3c0 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:59.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.351+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:59.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.351+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:59.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.351+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:59.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.351+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:43:59.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.752+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400c3c0 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:43:59.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.752+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:43:59.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.752+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:43:59.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.752+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:43:59.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:43:59.752+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:00.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:00.553+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:00.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:00.553+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:00.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:00.553+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400c3c0 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:00.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:00.553+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:00.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:00.553+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:02.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:02.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:02.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b0400c7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:02.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04005b40 0x7f7b0400c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:02.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b0400c3c0 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:02.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 0x7f7b0400baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:02.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b04013b60 2024-04-22T06:44:02.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b0400b6c0 2024-04-22T06:44:02.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 msgr2=0x7f7b0400baa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:02.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013b60 legacy=0x7f7b04013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:02.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.150+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 0x7f7b0400baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:02.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.351+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 msgr2=0x7f7b0400baa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:02.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.351+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013b60 legacy=0x7f7b04013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:02.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.351+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 0x7f7b0400baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:02.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.752+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013b60 legacy=0x7f7b04013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:02.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.752+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 msgr2=0x7f7b0400baa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:02.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:02.752+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 0x7f7b0400baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:03.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:03.553+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013b60 legacy=0x7f7b04013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:03.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:03.553+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 msgr2=0x7f7b0400baa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:03.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:03.553+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 0x7f7b0400baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:05.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 msgr2=0x7f7b0400baa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b0400b6c0 0x7f7b0400baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04013b60 legacy=0x7f7b04013f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04014720 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04005b40 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04015260 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:05.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:05.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014720 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:05.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:05.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.150+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:05.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.351+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:05.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.351+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:05.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.351+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014720 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:05.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.351+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:05.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.351+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:05.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.752+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:05.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.752+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:05.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.752+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014720 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:05.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.752+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:05.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:05.752+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:06.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:06.553+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:06.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:06.553+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:06.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:06.553+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:06.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:06.553+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014720 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:06.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:06.553+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:08.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04015be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04015be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 msgr2=0x7f7b040085b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005b40 0x7f7b040085b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04014720 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 0x7f7b04013a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b0400fb40 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04013650 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400fb40 legacy=0x7f7b04011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 msgr2=0x7f7b04013a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:08.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.151+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 0x7f7b04013a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:08.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.352+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400fb40 legacy=0x7f7b04011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:08.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.352+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 msgr2=0x7f7b04013a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:08.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.352+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 0x7f7b04013a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.753+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400fb40 legacy=0x7f7b04011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:08.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.753+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 msgr2=0x7f7b04013a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:08.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:08.753+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 0x7f7b04013a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:09.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:09.554+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400fb40 legacy=0x7f7b04011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:09.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:09.554+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 msgr2=0x7f7b04013a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:09.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:09.554+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 0x7f7b04013a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 msgr2=0x7f7b04013a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04013650 0x7f7b04013a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b0400fb40 legacy=0x7f7b04011f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04005ae0 2024-04-22T06:44:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b04015260 2024-04-22T06:44:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04015be0 2024-04-22T06:44:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b0400fb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:11.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.151+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:11.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.352+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b0400fb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:11.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.352+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:11.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.352+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:11.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.352+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:11.724 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:44:11.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:44:11.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.753+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b0400fb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:11.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.753+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:11.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.753+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:11.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:11.753+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:12.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:12.554+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b0400fb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:12.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:12.554+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:12.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:12.554+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:12.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:12.554+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:14.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.151+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:14.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.151+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:14.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.151+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:14.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.151+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b0400fb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:14.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.151+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 0x7f7b04013650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:14.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.151+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 0x7f7b04013fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:14.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.151+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04013b90 2024-04-22T06:44:14.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.152+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04011260 2024-04-22T06:44:14.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.152+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 msgr2=0x7f7b04013fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:14.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.152+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 0x7f7b04013fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:14.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.152+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 msgr2=0x7f7b04013650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:14.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.152+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 0x7f7b04013650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:14.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.353+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 msgr2=0x7f7b04013fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:14.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.353+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 0x7f7b04013fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:14.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.353+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 msgr2=0x7f7b04013650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:14.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.353+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 0x7f7b04013650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.754+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 msgr2=0x7f7b04013fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.754+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 0x7f7b04013fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.754+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 msgr2=0x7f7b04013650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:14.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:14.754+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 0x7f7b04013650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:15.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:15.555+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 msgr2=0x7f7b04013fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:15.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:15.555+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 0x7f7b04013fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:15.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:15.555+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 msgr2=0x7f7b04013650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:15.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:15.555+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 0x7f7b04013650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 msgr2=0x7f7b04013650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04011260 0x7f7b04013650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 msgr2=0x7f7b04013fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:17.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04013b90 0x7f7b04013fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04005ae0 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04015260 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04015be0 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:17.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.152+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:17.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.353+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:17.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.353+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:17.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.353+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:17.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.353+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:17.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.754+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:17.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.754+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:17.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.754+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:17.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:17.754+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:18.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:18.555+0000 7f7b1e56a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:18.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:18.555+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:18.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:18.555+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:18.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:18.555+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:20.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040144e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 0x7f7b04012f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 0x7f7b040138c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04010b50 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b040134b0 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 msgr2=0x7f7b04012f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 0x7f7b04012f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 msgr2=0x7f7b040138c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:20.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.152+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 0x7f7b040138c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:20.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.353+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 msgr2=0x7f7b04012f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:20.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.353+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 0x7f7b04012f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:20.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.353+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 msgr2=0x7f7b040138c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:20.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.353+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 0x7f7b040138c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:20.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.754+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 msgr2=0x7f7b04012f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:20.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.754+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 0x7f7b04012f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:20.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.754+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 msgr2=0x7f7b040138c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:20.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:20.754+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 0x7f7b040138c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:21.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:21.555+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 msgr2=0x7f7b04012f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:21.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:21.555+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 0x7f7b04012f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:21.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:21.555+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 msgr2=0x7f7b040138c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:21.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:21.555+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 0x7f7b040138c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 msgr2=0x7f7b040138c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040134b0 0x7f7b040138c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 msgr2=0x7f7b04012f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04010b50 0x7f7b04012f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04007cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b04015be0 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04015260 2024-04-22T06:44:23.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04005ae0 2024-04-22T06:44:23.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04007cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:23.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:23.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04007cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:23.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.152+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:23.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.353+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04007cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:23.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.353+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:23.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.353+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04007cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:23.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.353+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:23.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.754+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04007cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.754+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.754+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04007cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:23.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:23.754+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:24.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:24.555+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:24.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:24.555+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04007cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:24.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:24.555+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04007cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:24.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:24.555+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04007cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04007cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04013b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 0x7f7b040140a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b040085e0 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04008200 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 msgr2=0x7f7b040140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 0x7f7b040140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:26.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.153+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.354+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.354+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 msgr2=0x7f7b040140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.354+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:26.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.354+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 0x7f7b040140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:26.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.755+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 msgr2=0x7f7b040140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:26.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.755+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:26.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.755+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 0x7f7b040140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:26.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:26.755+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:27.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:27.556+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 msgr2=0x7f7b040140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:27.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:27.556+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 0x7f7b040140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:27.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:27.556+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:27.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:27.556+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:29.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:29.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:29.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 msgr2=0x7f7b040140a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:29.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040085e0 0x7f7b040140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:29.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 0x7f7b0401b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04011b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04015260 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b040145e0 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04008200 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 msgr2=0x7f7b0401b240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 0x7f7b0401b240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:29.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.153+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:29.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.354+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:29.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.354+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 msgr2=0x7f7b0401b240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:29.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.354+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:29.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.354+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 0x7f7b0401b240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:29.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.354+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:29.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.755+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:29.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.755+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 msgr2=0x7f7b0401b240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:29.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.755+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:29.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.755+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 0x7f7b0401b240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:29.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:29.755+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:30.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:30.556+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:30.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:30.556+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:30.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:30.556+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 msgr2=0x7f7b0401b240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:30.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:30.556+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:30.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:30.556+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 0x7f7b0401b240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:32.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:32.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04008200 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:32.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 msgr2=0x7f7b0401b240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040145e0 0x7f7b0401b240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b040149c0 2024-04-22T06:44:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04015be0 2024-04-22T06:44:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b040149c0 legacy=0x7f7b04006ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:32.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.153+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:32.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.353+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b040149c0 legacy=0x7f7b04006ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:32.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.353+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:32.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.353+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:32.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.754+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:32.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.754+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b040149c0 legacy=0x7f7b04006ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:32.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:32.754+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:33.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:33.555+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b040149c0 legacy=0x7f7b04006ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:33.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:33.555+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:33.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:33.555+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:35.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b040065a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:35.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b040065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:35.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b040149c0 legacy=0x7f7b04006ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:35.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:35.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b04011b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:35.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04005ae0 2024-04-22T06:44:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1806bb70 con 0x7f7b04015260 2024-04-22T06:44:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04015be0 2024-04-22T06:44:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040071f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:35.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.153+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:35.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.354+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040071f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:35.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.354+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:35.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.354+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:35.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.354+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:35.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.755+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040071f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:35.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.755+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:35.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.755+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:35.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:35.755+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:36.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:36.556+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040071f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:36.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:36.556+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:36.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:36.556+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:36.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:36.556+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:38.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b04011b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:38.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b04011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:38.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:38.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b040071f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:38.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:38.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 0x7f7b040069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:38.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b040140a0 2024-04-22T06:44:38.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b040065a0 2024-04-22T06:44:38.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:38.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:38.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 msgr2=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:38.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.153+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 0x7f7b040069b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:38.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.354+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:38.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.354+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:38.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.354+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 msgr2=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:38.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.354+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 0x7f7b040069b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:38.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.755+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:38.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.755+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:38.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.755+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 msgr2=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:38.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:38.755+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 0x7f7b040069b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:39.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:39.556+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:39.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:39.556+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:39.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:39.556+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 msgr2=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:39.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:39.556+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 0x7f7b040069b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:41.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 msgr2=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b040065a0 0x7f7b040069b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04007ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04015be0 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b040140a0 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04007900 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:41.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:41.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.153+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:41.352 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.354+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:41.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.354+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:41.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.354+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:41.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.354+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:41.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.354+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.755+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.755+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.755+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.755+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:41.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:41.755+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:41.852 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:44:41.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:44:42.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:42.556+0000 7f7b1dd69640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:42.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:42.556+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:42.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:42.556+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:42.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:42.556+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:42.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:42.556+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:44.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:44.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:44.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:44.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:44.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015be0 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:44.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 0x7f7b04004ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:44.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04015260 2024-04-22T06:44:44.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b040070c0 2024-04-22T06:44:44.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:44.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 msgr2=0x7f7b04004ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:44.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.154+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 0x7f7b04004ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:44.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.355+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 msgr2=0x7f7b04004ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:44.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.355+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 0x7f7b04004ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:44.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.355+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:44.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.756+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 msgr2=0x7f7b04004ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:44.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.756+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 0x7f7b04004ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:44.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:44.756+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:45.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:45.557+0000 7f7b1dd69640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 msgr2=0x7f7b04004ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:45.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:45.557+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:45.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:45.557+0000 7f7b1dd69640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 0x7f7b04004ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:47.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 msgr2=0x7f7b04004ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:47.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040070c0 0x7f7b04004ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:47.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04015260 legacy=0x7f7b040069b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:47.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:47.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04013b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b04007ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04015260 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04015be0 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04007900 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:47.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.154+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:47.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.355+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:47.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.355+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:47.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.355+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:47.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.355+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:47.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.355+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:47.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.756+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:47.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.756+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:47.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.756+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:47.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.756+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:47.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:47.756+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:48.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:48.557+0000 7f7b1ed6b640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:48.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:48.557+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:48.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:48.557+0000 7f7b1ed6b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:48.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:48.557+0000 7f7b1e56a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:48.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:48.557+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:50.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 msgr2=0x7f7b04013b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:50.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04007900 0x7f7b04013b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:50.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b04007ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:50.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04015be0 0x7f7b04007ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:50.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04015260 legacy=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:50.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:50.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04005ae0 2024-04-22T06:44:50.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b040140a0 2024-04-22T06:44:50.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:50.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:50.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.155+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:50.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.356+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:50.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.356+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:50.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.356+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:50.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.757+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:50.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.757+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:50.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:50.757+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:51.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:51.558+0000 7f7b1dd69640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:51.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:51.558+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:51.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:51.558+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:53.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 msgr2=0x7f7b04014480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b040140a0 0x7f7b04014480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04005ae0 legacy=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04007090 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04015be0 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04015260 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0401c250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:53.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:53.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.155+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:53.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.356+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:53.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.356+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0401c250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:53.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.356+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:53.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.356+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:53.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.356+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:53.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.757+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.757+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.757+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.757+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0401c250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:53.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:53.757+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:54.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:54.558+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:44:54.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:54.558+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:54.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:54.558+0000 7f7b1ed6b640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:44:54.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:54.558+0000 7f7b1e56a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0401c250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:54.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:54.558+0000 7f7b1ed6b640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b17fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b17fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0401c250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04019770 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04005ae0 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:56.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:56.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.155+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:56.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.356+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:56.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.356+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:56.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.356+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:56.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.757+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:56.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.757+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:56.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:56.757+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:57.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:57.558+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:57.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:57.558+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:57.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:57.558+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:44:59.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:59.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:44:59.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:44:59.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:44:59.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b1ed6b640 1 -- reap_dead start 2024-04-22T06:44:59.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b17fff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b04009a30 con 0x7f7b04019770 2024-04-22T06:44:59.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b17fff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815bd50 con 0x7f7b04007090 2024-04-22T06:44:59.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b17fff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04005ae0 2024-04-22T06:44:59.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.155+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:59.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.156+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:59.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.156+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:44:59.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.156+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0400b6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:59.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.357+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:59.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.357+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:59.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.357+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:44:59.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.357+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0400b6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:44:59.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.758+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:44:59.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.758+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:44:59.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.758+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:44:59.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:44:59.758+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0400b6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:00.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:00.559+0000 7f7b1e56a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:00.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:00.559+0000 7f7b1dd69640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:00.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:00.559+0000 7f7b1e56a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:00.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:00.559+0000 7f7b1ed6b640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0400b6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:02.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b17fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 msgr2=0x7f7b04019230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:02.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b17fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7b04005ae0 0x7f7b04019230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:02.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b17fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f7b04007090 legacy=0x7f7b0400b6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:02.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b17fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f7b04019770 legacy=0x7f7b0400afb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:02.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b17fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:02.154 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b17fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:02.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b17fff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806b920 con 0x7f7b04015260 2024-04-22T06:45:02.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b17fff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1806c4a0 con 0x7f7b04015be0 2024-04-22T06:45:02.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:02.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:02.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:02.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.156+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:02.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.357+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:02.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.357+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:02.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.357+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:02.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.357+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:02.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.758+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:02.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.758+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:02.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.758+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:02.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:02.758+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:03.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:03.559+0000 7f7b1dd69640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 msgr2=0x7f7b04006980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:03.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:03.559+0000 7f7b1dd69640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f7b04015260 0x7f7b04006980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:03.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:03.559+0000 7f7b1e56a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 msgr2=0x7f7b0400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:03.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:03.559+0000 7f7b1e56a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7b04015be0 0x7f7b0400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:05.065 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-22T06:45:05.067 INFO:tasks.ceph:Scrubbing osd.7 2024-04-22T06:45:05.067 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-22T06:45:05.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.181+0000 7fb0baffd640 1 Processor -- start 2024-04-22T06:45:05.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.181+0000 7fb0baffd640 1 -- start start 2024-04-22T06:45:05.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0baffd640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 0x7fb0b406e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0baffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 0x7fb0b406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0baffd640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0b41555d0 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0baffd640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0b40c30b0 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0baffd640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0b41551f0 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0b41555d0 legacy=0x7fb0b40c29a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 msgr2=0x7fb0b406e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 0x7fb0b406e590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 msgr2=0x7fb0b406e050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:05.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.182+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 0x7fb0b406e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:05.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.383+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0b41555d0 legacy=0x7fb0b40c29a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:05.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.383+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 msgr2=0x7fb0b406e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:05.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.383+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 0x7fb0b406e590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:05.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.383+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 msgr2=0x7fb0b406e050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:05.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.383+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 0x7fb0b406e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:05.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.784+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 msgr2=0x7fb0b406e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:05.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.784+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0b41555d0 legacy=0x7fb0b40c29a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:05.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.784+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 0x7fb0b406e590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:05.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.784+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 msgr2=0x7fb0b406e050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:05.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:05.784+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 0x7fb0b406e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:06.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:06.585+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0b41555d0 legacy=0x7fb0b40c29a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:06.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:06.585+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 msgr2=0x7fb0b406e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:06.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:06.585+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 0x7fb0b406e590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:06.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:06.585+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 msgr2=0x7fb0b406e050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:06.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:06.585+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 0x7fb0b406e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:08.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.182+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 msgr2=0x7fb0b406e050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:08.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.182+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0b41551f0 0x7fb0b406e050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:08.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.182+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 msgr2=0x7fb0b406e590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:08.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.182+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0b40c30b0 0x7fb0b406e590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:08.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.182+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0b41555d0 legacy=0x7fb0b40c29a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:08.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.182+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 0x7fb0a00098e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:08.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.182+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a00036e0 2024-04-22T06:45:08.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.182+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0007420 2024-04-22T06:45:08.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.183+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00036e0 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:08.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.183+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:08.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.183+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:08.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.384+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:08.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.384+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00036e0 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:08.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.384+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:08.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.785+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00036e0 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:08.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.785+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:08.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:08.785+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:09.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:09.586+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:09.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:09.586+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00036e0 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:09.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:09.586+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:11.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:11.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0007420 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:11.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00036e0 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 0x7fb0a000a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a0006290 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0009fa0 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a000a8c0 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 msgr2=0x7fb0a000a380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 0x7fb0a000a380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:11.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.183+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:11.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.384+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:11.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.384+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 msgr2=0x7fb0a000a380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:11.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.384+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 0x7fb0a000a380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:11.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.384+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:11.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.384+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:11.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.785+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 msgr2=0x7fb0a000a380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:11.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.785+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:11.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.785+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 0x7fb0a000a380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:11.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.785+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:11.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:11.785+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:11.906 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:45:11.909 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:45:12.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:12.586+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 msgr2=0x7fb0a000a380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:12.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:12.586+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:12.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:12.586+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 0x7fb0a000a380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:12.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:12.586+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:12.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:12.586+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:14.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:14.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 msgr2=0x7fb0a000a380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0009fa0 0x7fb0a000a380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 0x7fb0a00134f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a0006720 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0011100 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006720 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 msgr2=0x7fb0a00134f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:14.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.183+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 0x7fb0a00134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:14.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.384+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 msgr2=0x7fb0a00134f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:14.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.384+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006720 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:14.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.384+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 0x7fb0a00134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:14.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.785+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 msgr2=0x7fb0a00134f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:14.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.785+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006720 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:14.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:14.785+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 0x7fb0a00134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:15.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:15.586+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006720 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:15.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:15.586+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 msgr2=0x7fb0a00134f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:15.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:15.586+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 0x7fb0a00134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:17.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 msgr2=0x7fb0a00134f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:17.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0011100 0x7fb0a00134f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:17.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006720 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:17.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:17.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:17.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a0006290 2024-04-22T06:45:17.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a000a380 2024-04-22T06:45:17.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000a8c0 2024-04-22T06:45:17.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:17.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:17.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:17.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.183+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:17.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.384+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:17.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.384+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:17.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.384+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:17.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.384+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:17.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.785+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:17.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.785+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:17.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.785+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:17.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:17.785+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:18.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:18.586+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:18.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:18.586+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:18.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:18.586+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:18.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:18.586+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:20.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 msgr2=0x7fb0a00098e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:20.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a8c0 0x7fb0a00098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:20.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 0x7fb0a0013f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 0x7fb0a00100f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0014490 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0013b70 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 msgr2=0x7fb0a0013f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:20.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.183+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 0x7fb0a0013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:20.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.384+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:20.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.384+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:20.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.384+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 msgr2=0x7fb0a0013f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:20.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.384+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 0x7fb0a0013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:20.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.785+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:20.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.785+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:20.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.785+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 msgr2=0x7fb0a0013f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:20.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:20.785+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 0x7fb0a0013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:21.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:21.586+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:21.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:21.586+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:21.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:21.586+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 msgr2=0x7fb0a0013f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:21.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:21.586+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 0x7fb0a0013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:23.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 msgr2=0x7fb0a0013f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0013b70 0x7fb0a0013f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014490 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a0006b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 0x7fb0a0013b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a0006290 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000a840 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a000a380 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:23.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:23.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:23.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:23.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.183+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a0006b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:23.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.384+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:23.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.384+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:23.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.384+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:23.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.384+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:23.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.384+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a0006b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.785+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.785+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.785+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.785+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:23.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:23.785+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a0006b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:24.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:24.586+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:24.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:24.586+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:24.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:24.586+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:24.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:24.586+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:24.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:24.586+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a0006b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:26.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a0006b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:26.182 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a0006b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:26.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:26.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a840 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:26.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:26.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 0x7fb0a000f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:26.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a00140b0 2024-04-22T06:45:26.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a00098e0 2024-04-22T06:45:26.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 msgr2=0x7fb0a000f800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:26.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:26.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.183+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 0x7fb0a000f800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:26.382 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.384+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:26.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.384+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 msgr2=0x7fb0a000f800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:26.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.384+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 0x7fb0a000f800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.785+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 msgr2=0x7fb0a000f800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.785+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:26.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:26.785+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 0x7fb0a000f800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:27.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:27.586+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:27.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:27.586+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 msgr2=0x7fb0a000f800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:27.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:27.586+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 0x7fb0a000f800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 msgr2=0x7fb0a000f800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098e0 0x7fb0a000f800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a0006290 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a000a840 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000a380 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:29.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:29.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:29.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.184+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:29.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.385+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:29.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.385+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:29.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.385+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:29.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.385+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:29.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.786+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:29.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.786+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:29.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.786+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:29.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:29.786+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:30.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:30.587+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:30.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:30.587+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:30.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:30.587+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:30.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:30.587+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:32.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:32.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:32.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:32.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:32.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 0x7fb0a00100f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:32.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 0x7fb0a0010a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:32.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0010630 2024-04-22T06:45:32.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a00098e0 2024-04-22T06:45:32.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:32.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 msgr2=0x7fb0a0010a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:32.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:32.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.184+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 0x7fb0a0010a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:32.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.385+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:32.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.385+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 msgr2=0x7fb0a0010a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:32.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.385+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:32.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.385+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 0x7fb0a0010a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:32.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.786+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:32.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.786+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 msgr2=0x7fb0a0010a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:32.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.786+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:32.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:32.786+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 0x7fb0a0010a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:33.587+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 msgr2=0x7fb0a0010a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:33.587+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:33.587+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 0x7fb0a0010a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:33.585 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:33.587+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:35.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 msgr2=0x7fb0a00100f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a00098e0 0x7fb0a00100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 msgr2=0x7fb0a0010a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0010630 0x7fb0a0010a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000a380 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0006290 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a0014870 con 0x7fb0a000a840 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:35.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:35.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:35.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b959a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0003b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:35.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:35.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.185+0000 7fb0b959a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0003b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:35.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.386+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:35.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.386+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:35.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.386+0000 7fb0b959a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0003b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:35.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.386+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:35.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.386+0000 7fb0b959a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0003b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:35.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.386+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:35.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.787+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:35.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.787+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:35.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.787+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:35.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.787+0000 7fb0b959a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0003b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:35.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.787+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:35.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:35.787+0000 7fb0b959a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0003b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:36.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:36.588+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:36.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:36.588+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:36.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:36.588+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:36.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:36.588+0000 7fb0b959a640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0003b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:36.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:36.588+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:36.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:36.588+0000 7fb0b959a640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0003b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0003b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0003b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:38.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a00098a0 2024-04-22T06:45:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a00140b0 2024-04-22T06:45:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:38.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.185+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:38.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.386+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:38.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.386+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:38.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.787+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:38.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:38.787+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:39.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:39.588+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:39.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:39.588+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:41.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:41.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:41.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:41.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:41.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a000a380 2024-04-22T06:45:41.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a00140b0 2024-04-22T06:45:41.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0006290 2024-04-22T06:45:41.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0007890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:41.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:41.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:41.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.185+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:41.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.386+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0007890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:41.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.386+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:41.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.386+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:41.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.386+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:41.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.787+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0007890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:41.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.787+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:41.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.787+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:41.785 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:41.787+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:42.191 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:45:42.194 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:45:42.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:42.588+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0007890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:42.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:42.588+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:42.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:42.588+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:42.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:42.588+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.185+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.185+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.185+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.185+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0007890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.185+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.185+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 0x7fb0a0010800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.185+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0003af0 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.185+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a000a840 2024-04-22T06:45:44.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.186+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:44.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.186+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:44.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.186+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:44.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.186+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:44.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.387+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:44.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.387+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:44.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.387+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:44.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.387+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:44.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.788+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:44.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.788+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:44.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.788+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:44.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:44.788+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:45.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:45.589+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:45.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:45.589+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:45.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:45.589+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:45.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:45.589+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:47.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:47.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0003af0 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0010800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000a380 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0006290 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a0014870 con 0x7fb0a000a840 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:47.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:47.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:47.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.186+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.387+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.387+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.387+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.387+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.387+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.387+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:47.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.788+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:47.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.788+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:47.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.788+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:47.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.788+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:47.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.788+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:47.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:47.788+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:48.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:48.589+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:48.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:48.589+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:48.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:48.589+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:48.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:48.589+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:48.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:48.589+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:48.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:48.589+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:50.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:50.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:50.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:50.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:50.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:50.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000a380 0x7fb0a0010800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:50.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a00098a0 2024-04-22T06:45:50.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a00140b0 2024-04-22T06:45:50.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:50.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.186+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:50.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.387+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:50.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.387+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:50.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.788+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:50.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:50.788+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:51.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:51.589+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:51.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:51.589+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:53.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a00140b0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:53.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:53.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:53.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:53.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 0x7fb0a000e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:53.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a0006290 2024-04-22T06:45:53.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000a380 2024-04-22T06:45:53.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a000a840 2024-04-22T06:45:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.187+0000 7fb0b959a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.187+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.186+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.187+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:53.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.187+0000 7fb0b959a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:53.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.388+0000 7fb0b959a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:53.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.388+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:53.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.388+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:53.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.388+0000 7fb0b959a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:53.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.388+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:53.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.789+0000 7fb0b959a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:53.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.789+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:53.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.789+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:53.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.789+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:53.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:53.789+0000 7fb0b959a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:54.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:54.590+0000 7fb0b959a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:54.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:54.590+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:54.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:54.590+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:54.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:54.590+0000 7fb0b959a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:54.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:54.590+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a000a380 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0010800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a0013f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a00098a0 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0013b50 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a0013f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:56.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:56.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.187+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a0013f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:56.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.388+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:56.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.388+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a0013f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:56.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.388+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a0013f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:56.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.789+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a0013f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:56.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.789+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:56.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:56.789+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a0013f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:57.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:57.590+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a0013f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:45:57.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:57.590+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:45:57.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:57.590+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a0013f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:45:59.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a0013f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a0013f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a000a380 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0006290 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a000a840 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:59.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:59.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.187+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:45:59.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.387+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:59.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.387+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:59.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.387+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:59.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.387+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:59.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.387+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:45:59.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.788+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:45:59.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.788+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:45:59.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.788+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:45:59.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.788+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:45:59.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:45:59.788+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:00.589+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:00.589+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:00.589+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:00.589+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:00.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:00.589+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:02.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:02.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:02.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:02.185 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:02.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:02.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:02.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a00098a0 2024-04-22T06:46:02.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0014090 2024-04-22T06:46:02.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:02.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:02.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.186+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:02.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.387+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:02.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.387+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:02.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.387+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:02.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.788+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:02.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.788+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:02.786 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:02.788+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:03.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:03.589+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:03.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:03.589+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:03.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:03.589+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:05.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:05.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:05.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a0014ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:05.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:05.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:05.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:05.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a00098a0 2024-04-22T06:46:05.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0014090 2024-04-22T06:46:05.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0006290 2024-04-22T06:46:05.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:05.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:05.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:05.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:05.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.187+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:05.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.388+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:05.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.388+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:05.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.388+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:05.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.388+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:05.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.388+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:05.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.789+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:05.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.789+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:05.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.789+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:05.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.789+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:05.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:05.789+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:06.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:06.590+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:06.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:06.590+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:06.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:06.590+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:06.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:06.590+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:06.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:06.590+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:08.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:08.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:08.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 msgr2=0x7fb0a000e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:08.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0014090 0x7fb0a000e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:08.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a00098a0 legacy=0x7fb0a000d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:08.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:08.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a000a380 2024-04-22T06:46:08.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000a840 2024-04-22T06:46:08.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:08.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:08.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.187+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:08.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.388+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:08.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.388+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:08.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.388+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:08.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.789+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:08.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.789+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:08.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:08.789+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:09.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:09.590+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:09.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:09.590+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:09.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:09.590+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:11.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:11.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0010630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a000a380 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0006290 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a000a840 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:11.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.187+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:11.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.388+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:11.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.388+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:11.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.388+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:11.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.388+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:11.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.388+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:11.787 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.789+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:11.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.789+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:11.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.789+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:11.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.789+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:11.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:11.789+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:12.522 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:46:12.525 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:46:12.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:12.590+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:12.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:12.590+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:12.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:12.590+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:12.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:12.590+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:12.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:12.590+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:14.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a840 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0010630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0010630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a380 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 0x7fb0a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a000e0e0 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a00098a0 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:14.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.188+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:14.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.389+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:14.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.389+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:14.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.389+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:14.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.790+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:14.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.790+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:14.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:14.790+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:15.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:15.591+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:15.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:15.591+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:15.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:15.591+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:17.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:17.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a00098a0 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:17.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:17.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:17.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:17.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:17.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a000a840 2024-04-22T06:46:17.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0006290 2024-04-22T06:46:17.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0005720 2024-04-22T06:46:17.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:17.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:17.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:17.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:17.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.188+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:17.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.389+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:17.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.389+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:17.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.389+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:17.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.389+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:17.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.389+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.790+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.790+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.790+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.790+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:17.790+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:18.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:18.591+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:18.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:18.591+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:18.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:18.591+0000 7fb0b959a640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:18.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:18.591+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:18.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:18.591+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:20.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:20.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:20.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:20.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:20.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:20.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:20.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a000e0e0 2024-04-22T06:46:20.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000a380 2024-04-22T06:46:20.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:20.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:20.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.188+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:20.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.389+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:20.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.389+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:20.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.389+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:20.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.790+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:20.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.790+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:20.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:20.790+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:21.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:21.592+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:21.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:21.592+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:21.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:21.592+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:23.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:23.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000a380 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:23.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000e0e0 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0018ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a0006290 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0005720 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a000e600 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0018ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0018ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:23.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.189+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:23.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.390+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:23.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.390+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0018ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:23.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.390+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:23.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.390+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0018ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:23.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.390+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.791+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.791+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.791+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0018ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.791+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:23.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:23.791+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0018ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:24.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:24.592+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:24.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:24.592+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0018ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:24.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:24.592+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:24.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:24.592+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0018ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:24.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:24.592+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:26.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0018ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:26.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0018ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:26.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:26.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:26.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:26.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:26.187 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a000a840 2024-04-22T06:46:26.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000e0e0 2024-04-22T06:46:26.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:26.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:26.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.189+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:26.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.390+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:26.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.390+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:26.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.390+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:26.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.791+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:26.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.791+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:26.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:26.791+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:27.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:27.592+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:27.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:27.592+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:27.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:27.592+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a840 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a0006290 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000e0e0 2024-04-22T06:46:29.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0005720 2024-04-22T06:46:29.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:29.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:29.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:29.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:29.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.189+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:29.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.390+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.390+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.390+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.391+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:29.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.391+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:29.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.791+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.791+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.791+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.792+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:29.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:29.792+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:30.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:30.592+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:30.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:30.592+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:30.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:30.592+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:30.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:30.593+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:30.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:30.593+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a000a790 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000e600 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:32.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.190+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:32.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.391+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:32.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.391+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:32.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.391+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:32.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.792+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:32.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.793+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:32.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:32.793+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:33.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:33.594+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:33.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:33.594+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:33.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:33.594+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:35.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:35.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a000e600 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:35.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:35.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:35.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 0x7fb0a0018ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:35.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:35.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a000e0e0 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0005720 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a0014870 con 0x7fb0a0016ad0 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 msgr2=0x7fb0a0018ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 0x7fb0a0018ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:35.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.190+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:35.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.391+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:35.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.391+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:35.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.391+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 msgr2=0x7fb0a0018ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:35.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.391+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:35.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.391+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 0x7fb0a0018ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:35.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.391+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:35.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.792+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:35.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.792+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:35.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.792+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 msgr2=0x7fb0a0018ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:35.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.792+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 0x7fb0a0018ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:35.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.792+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:35.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:35.792+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:36.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:36.593+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:36.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:36.593+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:36.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:36.593+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 msgr2=0x7fb0a0018ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:36.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:36.593+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 0x7fb0a0018ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:36.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:36.593+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:36.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:36.593+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:38.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 msgr2=0x7fb0a0018ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:38.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0016ad0 0x7fb0a0018ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:38.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:38.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005720 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:38.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:38.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a000e0e0 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:38.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a000a790 2024-04-22T06:46:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a0006290 2024-04-22T06:46:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:38.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.190+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:38.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.391+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:38.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.391+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:38.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.792+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:38.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:38.792+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:39.590 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:39.593+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:39.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:39.593+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:41.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a0006290 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a000a790 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0013b50 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0006290 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:41.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.190+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:41.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.391+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:41.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.391+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:41.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.391+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:41.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.391+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:41.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.391+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:41.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.792+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:41.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.792+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:41.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.792+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:41.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.792+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:41.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:41.792+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:42.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:42.593+0000 7fb0b8d99640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:42.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:42.593+0000 7fb0b959a640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:42.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:42.593+0000 7fb0b959a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:42.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:42.593+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:42.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:42.593+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:42.666 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:46:42.669 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:46:44.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:44.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:44.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:44.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:44.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0003ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:44.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:44.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a000d0b0 2024-04-22T06:46:44.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0005720 2024-04-22T06:46:44.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:44.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:44.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.190+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:44.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.391+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:44.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.391+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:44.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.392+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.793+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:44.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.793+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:44.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:44.794+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:45.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:45.594+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:45.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:45.594+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:45.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:45.596+0000 7fb0b3fff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:47.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 msgr2=0x7fb0a0005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:47.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0005720 0x7fb0a0005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:47.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:47.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:47.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a000a790 2024-04-22T06:46:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b415bad0 con 0x7fb0a000d0b0 2024-04-22T06:46:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0013b50 2024-04-22T06:46:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.190+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:47.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.191+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:47.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.391+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:47.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.391+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:47.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.391+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.392+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:47.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.792+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:47.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.792+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:47.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.792+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:47.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:47.794+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:48.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:48.593+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:48.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:48.593+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:48.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:48.593+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:48.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:48.595+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:50.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.190+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 msgr2=0x7fb0a00051e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:50.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0013b50 0x7fb0a00051e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:50.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.190+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d0b0 legacy=0x7fb0a000d4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:50.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.190+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:50.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.190+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:50.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.190+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:50.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.190+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0006290 2024-04-22T06:46:50.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.190+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0004ad0 2024-04-22T06:46:50.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.191+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:50.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.191+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:50.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.191+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:50.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.191+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:50.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.392+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:50.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.392+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:50.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.392+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:50.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.392+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:50.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.793+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:50.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.793+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:50.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.794+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:50.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:50.794+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:51.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:51.595+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:51.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:51.595+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:51.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:51.595+0000 7fb0b8d99640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:51.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:51.595+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:53.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 msgr2=0x7fb0a0006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0006290 0x7fb0a0006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a0019af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a000a790 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0005c60 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0004ad0 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:53.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:53.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a0019af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:53.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:53.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.191+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a0019af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:53.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.392+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:53.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.393+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a0019af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:53.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.393+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a0019af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:53.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.393+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:53.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.393+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:53.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.793+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:53.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.795+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:53.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.795+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a0019af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:53.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.795+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:53.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:53.795+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a0019af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:54.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:54.594+0000 7fb0b959a640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:46:54.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:54.596+0000 7fb0b3fff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a0019af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:54.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:54.596+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a0019af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:54.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:54.596+0000 7fb0b8d99640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:54.595 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:54.596+0000 7fb0b8d99640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a0019af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a0019af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b27fc640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a000dbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 0x7fb0a000d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a000d070 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0006b00 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:56.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.191+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:56.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.392+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:56.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.392+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:56.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.392+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:56.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.793+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:56.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.793+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:56.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:56.794+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:57.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:57.594+0000 7fb0b3fff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:57.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:57.594+0000 7fb0b3fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:46:57.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:57.596+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:46:59.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:59.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0006b00 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:46:59.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a0013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:46:59.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 0x7fb0a001a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:59.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b959a640 1 -- reap_dead start 2024-04-22T06:46:59.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:59.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a000d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:46:59.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b415c030 con 0x7fb0a0004eb0 2024-04-22T06:46:59.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40c2720 con 0x7fb0a0005c60 2024-04-22T06:46:59.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b27fc640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a0014870 con 0x7fb0a0004ad0 2024-04-22T06:46:59.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 msgr2=0x7fb0a001a030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:59.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 0x7fb0a001a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:59.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:59.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.191+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:59.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.192+0000 7fb0b959a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:59.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.192+0000 7fb0b959a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:46:59.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.392+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 msgr2=0x7fb0a001a030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:59.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.392+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 0x7fb0a001a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:59.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.392+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:59.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.392+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:59.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.393+0000 7fb0b959a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:59.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.394+0000 7fb0b959a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:46:59.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.793+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 msgr2=0x7fb0a001a030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:46:59.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.793+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 0x7fb0a001a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:59.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.793+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:46:59.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.793+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:46:59.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.795+0000 7fb0b959a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:46:59.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:46:59.795+0000 7fb0b959a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:00.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:00.594+0000 7fb0b8d99640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 msgr2=0x7fb0a001a030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:00.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:00.594+0000 7fb0b8d99640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 0x7fb0a001a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:00.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:00.594+0000 7fb0b3fff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:00.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:00.595+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:00.596 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:00.597+0000 7fb0b959a640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:00.596 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:00.597+0000 7fb0b959a640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:02.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b27fc640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 msgr2=0x7fb0a0005290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:02.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b27fc640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb0a0004ad0 0x7fb0a0005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:02.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b27fc640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 msgr2=0x7fb0a000d490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:02.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb0a0005c60 0x7fb0a000d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:02.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b27fc640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 msgr2=0x7fb0a001a030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:02.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b27fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0a0004eb0 0x7fb0a001a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:02.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b27fc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a0013500 con 0x7fb0a000d070 2024-04-22T06:47:02.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b27fc640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40c7f90 con 0x7fb0a000a790 2024-04-22T06:47:02.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:02.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.191+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:02.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.392+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:02.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.392+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:02.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.793+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:02.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:02.793+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:03.592 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:03.594+0000 7fb0b3fff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7fb0a000d070 legacy=0x7fb0a000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:03.593 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:03.594+0000 7fb0b8d99640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7fb0a000a790 legacy=0x7fb0a0013b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:05.100 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-22T06:47:05.102 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T06:47:05.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.210+0000 7f971c3e6640 1 Processor -- start 2024-04-22T06:47:05.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.210+0000 7f971c3e6640 1 -- start start 2024-04-22T06:47:05.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.211+0000 7f971c3e6640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f971415e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:05.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.211+0000 7f971c3e6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406c850 con 0x7f97141553a0 2024-04-22T06:47:05.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.211+0000 7f971c3e6640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f97140c8070 2024-04-22T06:47:05.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.211+0000 7f971c3e6640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f97140c8e10 2024-04-22T06:47:05.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.211+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f97141553a0 legacy=0x7f97140c8700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:05.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.213+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f971415e670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:05.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.213+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f971415ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:05.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.213+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f971415e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:05.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.412+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f97141553a0 legacy=0x7f97140c8700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:05.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.414+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f971415ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:05.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.414+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f971415e670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:05.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.414+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f971415e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.813+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f97141553a0 legacy=0x7f97140c8700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:05.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.816+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f971415ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:05.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.816+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f971415e670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:05.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:05.816+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f971415e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:06.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:06.614+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f97141553a0 legacy=0x7f97140c8700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:06.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:06.618+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f971415ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:06.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:06.618+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f971415e670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:06.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:06.618+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f971415e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.211+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f971415e670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.211+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f971415e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.211+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f971415ebb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.211+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f97141553a0 legacy=0x7f97140c8700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.211+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 0x7f96f8005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.211+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 0x7f96f8008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.211+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80061c0 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.212+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f80036a0 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.212+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 msgr2=0x7f96f8008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:08.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.212+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 0x7f96f8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:08.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.212+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 msgr2=0x7f96f8005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:08.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.212+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 0x7f96f8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.413+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 msgr2=0x7f96f8008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:08.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.413+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 0x7f96f8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.414+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 msgr2=0x7f96f8005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:08.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.414+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 0x7f96f8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:08.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.814+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 msgr2=0x7f96f8008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:08.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.814+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 0x7f96f8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:08.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.815+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 msgr2=0x7f96f8005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:08.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:08.815+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 0x7f96f8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:09.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:09.615+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 msgr2=0x7f96f8008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:09.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:09.615+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 0x7f96f8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:09.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:09.616+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 msgr2=0x7f96f8005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:09.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:09.616+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 0x7f96f8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:11.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 msgr2=0x7f96f8005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:11.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80036a0 0x7f96f8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:11.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 msgr2=0x7f96f8008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:11.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80061c0 0x7f96f8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:11.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:11.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f96f800b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:11.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f8003ae0 2024-04-22T06:47:11.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406c850 con 0x7f97140c8070 2024-04-22T06:47:11.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f97140c8e10 2024-04-22T06:47:11.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.212+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8003ae0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:11.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.213+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f96f800b100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:11.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.213+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f96f800d680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:11.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.213+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f96f800b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:11.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.413+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8003ae0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:11.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.415+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f96f800b100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:11.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.415+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f96f800b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:11.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.415+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f96f800d680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:11.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.814+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8003ae0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:11.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.817+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f96f800b100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:11.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.817+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f96f800d680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:11.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:11.817+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f96f800b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:12.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:12.615+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8003ae0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:12.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:12.618+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f96f800d680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:12.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:12.618+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f96f800b100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:12.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:12.618+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f96f800b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:12.820 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:47:12.823 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:47:14.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 msgr2=0x7f96f800b100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f97140c8e10 0x7f96f800b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f97140c8070 legacy=0x7f96f800d680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8003ae0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 0x7f96f80081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8007df0 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f8010de0 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 msgr2=0x7f96f80081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:14.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.212+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 0x7f96f80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.213+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:14.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.213+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:14.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.413+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 msgr2=0x7f96f80081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:14.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.413+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 0x7f96f80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:14.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.415+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:14.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.415+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:14.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.814+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 msgr2=0x7f96f80081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:14.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.814+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 0x7f96f80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:14.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.816+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:14.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:14.816+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:15.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:15.615+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 msgr2=0x7f96f80081d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:15.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:15.615+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 0x7f96f80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:15.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:15.618+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:15.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:15.618+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:17.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:17.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:17.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 msgr2=0x7f96f80081d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:17.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007df0 0x7f96f80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:17.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:17.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:17.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 0x7f96f800f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f80081d0 2024-04-22T06:47:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800edd0 2024-04-22T06:47:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f8010de0 2024-04-22T06:47:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 msgr2=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.212+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 0x7f96f800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.213+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.213+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:17.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.213+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:17.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.413+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 msgr2=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:17.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.413+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 0x7f96f800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:17.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.414+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:17.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.415+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:17.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.415+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.814+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 msgr2=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:17.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.814+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 0x7f96f800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:17.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.815+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:17.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.816+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:17.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:17.816+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:18.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:18.615+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 msgr2=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:18.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:18.615+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 0x7f96f800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:18.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:18.618+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:18.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:18.618+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:18.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:18.618+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:20.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:20.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:20.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 msgr2=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:20.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800edd0 0x7f96f800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 0x7f96f800fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f8010120 2024-04-22T06:47:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800f770 2024-04-22T06:47:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010120 legacy=0x7f96f8010530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.213+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 msgr2=0x7f96f800fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:20.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.214+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 0x7f96f800fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:20.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.414+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010120 legacy=0x7f96f8010530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:20.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.415+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 msgr2=0x7f96f800fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:20.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.415+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 0x7f96f800fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:20.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.815+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010120 legacy=0x7f96f8010530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.816+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 msgr2=0x7f96f800fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:20.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:20.816+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 0x7f96f800fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:21.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:21.616+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010120 legacy=0x7f96f8010530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:21.618+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 msgr2=0x7f96f800fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:21.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:21.618+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 0x7f96f800fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:23.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 msgr2=0x7f96f800fb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f770 0x7f96f800fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010120 legacy=0x7f96f8010530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 0x7f96f8007680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800edd0 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8010120 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f8010de0 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.213+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 msgr2=0x7f96f8007680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.214+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800edd0 legacy=0x7f96f8010500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.214+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 0x7f96f8007680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:23.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.214+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:23.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.214+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:23.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.415+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:23.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.415+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:23.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.415+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800edd0 legacy=0x7f96f8010500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:23.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.415+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 msgr2=0x7f96f8007680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:23.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.415+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 0x7f96f8007680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:23.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.817+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:23.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.817+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 msgr2=0x7f96f8007680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:23.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.817+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:23.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.817+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800edd0 legacy=0x7f96f8010500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:23.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:23.817+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 0x7f96f8007680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:24.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:24.619+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 msgr2=0x7f96f8007680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:24.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:24.619+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:24.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:24.619+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800edd0 legacy=0x7f96f8010500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:24.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:24.619+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 0x7f96f8007680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:24.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:24.619+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:26.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 msgr2=0x7f96f80131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:26.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8010de0 0x7f96f80131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:26.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 msgr2=0x7f96f8007680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:26.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f8010120 0x7f96f8007680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:26.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800edd0 legacy=0x7f96f8010500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:26.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:26.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800e6a0 2024-04-22T06:47:26.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80081d0 2024-04-22T06:47:26.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:26.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:26.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.214+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:26.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.415+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:26.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.415+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:26.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.415+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.815+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:26.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.815+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:26.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:26.815+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:27.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:27.616+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:27.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:27.616+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:27.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:27.616+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:29.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:29.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:29.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800f230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:29.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800e6a0 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80081d0 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f8007680 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:29.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.213+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:29.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.414+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:29.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.414+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:29.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.414+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:29.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.414+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:29.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.414+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:29.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.815+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:29.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.815+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:29.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.815+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:29.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.815+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:29.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:29.815+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:30.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:30.616+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:30.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:30.616+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:30.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:30.616+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:30.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:30.616+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:30.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:30.616+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:32.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:32.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f800e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800e6a0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 0x7f96f8014dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800d7e0 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800dbf0 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 msgr2=0x7f96f8014dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d7e0 legacy=0x7f96f800f210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:32.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.213+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 0x7f96f8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:32.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.414+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 msgr2=0x7f96f8014dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:32.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.414+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d7e0 legacy=0x7f96f800f210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:32.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.414+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 0x7f96f8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:32.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.815+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 msgr2=0x7f96f8014dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:32.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.815+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d7e0 legacy=0x7f96f800f210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:32.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:32.815+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 0x7f96f8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:33.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:33.617+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d7e0 legacy=0x7f96f800f210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:33.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:33.617+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 msgr2=0x7f96f8014dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:33.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:33.617+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 0x7f96f8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:35.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 msgr2=0x7f96f8014dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800dbf0 0x7f96f8014dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d7e0 legacy=0x7f96f800f210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 0x7f96f800d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f80081d0 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800f210 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f8007680 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.213+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.214+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:35.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.214+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:35.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.414+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:35.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.414+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:35.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.414+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:35.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.415+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:35.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.415+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:35.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.815+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:35.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.815+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:35.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.815+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:35.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.816+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:35.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:35.816+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:36.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:36.616+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:36.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:36.616+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:36.615 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:36.616+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:36.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:36.617+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:36.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:36.617+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f210 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f800e160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8014d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800d610 2024-04-22T06:47:38.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8010690 2024-04-22T06:47:38.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:38.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:38.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.214+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:38.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.415+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:38.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.415+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:38.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.415+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:38.814 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.816+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:38.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.816+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:38.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:38.816+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:39.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:39.617+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:39.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:39.617+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:39.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:39.617+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:41.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:41.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:41.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:41.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:41.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8006d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800f210 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8010690 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f8007680 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f210 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:41.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.214+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:41.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.415+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:41.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.415+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f210 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:41.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.415+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:41.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.415+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:41.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.415+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:41.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.816+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:41.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.816+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f210 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:41.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.816+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:41.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.816+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:41.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:41.816+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:42.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:42.617+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:42.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:42.617+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f210 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:42.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:42.617+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:42.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:42.617+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:42.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:42.617+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:42.940 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:47:42.944 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:47:44.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 msgr2=0x7f96f800ebb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:44.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8007680 0x7f96f800ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:44.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:44.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8010690 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:44.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f210 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:44.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:44.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800d610 2024-04-22T06:47:44.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80081d0 2024-04-22T06:47:44.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:44.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:44.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.215+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:44.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.416+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:44.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.416+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:44.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.417+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:44.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.817+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:44.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.818+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:44.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:44.818+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:45.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:45.618+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:45.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:45.619+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:45.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:45.619+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:47.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:47.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:47.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800d610 legacy=0x7f96f800da20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:47.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8006d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f8010670 2024-04-22T06:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f80081d0 2024-04-22T06:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800f1f0 2024-04-22T06:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010670 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:47.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.215+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8007360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:47.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.416+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:47.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.416+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010670 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:47.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.416+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:47.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.416+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8007360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:47.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.817+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010670 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:47.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.817+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:47.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.817+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:47.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:47.817+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8007360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:48.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:48.618+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010670 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:48.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:48.618+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:48.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:48.618+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:48.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:48.618+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8007360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:50.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.215+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:50.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.215+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8006d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:50.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.215+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8007360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:50.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.215+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010670 legacy=0x7f96f8006670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:50.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.215+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f800e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:50.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.215+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 0x7f96f8014d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:50.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.215+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800e620 2024-04-22T06:47:50.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.215+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f800ebb0 2024-04-22T06:47:50.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.216+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:50.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.216+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:50.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.216+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:50.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.216+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:50.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.417+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:50.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.417+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:50.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.417+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:50.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.417+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:50.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.818+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:50.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.818+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:50.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.818+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:50.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:50.818+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:51.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:51.619+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:51.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:51.619+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:51.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:51.619+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:51.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:51.619+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:53.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:53.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 msgr2=0x7f96f8014d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800e620 0x7f96f8014d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 0x7f96f80102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406c850 con 0x7f96f800ebb0 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8007680 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f80081d0 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 msgr2=0x7f96f80102b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 0x7f96f80102b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:53.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.216+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:53.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.417+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:53.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.417+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 msgr2=0x7f96f80102b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:53.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.417+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 0x7f96f80102b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:53.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.417+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:53.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.417+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.818+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 msgr2=0x7f96f80102b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.818+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.818+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 0x7f96f80102b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.818+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:53.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:53.818+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:54.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:54.619+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 msgr2=0x7f96f80102b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:54.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:54.619+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:54.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:54.619+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 0x7f96f80102b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:54.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:54.619+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:47:54.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:54.619+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:56.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:56.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:56.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 msgr2=0x7f96f80102b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:56.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8007680 0x7f96f80102b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:56.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800fba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:56.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 0x7f96f8015120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:56.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800f1f0 2024-04-22T06:47:56.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8012d30 2024-04-22T06:47:56.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:56.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 msgr2=0x7f96f8015120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:56.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.216+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 0x7f96f8015120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:56.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.417+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 msgr2=0x7f96f8015120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:56.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.417+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:56.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.417+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 0x7f96f8015120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:56.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.818+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:56.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.818+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 msgr2=0x7f96f8015120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:56.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:56.818+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 0x7f96f8015120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:57.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:57.619+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:57.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:57.619+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 msgr2=0x7f96f8015120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:47:57.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:57.619+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 0x7f96f8015120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 msgr2=0x7f96f8015120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8012d30 0x7f96f8015120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 0x7f96f8015660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406c850 con 0x7f96f8010690 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800f1f0 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80102b0 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 msgr2=0x7f96f8015660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:59.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 0x7f96f8015660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:47:59.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010690 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:59.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.216+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:59.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.417+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 msgr2=0x7f96f8015660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:59.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.417+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 0x7f96f8015660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:47:59.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.417+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010690 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:59.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.417+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:47:59.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.818+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010690 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:47:59.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.818+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 msgr2=0x7f96f8015660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:47:59.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.818+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 0x7f96f8015660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:47:59.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:47:59.819+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:00.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:00.619+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010690 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:00.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:00.619+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 msgr2=0x7f96f8015660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:00.616 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:00.619+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 0x7f96f8015660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:00.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:00.620+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:02.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.216+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 msgr2=0x7f96f8015660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:02.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.216+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80102b0 0x7f96f8015660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:02.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.216+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:02.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.216+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8010690 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:02.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.216+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:02.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.216+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8014d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:02.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.216+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80081d0 2024-04-22T06:48:02.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.216+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f800ebb0 2024-04-22T06:48:02.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.217+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800fd70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:02.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.217+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8014d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:02.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.217+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:02.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.217+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8014d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:02.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.418+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800fd70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:02.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.418+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8014d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:02.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.418+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:02.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.418+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8014d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:02.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.819+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800fd70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:02.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.819+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.819+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8014d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:02.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:02.819+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8014d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:03.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:03.620+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800fd70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:03.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:03.620+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:03.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:03.620+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8014d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:03.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:03.620+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8014d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:05.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8014d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8014d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800fd70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 0x7f96f8006b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800f1f0 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800ebb0 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f80081d0 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8006b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 0x7f96f8006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:05.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:05.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.217+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:05.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.418+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:05.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.418+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8006b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:05.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.418+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 0x7f96f8006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:05.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.418+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:05.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.418+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:05.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.819+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:05.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.819+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8006b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:05.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.819+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 0x7f96f8006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:05.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.819+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:05.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:05.819+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:06.617 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:06.620+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8006b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:06.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:06.620+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:06.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:06.620+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 0x7f96f8006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:06.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:06.620+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:06.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:06.620+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:08.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:08.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8006b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800ebb0 0x7f96f8006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 0x7f96f800e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406c850 con 0x7f96f800fd70 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80070b0 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.217+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:08.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.218+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800fd70 legacy=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:08.415 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.418+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:08.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.418+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:08.416 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.419+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800fd70 legacy=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:08.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.819+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:08.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.819+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:08.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:08.820+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800fd70 legacy=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:09.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:09.620+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:09.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:09.620+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:09.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:09.621+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800fd70 legacy=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:11.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:11.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80070b0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:11.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800fd70 legacy=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:11.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800ebb0 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800f1f0 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f80081d0 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:11.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.217+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:11.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.418+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:11.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.418+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:11.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.418+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:11.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.418+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:11.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.418+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:11.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.819+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:11.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.819+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:11.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.819+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:11.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.819+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:11.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:11.819+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:12.620+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:12.620+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:12.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:12.620+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:12.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:12.621+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:12.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:12.621+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:13.060 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:48:13.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:48:14.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80081d0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 0x7f96f8015ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406c850 con 0x7f96f80106c0 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8006d40 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 msgr2=0x7f96f8015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 0x7f96f8015ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:14.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.217+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:14.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.418+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 msgr2=0x7f96f8015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:14.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.418+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 0x7f96f8015ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:14.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.418+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:14.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.819+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 msgr2=0x7f96f8015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:14.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.819+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 0x7f96f8015ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:14.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:14.819+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:15.620+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 msgr2=0x7f96f8015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:15.620+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:15.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:15.620+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 0x7f96f8015ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:17.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 msgr2=0x7f96f8015ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8006d40 0x7f96f8015ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 0x7f96f8015f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800ebb0 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406c850 con 0x7f96f80081d0 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8013b90 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 msgr2=0x7f96f8015f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:17.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.218+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 0x7f96f8015f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:17.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.419+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:17.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.419+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 msgr2=0x7f96f8015f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:17.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.419+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:17.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.419+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 0x7f96f8015f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:17.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.820+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:17.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.820+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:17.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.820+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 msgr2=0x7f96f8015f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:17.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:17.820+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 0x7f96f8015f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:18.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:18.621+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:18.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:18.621+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 msgr2=0x7f96f8015f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:18.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:18.621+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:18.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:18.621+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 0x7f96f8015f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 msgr2=0x7f96f8015f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f8013b90 0x7f96f8015f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800f1f0 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f80106c0 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:20.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:20.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:20.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.218+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:20.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.419+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:20.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.419+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:20.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.419+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:20.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.419+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:20.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.820+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:20.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.820+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:20.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.820+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:20.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:20.820+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:21.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:21.621+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:21.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:21.621+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:21.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:21.621+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:21.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:21.621+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:23.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:23.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f800f1f0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f80081d0 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80106c0 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f800ebb0 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.218+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.219+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.219+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:23.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.219+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:23.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.219+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:23.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.419+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:23.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.420+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:23.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.420+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:23.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.421+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:23.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.421+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:23.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.820+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:23.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.822+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:23.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.822+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:23.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.822+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:23.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:23.822+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:24.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:24.622+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:24.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:24.624+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:24.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:24.624+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:24.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:24.624+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:24.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:24.624+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:26.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:26.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:26.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f800e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:26.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:26.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:26.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 0x7f96f8015f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:26.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800f1f0 2024-04-22T06:48:26.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8013b60 2024-04-22T06:48:26.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:26.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:26.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.218+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:26.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.419+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:26.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.419+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:26.417 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.419+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.820+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.820+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:26.820+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:27.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:27.621+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:27.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:27.621+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:27.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:27.621+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8013b60 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 0x7f96f8018880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800f1f0 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f8016490 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f800ebb0 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 msgr2=0x7f96f8018880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 0x7f96f8018880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:29.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:29.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:29.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.219+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:29.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.420+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 msgr2=0x7f96f8018880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:29.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.420+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:29.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.420+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 0x7f96f8018880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:29.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.420+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:29.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.420+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.821+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 msgr2=0x7f96f8018880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.821+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:29.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.821+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 0x7f96f8018880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:29.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.821+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:29.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:29.821+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:30.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:30.622+0000 7f971a983640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:30.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:30.622+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 msgr2=0x7f96f8018880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:30.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:30.622+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 0x7f96f8018880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:30.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:30.623+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:30.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:30.623+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:32.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 msgr2=0x7f96f8018880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f8016490 0x7f96f8018880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f80081d0 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80106c0 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:32.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.219+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:32.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.420+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:32.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.420+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:32.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.420+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:32.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.821+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:32.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.821+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:32.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:32.821+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:33.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:33.622+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:33.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:33.622+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:33.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:33.622+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:35.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.219+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:35.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.219+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:35.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.219+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f80081d0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:35.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.219+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.219+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800f1f0 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80081d0 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f80106c0 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:35.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.220+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.421+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.421+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.421+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.421+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:35.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.421+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.822+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:35.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.822+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:35.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.822+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:35.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.822+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:35.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:35.822+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:36.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:36.623+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:36.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:36.623+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:36.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:36.623+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:36.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:36.624+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:36.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:36.624+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:38.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8015f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:38.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8015f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:38.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:38.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:38.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:38.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 0x7f96f8016490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:38.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800ebb0 2024-04-22T06:48:38.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800c0d0 2024-04-22T06:48:38.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 msgr2=0x7f96f8016490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:38.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:38.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.220+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 0x7f96f8016490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:38.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.421+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:38.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.421+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 msgr2=0x7f96f8016490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:38.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.421+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 0x7f96f8016490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:38.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.822+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 msgr2=0x7f96f8016490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:38.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.822+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:38.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:38.822+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 0x7f96f8016490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:39.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:39.624+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 msgr2=0x7f96f8016490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:39.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:39.624+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:39.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:39.624+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 0x7f96f8016490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:41.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 msgr2=0x7f96f8016490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:41.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800c0d0 0x7f96f8016490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 0x7f96f8018dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800ebb0 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80081d0 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f80169d0 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 msgr2=0x7f96f8018dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:41.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.220+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 0x7f96f8018dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:41.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.421+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:41.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.421+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:41.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.421+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:41.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.421+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 msgr2=0x7f96f8018dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:41.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.421+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 0x7f96f8018dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:41.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.822+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:41.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.822+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:41.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.822+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:41.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.822+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 msgr2=0x7f96f8018dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:41.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:41.822+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 0x7f96f8018dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:42.623+0000 7f971a983640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:42.623+0000 7f971a983640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:42.623+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:42.623+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 msgr2=0x7f96f8018dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:42.623+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 0x7f96f8018dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:43.215 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:48:43.218 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 msgr2=0x7f96f8018dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80169d0 0x7f96f8018dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f800b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f80106c0 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800f1f0 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.220+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.221+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:44.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.221+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:44.418 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.421+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:44.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.422+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:44.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.422+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:44.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.822+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:44.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.823+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:44.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:44.823+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:45.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:45.623+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:45.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:45.624+0000 7f9719981640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:45.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:45.624+0000 7f9719981640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:47.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f800b0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:47.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:47.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f80106c0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:47.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:47.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:47.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:47.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800f1f0 2024-04-22T06:48:47.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:47.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80081d0 2024-04-22T06:48:47.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f800ebb0 2024-04-22T06:48:47.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:47.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:47.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:47.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.221+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.422+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:47.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.422+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.422+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.422+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:47.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.422+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:47.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.823+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:47.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.823+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:47.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.823+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:47.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.824+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:47.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:47.824+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:48.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:48.624+0000 7f971a182640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:48.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:48.624+0000 7f971a182640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:48.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:48.624+0000 7f971a983640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:48.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:48.625+0000 7f9719981640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:48.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:48.625+0000 7f9719981640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f800ebb0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:50.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80081d0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:50.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:50.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8012af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:50.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f8013030 2024-04-22T06:48:50.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80106c0 2024-04-22T06:48:50.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:50.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:50.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.221+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8012af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:50.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.422+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:50.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.422+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:50.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.422+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8012af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:50.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.823+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.823+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:50.823+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8012af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:51.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:51.624+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:51.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:51.625+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:51.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:51.625+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8012af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:53.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:53.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f80106c0 0x7f96f8012af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:53.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:53.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:53.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:53.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f8013030 2024-04-22T06:48:53.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406d0f0 con 0x7f96f800f1f0 2024-04-22T06:48:53.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80081d0 2024-04-22T06:48:53.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.221+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:53.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.222+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:53.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.222+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:53.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.222+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:53.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.422+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:53.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.423+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:53.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.423+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:53.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.424+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:53.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.823+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:53.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.825+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:53.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.825+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:53.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:53.826+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:54.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:54.623+0000 7f9719981640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:54.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:54.625+0000 7f971a983640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:48:54.623 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:54.625+0000 7f971a983640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:54.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:54.626+0000 7f971a182640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:56.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f970bfff640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800f1f0 legacy=0x7f96f800f640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 0x7f96f8012ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80106c0 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f800ebb0 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:56.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:56.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:56.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.221+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:56.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.422+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:56.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.422+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:56.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.422+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:56.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.422+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:56.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.823+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:56.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.823+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:56.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.823+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:56.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:56.823+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:48:57.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:57.624+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:48:57.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:57.624+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:57.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:57.625+0000 7f971a182640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:57.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:57.625+0000 7f971a182640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:48:59.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 msgr2=0x7f96f8010180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:59.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800ebb0 0x7f96f8010180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:59.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f970bfff640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:48:59.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80106c0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:48:59.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f971a983640 1 -- reap_dead start 2024-04-22T06:48:59.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f8006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:48:59.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f970bfff640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406c850 con 0x7f96f8013030 2024-04-22T06:48:59.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f970bfff640 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f971406cb30 con 0x7f96f800ebb0 2024-04-22T06:48:59.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f970bfff640 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f800f1f0 2024-04-22T06:48:59.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:59.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:59.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:48:59.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.221+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:59.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.422+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:59.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.422+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:59.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.422+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:59.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.423+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:48:59.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.823+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:48:59.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.825+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:48:59.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.825+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:48:59.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:48:59.825+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:49:00.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:00.624+0000 7f971a182640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.113:6789/0 2024-04-22T06:49:00.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:00.627+0000 7f9719981640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.145:6789/0 2024-04-22T06:49:00.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:00.627+0000 7f971a983640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3300/0 2024-04-22T06:49:00.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:00.627+0000 7f971a983640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:49:02.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f970bfff640 1 -- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 msgr2=0x7f96f8006630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f96f800f1f0 0x7f96f8006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f970bfff640 1 -- >> v1:172.21.15.145:6789/0 conn(0x7f96f800ebb0 legacy=0x7f96f800f600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f970bfff640 1 -- >> v1:172.21.15.113:6789/0 conn(0x7f96f8013030 legacy=0x7f96f8013410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f970bfff640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8012190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f970bfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 0x7f96f8012ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f970bfff640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 -- 0x7f971406ce10 con 0x7f96f80126d0 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f970bfff640 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 -- 0x7f96f8008d30 con 0x7f96f80081d0 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.221+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.222+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8012190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:49:02.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.222+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8012190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T06:49:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.422+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:49:02.420 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.422+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:49:02.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.423+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8012190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:49:02.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.423+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8012190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-22T06:49:02.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.823+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:49:02.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.823+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:49:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.825+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8012190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:49:02.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:02.825+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8012190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-22T06:49:03.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:03.624+0000 7f9719981640 1 -- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 msgr2=0x7f96f8012ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.113:3300/0 2024-04-22T06:49:03.622 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:03.624+0000 7f9719981640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f96f80126d0 0x7f96f8012ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:49:03.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:03.626+0000 7f971a182640 1 -- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 msgr2=0x7f96f8012190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.145:3301/0 2024-04-22T06:49:03.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-04-22T06:49:03.626+0000 7f971a182640 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96f80081d0 0x7f96f8012190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-22T06:49:05.135 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-22T06:49:05.136 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1281, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi113 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-22T06:49:05.138 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-22T06:49:05.139 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-22T06:49:05.139 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.139 INFO:tasks.ceph.mds.a:Stopped 2024-04-22T06:49:05.139 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-22T06:49:05.139 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.139 INFO:tasks.ceph.mds.c:Stopped 2024-04-22T06:49:05.139 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-22T06:49:05.140 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.140 INFO:tasks.ceph.mds.e:Stopped 2024-04-22T06:49:05.140 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-22T06:49:05.140 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.140 INFO:tasks.ceph.mds.b:Stopped 2024-04-22T06:49:05.140 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-22T06:49:05.140 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.140 INFO:tasks.ceph.mds.d:Stopped 2024-04-22T06:49:05.141 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-22T06:49:05.141 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.141 INFO:tasks.ceph.mds.f:Stopped 2024-04-22T06:49:05.141 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-22T06:49:05.141 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-22T06:49:05.141 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.141 INFO:tasks.ceph.osd.0:Stopped 2024-04-22T06:49:05.141 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-22T06:49:05.141 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.142 INFO:tasks.ceph.osd.1:Stopped 2024-04-22T06:49:05.142 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-22T06:49:05.142 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.142 INFO:tasks.ceph.osd.2:Stopped 2024-04-22T06:49:05.142 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-22T06:49:05.142 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.142 INFO:tasks.ceph.osd.3:Stopped 2024-04-22T06:49:05.142 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-22T06:49:05.143 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.143 INFO:tasks.ceph.osd.4:Stopped 2024-04-22T06:49:05.143 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-22T06:49:05.143 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.143 INFO:tasks.ceph.osd.5:Stopped 2024-04-22T06:49:05.143 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-22T06:49:05.143 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.143 INFO:tasks.ceph.osd.6:Stopped 2024-04-22T06:49:05.143 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-22T06:49:05.144 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.144 INFO:tasks.ceph.osd.7:Stopped 2024-04-22T06:49:05.144 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-22T06:49:05.144 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-22T06:49:05.144 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.144 INFO:tasks.ceph.mgr.y:Stopped 2024-04-22T06:49:05.144 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-22T06:49:05.144 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:49:05.145 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1281, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi113 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi145 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2024-04-22T06:49:05.145 INFO:tasks.ceph.mgr.x:Stopped 2024-04-22T06:49:05.145 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-22T06:49:05.145 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-22T06:49:05.146 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.146 INFO:tasks.ceph.mon.a:Stopped 2024-04-22T06:49:05.146 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-22T06:49:05.146 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.146 INFO:tasks.ceph.mon.b:Stopped 2024-04-22T06:49:05.146 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-22T06:49:05.146 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T06:49:05.146 INFO:tasks.ceph.mon.c:Stopped 2024-04-22T06:49:05.147 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-22T06:49:05.147 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-22T06:49:05.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:49:05.191 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-22T06:49:05.352 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:49:05.352 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-22T06:49:05.418 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:49:05.418 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-22T06:49:05.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:49:05.484 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-22T06:49:05.558 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:49:05.558 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-22T06:49:05.720 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:49:05.720 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-22T06:49:05.774 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:49:05.775 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-22T06:49:05.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:49:05.835 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-22T06:49:05.884 INFO:tasks.ceph:Archiving mon data... 2024-04-22T06:49:05.886 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/data/mon.a.tgz 2024-04-22T06:49:05.886 DEBUG:teuthology.orchestra.run.smithi113:> mktemp 2024-04-22T06:49:05.901 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.25rx1DapQs 2024-04-22T06:49:05.901 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.25rx1DapQs 2024-04-22T06:49:06.042 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0666 /tmp/tmp.25rx1DapQs 2024-04-22T06:49:06.123 DEBUG:teuthology.orchestra.remote:smithi113:/tmp/tmp.25rx1DapQs is 284KB 2024-04-22T06:49:06.217 DEBUG:teuthology.orchestra.run.smithi113:> rm -fr /tmp/tmp.25rx1DapQs 2024-04-22T06:49:06.230 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/data/mon.b.tgz 2024-04-22T06:49:06.231 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-04-22T06:49:06.250 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.SeCK5mxQ1b 2024-04-22T06:49:06.250 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SeCK5mxQ1b 2024-04-22T06:49:06.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.SeCK5mxQ1b 2024-04-22T06:49:06.491 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.SeCK5mxQ1b is 383KB 2024-04-22T06:49:06.527 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.SeCK5mxQ1b 2024-04-22T06:49:06.543 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/data/mon.c.tgz 2024-04-22T06:49:06.543 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-04-22T06:49:06.601 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.1K5q6IGbmp 2024-04-22T06:49:06.601 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1K5q6IGbmp 2024-04-22T06:49:06.737 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.1K5q6IGbmp 2024-04-22T06:49:06.825 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.1K5q6IGbmp is 383KB 2024-04-22T06:49:06.900 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.1K5q6IGbmp 2024-04-22T06:49:06.916 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-22T06:49:06.916 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T06:49:06.918 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T06:49:06.997 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-22T06:49:07.039 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-22T06:49:07.039 INFO:tasks.ceph:Archiving crash dumps... 2024-04-22T06:49:07.041 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/remote/smithi113/crash 2024-04-22T06:49:07.042 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T06:49:07.065 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/remote/smithi145/crash 2024-04-22T06:49:07.067 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T06:49:07.104 INFO:tasks.ceph:Shutting down logrotate 2024-04-22T06:49:07.104 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:49:07.109 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T06:49:07.215 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-22T06:49:07.238 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-22T06:49:07.261 INFO:tasks.ceph:Compressing logs... 2024-04-22T06:49:07.262 DEBUG:teuthology.orchestra.run.smithi113:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-22T06:49:07.279 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-22T06:49:07.343 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33534.log 2024-04-22T06:49:07.343 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-22T06:49:07.343 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33534.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33534.log.gz 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33283.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33574.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33283.log: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33574.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33283.log.gz 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33323.log 2024-04-22T06:49:07.344 INFO:teuthology.orchestra.run.smithi145.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33574.log.gz 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33323.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33323.log.gz 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5/var/log/ceph/ceph-mon.c.log: --verbose -- /var/log/ceph/ceph-client.admin.33363.log 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33494.log 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33363.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33363.log.gz 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33494.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33494.log.gz 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mds.d.log: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-22T06:49:07.345 INFO:teuthology.orchestra.run.smithi145.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-22T06:49:07.349 INFO:teuthology.orchestra.run.smithi145.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-22T06:49:07.349 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33407.log 2024-04-22T06:49:07.350 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33454.log 2024-04-22T06:49:07.350 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33407.log: /var/log/ceph/ceph-mon.b.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33407.log.gz 2024-04-22T06:49:07.350 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33454.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33454.log.gz 2024-04-22T06:49:07.354 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47508.log 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47466.log 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39870.log 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47466.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47508.log.gz 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44303.log 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47466.log.gz 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42609.log 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39870.log.gz 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42609.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44303.log.gz 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40165.log 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42609.log.gz 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47156.log 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40165.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2024-04-22T06:49:07.355 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47156.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40165.log.gz 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45326.log 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47156.log.gz 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42652.log 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48209.log 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45326.log.gz 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48209.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42652.log.gz 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48039.log 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41089.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48209.log.gz 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43628.log 2024-04-22T06:49:07.356 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48039.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43344.log 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48039.log.gz 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42302.log 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3%/var/log/ceph/ceph-client.admin.43344.log: -- replaced with /var/log/ceph/ceph-client.admin.43628.log.gz 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42888.log 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43344.log.gz 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42888.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42302.log.gz 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47240.log 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41257.log 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42888.log.gz 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47240.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45662.log 2024-04-22T06:49:07.357 INFO:teuthology.orchestra.run.smithi113.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47240.log.gz 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45943.log 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44219.log 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41257.log.gz 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47550.log 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45662.log.gz 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44219.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45943.log.gz 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45128.log 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47550.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44219.log.gz 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47550.log.gz/var/log/ceph/ceph-client.0.45128.log: 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43498.log 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46558.log 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39658.log 2024-04-22T06:49:07.358 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46558.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43498.log.gz 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39572.log 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46359.log 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39658.log: /var/log/ceph/ceph-client.admin.39572.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.46558.log.gz 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48123.log 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39658.log.gz 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46359.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39572.log.gz 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43045.log 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.46359.log.gz 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.2.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48123.log.gz 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42649.log 2024-04-22T06:49:07.359 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44051.log 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43045.log: /var/log/ceph/ceph-client.admin.42649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39700.log 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43045.log.gz 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44051.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.42649.log.gz 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46668.log 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44051.log.gz 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42284.log 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42031.log 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46668.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39700.log.gz 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42284.log.gz 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42031.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46668.log.gz 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40855.log 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39993.log 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47781.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42031.log.gz 2024-04-22T06:49:07.360 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48815.log 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46212.log 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48815.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39993.log.gz 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph.audit.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46212.log.gz 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45494.log 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.40855.log.gz 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43582.log 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42610.log 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.45128.log.gz 2024-04-22T06:49:07.361 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43582.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph.audit.log.gz -- 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr: /var/log/ceph/ceph-client.admin.43757.log 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45494.log.gz 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:gzip/var/log/ceph/ceph-client.admin.42610.log: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.48815.log.gz 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43582.log.gz 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43757.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42610.log.gz 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42295.log 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42115.log 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48917.log 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46028.log 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2024-04-22T06:49:07.362 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48917.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.42115.log.gz 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46028.log.gz 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43340.log 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33443.log 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44345.log: /var/log/ceph/ceph-client.admin.43340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39614.log 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.33443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47114.log 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39614.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33443.log.gz 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39614.log.gz 2024-04-22T06:49:07.363 INFO:teuthology.orchestra.run.smithi113.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.48917.log.gz 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44477.log 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39357.log 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47114.log.gz 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44477.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45986.log 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42991.log 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44477.log.gz 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39357.log.gz 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41947.log 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45986.log.gz 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41947.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42991.log.gz 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-22T06:49:07.364 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41947.log.gz 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40080.log 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42287.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41441.log 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43967.log 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40080.log.gz 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41441.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43967.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41441.log.gz 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43967.log.gz/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41357.log 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44543.log 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44543.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41357.log.gz 2024-04-22T06:49:07.365 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44735.log 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48167.log 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42947.log: 91.0%/var/log/ceph/ceph-client.admin.44735.log: -- replaced with /var/log/ceph/ceph-client.admin.44543.log.gz 88.7% 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44735.log.gz 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41047.log 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43204.log 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48167.log.gz 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.41047.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41047.log.gz 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39914.log 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43204.log.gz 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40249.log 2024-04-22T06:49:07.366 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43715.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39914.log.gz 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40249.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40249.log.gz 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44261.log 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40291.log: /var/log/ceph/ceph-client.admin.44261.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48377.log 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48081.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41603.log 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42293.log 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48377.log: /var/log/ceph/ceph-client.admin.41603.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41603.log.gz 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.48377.log.gz 2024-04-22T06:49:07.367 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39784.log 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27164.log 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39784.log: /var/log/ceph/ceph-client.admin.42293.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42293.log.gz 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39784.log.gz 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40036.log 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46998.log 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph.tmp-client.admin.27164.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27164.log.gz 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47198.log 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40036.log.gz 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48293.log 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47198.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47198.log.gz 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46998.log.gz 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42946.log 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41905.log 2024-04-22T06:49:07.368 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48293.log: /var/log/ceph/ceph-client.admin.42946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48293.log.gz 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42946.log.gz 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41645.log 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46293.log: /var/log/ceph/ceph-client.admin.41905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41905.log.gz 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48251.log 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47955.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41645.log.gz 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45536.log 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45536.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48251.log.gz 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45536.log.gz 2024-04-22T06:49:07.369 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42611.log 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44009.log: /var/log/ceph/ceph-client.admin.42611.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42611.log.gz 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41215.log: /var/log/ceph/ceph-client.admin.47282.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gz 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42600.log 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.45368.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40445.log 2024-04-22T06:49:07.370 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42600.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42600.log.gz 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42073.log 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40445.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40445.log.gz 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42073.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42073.log.gz 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49020.log 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48713.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gz 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49020.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.49020.log.gz 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46492.log 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44093.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2024-04-22T06:49:07.371 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2024-04-22T06:49:07.397 INFO:teuthology.orchestra.run.smithi145.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46492.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46492.log.gz 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43925.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40375.log 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48503.log: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45901.log 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40375.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40375.log.gz 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39826.log 2024-04-22T06:49:07.409 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45901.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45901.log.gz 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40207.log 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39826.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39826.log.gz 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45807.log 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40207.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40207.log.gz 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43332.log 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45807.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45807.log.gz 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43334.log 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43332.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43332.log.gz 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43334.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43334.log.gz 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40333.log 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mds.e.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45410.log 2024-04-22T06:49:07.410 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40333.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40333.log.gz 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33546.log 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45410.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45410.log.gz 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47382.log 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.33546.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33546.log.gz 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45704.log 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47382.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47382.log.gz 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42948.log 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45704.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45704.log.gz 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46070.log 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42948.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42948.log.gz 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42294.log 2024-04-22T06:49:07.411 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46955.log 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46070.log.gz 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42294.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42294.log.gz 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41315.log 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45452.log 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46955.log: /var/log/ceph/ceph-client.admin.41315.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46955.log.gz 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41315.log.gz 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45620.log 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45452.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45452.log.gz 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41863.log 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41687.log 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr: 87.5%/var/log/ceph/ceph-client.admin.41863.log: -- replaced with /var/log/ceph/ceph-client.admin.45620.log.gz 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45853.log 2024-04-22T06:49:07.412 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41863.log.gz 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39472.log 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41821.log 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45853.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41687.log.gz 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39472.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45853.log.gz 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39472.log.gz 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41399.log 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41821.log.gz 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41483.log 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz/var/log/ceph/ceph-client.admin.41399.log: 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46425.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41399.log.gz 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-04-22T06:49:07.413 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43799.log 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41483.log.gz 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41779.log 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45746.log 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46425.log.gz 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43799.log.gz 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41779.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41779.log.gz 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44411.log 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44135.log 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44411.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45746.log.gz 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43540.log 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42612.log 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44135.log: /var/log/ceph/ceph-client.admin.43540.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44411.log.gz 2024-04-22T06:49:07.414 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44135.log.gz 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43540.log.gz 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40122.log 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5/var/log/ceph/ceph-client.admin.42612.log: --verbose -- /var/log/ceph/ceph-client.admin.42282.log 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.40122.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42612.log.gz 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47997.log 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40122.log.gz 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39265.log 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42282.log.gz 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.39265.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43673.log 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47997.log.gz 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39265.log.gz 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43841.log 2024-04-22T06:49:07.415 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47424.log 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43841.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43673.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43841.log.gz 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44609.log 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47424.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45284.log 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44609.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47424.log.gz 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48335.log 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45284.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45284.log.gz 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42608.log 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48335.log: /var/log/ceph/ceph-client.admin.47648.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48335.log.gz 2024-04-22T06:49:07.416 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48608.log 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42608.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42608.log.gz 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43883.log 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47592.log 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48608.log: /var/log/ceph/ceph-client.admin.43883.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43883.log.gz 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.48608.log.gz 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39742.log 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41729.log 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47592.log: /var/log/ceph/ceph-client.admin.39742.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47592.log.gz 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39742.log.gz 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41173.log 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41729.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41729.log.gz 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2024-04-22T06:49:07.417 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41131.log 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41173.log: /var/log/ceph/ceph-client.admin.47324.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr: 93.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43046.log 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33182.log 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41131.log.gz 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.33182.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43046.log.gz 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41989.log 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42887.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33182.log.gz 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42288.log 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41525.log 2024-04-22T06:49:07.418 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-04-22T06:49:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41989.log: /var/log/ceph/ceph-client.admin.42288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45578.log 2024-04-22T06:49:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.41525.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41989.log.gz 2024-04-22T06:49:07.419 INFO:teuthology.orchestra.run.smithi113.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42288.log.gz 2024-04-22T06:49:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41525.log.gz 2024-04-22T06:49:07.419 INFO:teuthology.orchestra.run.smithi113.stderr: /var/log/ceph/ceph-client.admin.47829.log 2024-04-22T06:49:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45578.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45578.log.gz 2024-04-22T06:49:07.419 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47829.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47829.log.gz 2024-04-22T06:49:07.453 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-22T06:49:07.544 INFO:teuthology.orchestra.run.smithi113.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-22T06:49:07.959 INFO:teuthology.orchestra.run.smithi145.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-22T06:49:07.965 INFO:teuthology.orchestra.run.smithi145.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-22T06:49:07.967 INFO:teuthology.orchestra.run.smithi145.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-22T06:49:07.968 INFO:teuthology.orchestra.run.smithi145.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-22T06:49:07.970 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-04-22T06:49:07.970 INFO:teuthology.orchestra.run.smithi145.stderr:real 0m0.650s 2024-04-22T06:49:07.971 INFO:teuthology.orchestra.run.smithi145.stderr:user 0m2.648s 2024-04-22T06:49:07.971 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m0.110s 2024-04-22T06:49:07.972 INFO:teuthology.orchestra.run.smithi113.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-22T06:49:07.986 INFO:teuthology.orchestra.run.smithi113.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-22T06:49:07.992 INFO:teuthology.orchestra.run.smithi113.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-22T06:49:08.033 INFO:teuthology.orchestra.run.smithi113.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-22T06:49:08.035 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-04-22T06:49:08.035 INFO:teuthology.orchestra.run.smithi113.stderr:real 0m0.744s 2024-04-22T06:49:08.035 INFO:teuthology.orchestra.run.smithi113.stderr:user 0m3.042s 2024-04-22T06:49:08.035 INFO:teuthology.orchestra.run.smithi113.stderr:sys 0m0.209s 2024-04-22T06:49:08.035 INFO:tasks.ceph:Archiving logs... 2024-04-22T06:49:08.035 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/remote/smithi113/log 2024-04-22T06:49:08.036 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-22T06:49:08.642 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/remote/smithi145/log 2024-04-22T06:49:08.643 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-22T06:49:09.059 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph.py", line 1281, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi113 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-22T06:49:09.059 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-22T06:49:09.068 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) 2024-04-22T06:49:09.069 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-22T06:49:09.069 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T06:49:09.072 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T06:49:09.175 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-22T06:49:09.184 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-22T06:49:09.184 DEBUG:teuthology.orchestra.run.smithi113:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T06:49:09.186 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T06:49:09.198 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 1: ntpq: command not found 2024-04-22T06:49:09.203 INFO:teuthology.orchestra.run.smithi113.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T06:49:09.203 INFO:teuthology.orchestra.run.smithi113.stdout:=============================================================================== 2024-04-22T06:49:09.203 INFO:teuthology.orchestra.run.smithi113.stdout:^- hv01.front.sepia.ceph.com 2 6 377 4 +1217us[+1220us] +/- 572ms 2024-04-22T06:49:09.203 INFO:teuthology.orchestra.run.smithi113.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -94us[ -90us] +/- 72ms 2024-04-22T06:49:09.203 INFO:teuthology.orchestra.run.smithi113.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +120us[ +120us] +/- 79ms 2024-04-22T06:49:09.203 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:49:09.204 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-04-22T06:49:09.210 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T06:49:09.210 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-04-22T06:49:09.210 INFO:teuthology.orchestra.run.smithi145.stdout:^- hv01.front.sepia.ceph.com 2 6 377 68 +1259us[+1261us] +/- 571ms 2024-04-22T06:49:09.210 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv02.front.sepia.ceph.com 3 6 377 5 -119us[ -117us] +/- 72ms 2024-04-22T06:49:09.210 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 68 +118us[ +120us] +/- 78ms 2024-04-22T06:49:09.210 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T06:49:09.210 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-22T06:49:09.227 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-22T06:49:09.228 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-22T06:49:09.243 DEBUG:teuthology.orchestra.run.smithi113:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-22T06:49:09.308 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-22T06:49:09.372 DEBUG:teuthology.orchestra.run.smithi113:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T06:49:09.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:49:09.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T06:49:09.426 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:49:09.427 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-22T06:49:09.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-22T06:49:09.448 INFO:teuthology.task.internal:Duration was 1449.707459 seconds 2024-04-22T06:49:09.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-22T06:49:09.460 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-22T06:49:09.460 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T06:49:09.462 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T06:49:09.496 INFO:teuthology.orchestra.run.smithi113.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T06:49:09.507 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T06:49:09.731 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-22T06:49:09.731 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi113.front.sepia.ceph.com 2024-04-22T06:49:09.731 DEBUG:teuthology.orchestra.run.smithi113:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T06:49:09.768 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-04-22T06:49:09.768 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T06:49:09.801 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-22T06:49:09.801 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T06:49:09.811 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T06:49:09.868 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-22T06:49:09.868 DEBUG:teuthology.orchestra.run.smithi113:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T06:49:09.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T06:49:10.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-22T06:49:10.025 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-22T06:49:10.026 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T06:49:10.049 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T06:49:10.073 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-22T06:49:10.084 DEBUG:teuthology.orchestra.run.smithi113:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T06:49:10.092 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T06:49:10.111 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = core 2024-04-22T06:49:10.138 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-04-22T06:49:10.159 DEBUG:teuthology.orchestra.run.smithi113:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T06:49:10.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:49:10.177 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T06:49:10.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T06:49:10.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-22T06:49:10.225 INFO:teuthology.task.internal:Transferring archived files... 2024-04-22T06:49:10.226 DEBUG:teuthology.misc:Transferring archived files from smithi113:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/remote/smithi113 2024-04-22T06:49:10.227 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T06:49:10.260 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134/remote/smithi145 2024-04-22T06:49:10.260 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T06:49:10.293 INFO:teuthology.task.internal:Removing archive directory... 2024-04-22T06:49:10.293 DEBUG:teuthology.orchestra.run.smithi113:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T06:49:10.296 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T06:49:10.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-22T06:49:10.355 INFO:teuthology.task.internal:Not uploading archives. 2024-04-22T06:49:10.355 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-22T06:49:10.366 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-22T06:49:10.366 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T06:49:10.368 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T06:49:10.380 INFO:teuthology.orchestra.run.smithi113.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 06:49 /home/ubuntu/cephtest 2024-04-22T06:49:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 06:49 /home/ubuntu/cephtest 2024-04-22T06:49:10.402 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-22T06:49:10.413 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-22T06:49:10.425 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during quiesce thrashing: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0) 2024-04-22T06:49:10.426 INFO:teuthology.nuke:Checking targets against current locks 2024-04-22T06:49:10.458 DEBUG:teuthology.nuke:shortname: smithi113 2024-04-22T06:49:10.458 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-22T06:49:10.500 DEBUG:teuthology.nuke:shortname: smithi145 2024-04-22T06:49:10.500 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-22T06:49:10.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 06:18:58.690215', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZ+77ifGZn2SiyzutY+8PjwaIY2E0agniXCAOSoNasPOzGOp5fR+Wle6IyCvhVhzh7Hc2OSF6w/MIKLr6txO14='} 2024-04-22T06:49:10.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668134', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 06:18:58.689080', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOWuUrUsYKZM9f3ntSvSFzMMULsB7naGYopwRAMwxaMNMQS4zAq7B1mBDsdK2ZH7UMBHL9Erac9RHCiWANJzEYI='} 2024-04-22T06:49:10.587 INFO:teuthology.orchestra.console.smithi113:Power off 2024-04-22T06:49:10.587 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-22T06:49:10.637 INFO:teuthology.orchestra.console.smithi145:Power off 2024-04-22T06:49:10.637 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-22T06:49:10.647 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-04-22T06:49:10.648 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T06:49:10.685 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2024-04-22T06:49:10.685 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T06:49:10.701 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-22T06:49:10.733 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-04-22T06:49:14.703 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T06:49:14.734 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T06:49:14.813 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-22T06:49:14.842 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-04-22T06:49:18.818 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T06:49:18.842 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T06:49:18.928 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-22T06:49:18.951 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-04-22T06:49:22.932 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T06:49:22.952 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-22T06:49:23.042 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-22T06:49:23.061 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-04-22T06:49:23.143 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-04-22T06:49:23.162 INFO:teuthology.orchestra.console.smithi145:Power off completed 2024-04-22T06:49:23.267 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/fs/trivial_sync}} duration: 1449.7074592113495 failure_reason: 'error during quiesce thrashing: Error parsing quiesce response: Expecting value: line 1 column 1 (char 0)' flavor: default owner: scheduled_leonidus@teuthology status: fail success: false 2024-04-22T06:49:23.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T06:49:23.366 INFO:teuthology.run:FAIL